Just updated #janai, and oh my it's improved a lot. With the Jan nano model, the token speed is at 47 tokens/sec on my mac. Pretty impressive.

#RunLLMLocally #LocalLLM #LocalAI