youtube.com/watch?v=0fWF...
#1bit #LLM #noGPU #noNPU #justCPU

The prospect of functional #edgeLLM in a #RISC-V instruction extension (or M chip) already may have popped #AIbubble. The #TurboQuant #KVC optimization was less disruptive than this approach to small AIs useful for #privacy or #latency.

Developing Generative AI Applications in Go with Ollama Developing Generative AI Applications in Go with Ollama (and Tiny models)

You can totally build #GenAI apps without a GPU using baby models 🤱, Ollama, and #golang! No need for fancy hardware to get started with AI development 🚀 #TinyLLM #NoGPU

k33g.hashnode.dev/developing-g...

screenshot of the game "Eternal Return", but at a very low resolution

When your computer is so underpowered that you are forced to play everything with pixelart graphics:

#pixelart #gaming #laptop #noGPU #toaster #retro #retrogaming #linuxgaming #linux #steam #EternalReturn

Awesome SLMs

👋☕️ Good morning
I'm addicted to the Small Language Models (or tiny models) and run the SMLs on a @raspberrypi.bsky.social 5 (8GB RAM)
I maintain a page to list the models running on my Pi:
parakeet-nest.github.io/awesome-slms...
With some benchmarks:
parakeet-nest.github.io/awesome-slms...

#NoGPU