A small TV displays btop, a computer resource monitoring program. The colorful indicators are showing that the CPU and memory are fully utilized.
Top view of a Libre Computer ROC-RK3328-CC single board computer. The computer is about the size of a credit card, and is connected to an HDMI cable, power supply, ethernet, and a wireless dongle for keyboard + mouse. The SBC has four 64-bit low-power cores and 4GB of DDR4 RAM.
A screenshot showing the output from the Alpaca program running on my laptop. Alpaca is a client program that allows you to chat with AI models. In this case, the local LLM is running on the Libre Computer single board computer shown earlier.
Chuffed! ๐
I needed to keep dog company while the plumber fixed a leak, so I grabbed some stuff & set it up on the dining room table. I tested small LLMs, then set it all up as a service and accessed it from my laptop.
#ittybittyservers #homelab #LibreComputer #selfhosting #Ollama #Alpaca #btop