Gone full LLM-benchmarking-nut on laptop: iGPU/dGPU/NPU/CPU
Verdict: RTX 4070 king @ 45 t/s. OpenArc's iGPU is the dark horse 16.5 t/s & <1s TTFT! Smokes default Ollama. My year-idle Intel NPU? 9.6 t/s. Full torture report: github.com/SearchSavior...
#IntelNPU #Benchmark #LLMs #Ollama #OpenArc #AI
Hashtag
#IntelNPU
Advertisement · 728 × 90
1
0
0
0
Personal challenge: Dusted off the year-idle **Intel NPU**.
Got **OpenArc** running on v1.0.6 and squeezed out a **benchmark**! Feels good to see that silicon finally working after judging my life choices for a year.
Proof: github.com/SearchSavior...
#IntelNPU #OpenVINO #OpenArc #Benchmark #AI
2
0
0
0