btw this may also be interesting to follow up with. An LLM burnt into a PCI card: taalas.com/products/
Posts by ravokue.bsky.social
You can boot a Mac with Linux if that helps. And you could run windows via a VM within macOS if that's something you need (I doubt it, but I am biased). From my experience M3 and above do an excellent job for local LLMs. M2 could work but, not very well, would then invest in a lot of RAM.
I don't know if the NIPOGI can run a local LLM (but doubt it). The nice thing with silicon Macs is that you don't need a GPU but can leverage the RAM of the computer.
I am using smaller pcs and raspberries which run e.g. openclaw and connect to one of my larger machines which run the LLM. I guess for coding anything that is capable of running qwen3.5 or higher should do the job (so 32GB of RAM). More is of course better but also pricy these days.
Didn't test it myself, but a MacMini M4 with 32GB should already be able to run a smaller version of qwen3.5, which is for most tasks enough.
From my experience running a decent OSS model locally does not require much investment anymore. Thanks to ROCm you can now use cheaper AMD GPUs for larger models. Quantization and Distillation allow you to run powerful models (qwen3.6) on gaming cards. So for 6k you get a local LLM machine.
Hi Matt, what do you want to do with it? I have several local LLMs running on differnet computers and setups. I got a MacBook Pro M4 Max with 128GB, a Mac Pro 2019 with 768GB RAM and an AMD Radeon Pro with 48GB VRAM (running e.g. Ollama, LM Studio and OpenClaw under Linux or Win10), and some Minis..
The French singing La Marseillaise in a nuclear submarine base is deeply symbolic.
France built its own independent nuclear deterrent after WWII to never again have to suffer a similar humiliation. Now France is offering to ”advance” that deterrent to other European countries.
bei mir ist die spannung auch wieder raus... muss an physik liegen... #dhdl
nur wenn es russische eier und geskriptete dialoge von der free version der Chat KI gibt... #dhdl
Judith hat recht. Bei 185€ brauch ich auch erstmal was um wieder zu mir zu kommen... #dhdl
But when I am dead,
from all sides my ghost will haunt
the tyrant both night and day.
It’s no secret I love Baroque music while coding — but nothing quite surpasses the Hannibal rendition of “Piangerò la sorte mia.”
www.youtube.com/watch?v=HZuX...
Happy to have my digital marketing strategy class been allocated to our latest and most modern classroom at #ESSEC. Plenty of new tech tools and things to use with students when exploring what it takes to create highly engaging and profitable digital campaigns and business models.
Meta closed the academic API in 2016, Musk did the same in 2023 for Twitter. TikTok opened an academic API and allowed to access the platform‘s data for free. If Musk takes this last transparency away, no one will be able to control what is happening. Stand up, or 2025 will soon look like 1984…
What a great morning in Paris! Wish u all a great start in the day!
First day of classes in 2025! To a new teaching year, interested students, new insights and experiences!
Warum dieser Mann einfach nie Bundeskanzler werden darf... Wer bewusst Hand an fundamentale Bereiche des Grundgesetzes legen will und damit den Weg frei macht, unliebsamen Bürgern die Staatsbürgerschaft zu entziehen, ist nicht tolerierbar. Wo hört dieses Populismusrennen nur auf?
Some play say it tastes best with salty butter on it…
By the way did u know that many billionaires did say they would donate hundreds of millions for the renovation of #NotreDame but then never did? Check this Guardian article from 2019 www.theguardian.com/commentisfre...
In the other hand given that with Sarkozy and Trump two convicted fellons are allowed to attend, it is heartwarming to see that the Catholic church still allows sinners to find their way back to god…
Donald Trump and Elon Musk both attending the re-opening of Notre Dame. Not sure what we need more. Another reformation of the Catholic Church, another French Revolution, or another Viking invasion of Panam…
Happy #SaintNicolaus… guess this #mixologist was a good boy last year… can‘t wait to try the 2023 Sommelier #chartreuse
With 300km/h through the fog… feels like Rudolph is having a training ride for Xmas night… do these TGVs also come with a red nose?
On my way to Lyon to participate in the AFM Publication Booster seminar. First time I made it to Hall1 of the Parisian Gare du Lyon with its famous Train Bleu restaurant….
Another week, another magnificent journey to our downtown campus shared with CentraleSuppelec in Montparnasse teaching Marketing Analytics in our FT globally No2 ranked Master in Data Science and Business Analytics…
Was kommt als Nächstes? Nicht bekifft auf TikTok rumhängen?
🐈😴 Very much today’s working attitude. Guess growing up means accepting that waiting for Christmas turned into running after end of year deadlines… still a very happy first of advent to everyone celebrating each year’s final countdown.
No better city to commute to your city campus…
Some #brands come with a specific meaning. For me #Starbucks means I need to kill time and need to stay somewhere while waiting for a connection…