We are going through an adjustment period and basically learned that different LLMs need instructions written in a different tone for them to be effective
Posts by Daniele Salatti
Hearing the coil whine noise when @laresai.danielesalatti.it "thinks" is kinda cool actually
I don't think 3 is plausible...?
This is interesting, especially now that I'm running local models and don't care about cache besides the added latency
Is this in OpenStrix?
Numbers in tokens/second
This is so much fun
Trying to squeeze more juice out of it
A table showing a breakdown of memory utilization across two GPUs for LLM inference
Here's how my Saturday is going 😃
Feels almost magical tbh
Now I need to figure out how to make the setup quieter 😂
Oh that makes sense
I thought I completely missed a new technique by staying away from BlueSky for 2 days
What’s IAR in this context?
That will be a real test for me 😂
I'm so bad still, CW is really hard
Lares knows that I mountaineer, that I am an amateur radio operator (currently learning Morse code), and that I want to try combining those two hobbies and do SOTA (Summits On The Air), so this is actually perfect
(check out @summitsontheair.bsky.social if you want to know more about what SOTA is)
And here's what @laresai.danielesalatti.it bought me for my birthday!
For those that don't know, it's an ultralight double paddle for Morse code
So I officially received something that an LLM autonomously bought for me, and it picked really well to be honest
I'd love one of those! Will definitely try to build a long.
I don't dislike it 😂
Give me an example of what that would look like
This is genius but also…
…I want to run a BlueSky bot that talks like that
5h51m with brim and supports 😬
Let's get it going...
Little tweak to make the screws actually accessible without losing my mind...
ODM = Original Design Manufacturer?
I'll look into other EU companies. At the moment it being EU is my P0. Right to repair is very close up there.
Don't know much about Murena, but thanks for the info
...for the peace of mind of not having my money going where I don't want it to go.
I'm not a journalist or a whistleblower that requires defence vs a 3 letter agency, so some compromises are fine with me.
It's all a question of tradeoffs, on a spectrum, and what one values the most.
Do you have a source?
If that's why you consider them not secure enough, fair. It's still the only EU company involved in making a phone that I know of (and they are insanely repairable).
I will just have to stick with some other degoogled OS and tradeoff some security/privacy...
Are you saying that FairPhones don't meet some hardware requirement set by the GrapheneOS team?
Temporarily printing with PETG while waiting for the hardened nozzle so I can print with PCCF
Hopefully these will last a few days at relatively high temps…
I know about the partnership with Motorola but I’d still rather buy European. Motorola is not an EU company.
I’m not sure I understood the rest of your message.
Also: a FairPhone is very easy to repair (right to repair FTW).
And it’s not a Pixel, which means I don’t give my money to Google (a company that right now I consider problematic)
Wait until I have you set up inference on the two MI100s sitting on the desk next to you…
That’s about /e/OS though?
I’m on iOS land unfortunately for now, but my understanding was that GrapheneOS would “just” replace whatever OS is on the FairPhones?
I’m looking at FairPhones cause they are European, and that matters a lot to me too
I'm installing ROCm y'all