That time I gave some quick legal advice to Afroman before he won his court case.
Posts by Pete Cheslock
Hey Boston friends, we're cooking up another great event in the area.
Workshop + evening sessions covering:
- vLLM project update
- Model compression and speculative decoding
- Agentic AI with vLLM
- Distributed inference at scale with llm-d and k8s
luma.com/4rmkrrb7
๐ข ๐ง๐ต๐ฒ ๐ฆ๐๐ฎ๐๐ฒ ๐ผ๐ณ ๐ ๐ผ๐ฑ๐ฒ๐น ๐ฆ๐ฒ๐ฟ๐๐ถ๐ป๐ด ๐๐ผ๐บ๐บ๐๐ป๐ถ๐๐ถ๐ฒ๐: ๐ ๐ฎ๐ฟ๐ฐ๐ต ๐๐ฑ๐ถ๐๐ถ๐ผ๐ป ๐ถ๐ ๐ผ๐๐!
We launched our newsletter publicly last year to share our contributions to upstream communities from our Red Hat AI teams. Weโve gained over ๐ญ๐ฏ๐ฌ๐ฌ ๐๐๐ฏ๐๐ฐ๐ฟ๐ถ๐ฏ๐ฒ๐ฟ๐!
Jayson Tatum looking like Jayson Tatum is a horrifying development for the rest of the East.
I'm going to be in NYC next week, come and join me at the first llm-d meetup.
If you're looking to learn more about distributed inferencing on kubernetes, this is going to be the place to be.
In the latest llm-d release, weโre tackling high hardware costs with the new GPU Recommendation Tool! ๐
Evaluate throughput, latency, and cost-effectiveness before requesting expensive cluster resources.
Check out the full demo: www.youtube.com/watch?v=Y26i...
Come and join us for the first llm-d meetup in NYC!
The agenda is still evolving, and weโve got even more awesomeness in the works! ๐
Whether you're running GenAI in production or building the platforms to support it, this is the room to be in.
๐
March 11 | 4:30 PM
๐ 1 Madison Ave, NYC
๐๏ธ RSVP: luma.com/0crwqwg4
We'd like to announce that @kubernetes.io WG Serving has succeeded and will be disbanded! Thank you everyone who have participated and contributed to the discussions and initiatives!
More details: groups.google.com/a/kubernetes...
The most cursed venn diagram
In case you missed it, last week the llm-d community shipped the v0.5 release.
Check out the post from the llm-d project owners to learn more about all the features we've included in this release.
llm-d.ai/blog/llm-d-v...
๐ข ๐ง๐ต๐ฒ ๐ฆ๐๐ฎ๐๐ฒ ๐ผ๐ณ ๐ ๐ผ๐ฑ๐ฒ๐น ๐ฆ๐ฒ๐ฟ๐๐ถ๐ป๐ด ๐๐ผ๐บ๐บ๐๐ป๐ถ๐๐ถ๐ฒ๐: ๐๐ฒ๐ฏ๐ฟ๐๐ฎ๐ฟ๐ ๐๐ฑ๐ถ๐๐ถ๐ผ๐ป ๐ถ๐ ๐ผ๐๐!
We launched our newsletter publicly last year to share our contributions to upstream communities from our Red Hat AI teams. Weโve gained over ๐ญ๐ฎ๐ฌ๐ฌ ๐๐๐ฏ๐๐ฐ๐ฟ๐ถ๐ฏ๐ฒ๐ฟ๐!
๐๏ธ llm-d v0.5: Sustaining Performance at Scale In our last release, we focused on breaking latency records.
With v0.5, weโre shifting from peak performance to the operational rigor required to sustain those gains in production.
๐งต๐
llm-d.ai/blog/llm-d-v...
Standardizing high-performance inference requires deep ecosystem collaboration. ๐
Huge shoutout to @vllm_project and @IBMResearch on the new KV Offloading Connector. Weโre seeing up to 9x throughput gains on H100s and massive TTFT reductions. ๐งต
blog.vllm.ai/2026/01/08/k...
AI inference is like a busy airport: without a controller, you get gridlock. โ๏ธ
Check out this breakdown by Cedric Clyburn from Red Hat on how llm-d intelligently routes distributed LLM requests.
๐น Solves "round robin" congestion
๐น Disaggregates P/D to save costs
www.youtube.com/watch?v=CNKG...
If you stop to think about it, Geysers are just Earth farts.
I'm unaware of any alternative pronunciations for it.
We're so young and full of life!
Honestly, if you want a project you could buy a Gaggia Classic Pro for $499 (or a used one cheaper) and go the gaggiuino route.
gaggiuino.github.io#/?id=home
aftermath.site/gaggiuino-ga...
Yea - they are shockingly close to ones I've seen in the past. Maybe if i get some time in the future and go and find some live ones. One I remember used the word "crunchy" to describe the headphones and i was reminded of a wine review for "chewy tannins". Hilarious
Well... that's the joke! They are all written to be basically as generic as possible so that they could equally apply to either wine or headphones. I seeded the vote counts out of the gate so that you wouldn't have like 1 or 2 votes swing the graph too much, but here's an example post-vote.
So I decided to make a game out of this. Welcome to "Bottles or Cans" where you can read a review and guess if its for a bottle of wine or for a pair of headphones (aka cans).
bottlesorcans.com
So a long time ago when buying new headphones and reading reviews, I noticed how the reviews often sounded similar to reviews for a bottle of wine. Like:
"Rich and full-bodied with excellent depth. The bass notes are particularly impressive, with a smooth finish that lingers pleasantly."
not that i'm sure you need ANOTHER one to look at, BUT i'm a big fan of the recteq smokers too. I agree to pass on the Traegers, i've seen too many literally go up in flames.
How do you pronounce โwwwโ the abbreviation for โWorld Wide Webโ?
https://youtube.com/shorts/MxuX7M661Hg
#www #sysadmin #devops #sre #pronunciation #tutorial #software #developers
How do you pronounce "sudo" the #linux/#unix command?
So are you team "Su DOUGH" or team "Su DOOOO"
https://www.youtube.com/shorts/qpi5wYblQfY
This is probably the most requested pronunciation video i've gotten.
How do you say: "fsck" - a.k.a - File System Check.
There is no agreed upon pronunciation of this one!
https://youtube.com/shorts/7b-X6MJGkdA
#linux #sysadmin #devops #sre
Another episode of โHow do you sayโ. This one is definitely one of my favorites.
How do you say JWT (JSON Web Token)?
https://youtube.com/shorts/D2D9umQMKhA?feature=share
Did you know there are at least 3 (THREE) different ways to say SQL?
https://www.tiktok.com/t/ZTRK9rNSh/