Advertisement ยท 728 ร— 90

Posts by Kevin Wittek

Run LLMs Locally with Docker Model Runner | Simplify AI Dev with Docker Desktop
Run LLMs Locally with Docker Model Runner | Simplify AI Dev with Docker Desktop YouTube video by Kubesimplify

In this video for #Kubesimplify, our Engineering Manager for the AI Runtime Team @wittek.dev talks #Docker's latest feature: Model Runner

It allows developers to run and test #LLM from their local environment w/ Docker Desktop 4.40

www.youtube.com/watch?v=md3W...

11 months ago 5 2 0 0
Preview
Unlock AI Potential Master Docker Model Runner Today! The Docker, Inc ๐Œ๐จ๐๐ž๐ฅ ๐‘๐ฎ๐ง๐ง๐ž๐ซ is a beta feature within Docker Desktop (version 4.40 and later) designed specifically for Mac users with Apple Silic...

Super cool talking cartoon from Hamida Rebai Senior Cloud Application Architect at @microsoft.com on #DockerModelRunner

http://spklr.io/63325AF5v

11 months ago 2 1 0 0
Video

Running a GenAI app locally with OpenAI SDK + Docker Model Runner? Yes, please.

This demo uses Next.js + Docker Compose to serve up an LLM chatbot (Qwen 2.5) with hardware acceleration on Apple Silicon.

Local, fast, secure. Watch it go! @wittek.dev

#Docker #JavaScript #NextJS #LLM #AI #OpenAI

11 months ago 13 3 0 0

I think to enjoy Mastodon, I have to curate my following list.
Right now itโ€™s weirdly random plus some grumpy German Linux IT stuff ^^

11 months ago 1 0 0 0

Kind of, which makes it somehow worse also ^^

1 year ago 1 0 0 0
Preview
Docker Does What?!? Run AI Models Locally with Docker Docker has always been about simplifying developers' lives, making it effortless to build, ship, and...

Developers: โ€œI wish I could run AI locally without all the setup.โ€ Docker: โ€œSay less.โ€

@hummusonrails.com dropped a ๐Ÿ”ฅ blog on the new Docker Model Runner:

๐Ÿ”— http://spklr.io/63328AJqs

#Docker #AI #Git #DevTools

1 year ago 3 3 0 0

Yeah, that would essentially be the self-hosting option.

1 year ago 2 0 1 0

I really liked the Fediverse stuff and gave Mastodon a good try when the whole Twitter debacle happened, but somehow it fizzled out for me.

1 year ago 1 0 1 0

Wanted to reboot my blog and was pondering the options. Self-hosting a static site would be okayish, but I also don't really want to yak shave the whole thing.

I used to like Substack, but it just is becoming an increasingly weird platform thingie. So maybe giving Ghost a try?

1 year ago 4 0 2 0

I don't really know what to do about all the different social media sites. More and more folks are following me here, but I am not really using it.

Maybe I should rotate through the different networks on a weekly basis :D (bsky, X, LinkedIn, Mastodon...)

1 year ago 4 0 3 0
Advertisement

Oh look, it's me!

1 year ago 14 3 0 0
Post image

In the style of The Ambassadors, Hans Holbein the Younger's Renaissance masterpiece painted in 1533, The Computers portrays many of the concepts and artifacts that define the world of computing.

1 year ago 138 21 9 2

An honor to be mentioned here :o

1 year ago 2 0 0 0

docker run docker/hello-bluesky

1 year ago 111 31 3 6

I have the same impression, the search is so bad, especially about product reviews, I resort to search things like "$product reddit".

1 year ago 2 0 0 0

Sounds like Sunsama :)

1 year ago 3 0 1 0

Even for Java? :o

1 year ago 2 0 1 0
Advertisement

That is interesting news.

1 year ago 3 0 1 0
Preview
Evolving our middleware strategy Red Hat and IBM will join forces to secure the future of the Java application ecosystem for our customers.

Do I read this right, Quarkus is IBM now?
www.redhat.com/en/blog/evol...

1 year ago 3 0 5 1

This project is key to Java. We need a notebook to bring Java towards students, scientists,... and help them doing research/POC's in the same language that can later be used in production systems where performance/stability/scaling/security is key.

1 year ago 11 9 1 1
Post image

๐ŸŽ™๏ธ Speaker Spotlight: Do not miss Kevin Wittek @wittek.dev with his lecture "Learning GenAI/LLM programming with langchain4j and Testcontainers" at Hashtag#JavaLand 2025! scomp.ly/R1oDxZ8

1 year ago 6 2 0 0

I awkwardly get the feeling, I know why you want to use this :o

1 year ago 1 0 1 0
Preview
You Can Code Offline With Local AI(Ollama) ChatGPT and other Generative AI tools took the world by a storm. People are using these AI tools for various purposes such as to explore a topic, to seek answers to their questions or to get help in c...

๐Ÿš€ Say hello to coding offline with Local AI! ๐Ÿ’ปโœจ

Check out how Ollama lets you harness the power of AI models like Llama 3, Deepseek, and moreโ€”right on your machine! ๐Ÿง โšก

๐Ÿ”’ Privacy-first
๐Ÿ› ๏ธ Works even when you're offline

๐Ÿ‘‰ Dive in: www.sivalabs.in/code-offline...

#AI #Ollama

1 year ago 5 1 0 0

Oh look, I am there ^^

1 year ago 3 0 1 0
Post image

Remembering Russel. RIP ๐Ÿ–ค

1 year ago 42 11 0 0

"Who gets to hit @anthropic.com harder with the money stick" apparently remains the sport of kings.

1 year ago 39 2 4 1
Me, while reading a book behind my desk.

Me, while reading a book behind my desk.

For my mental health, I usually refrain from commenting on politics. Today, I feel compelled to break this rule and speak out. In Germany, history revisionists yell their devoid phrases from the chancel, echoed by those who struggle with recent politics and are afraid of the future.

๐Ÿงต 1/8

1 year ago 2 1 2 0
Advertisement

Google Gemini for Workspace requires an enterprise tier subscription to turn off. It's the best economic story for their AI.

I didn't expect them to find it, but they did because after billions of dollars and decades of ML work Google has finally created a self-aware product manager.

1 year ago 84 10 4 1

I swear it wasn't me xD

1 year ago 3 0 1 0
Preview
Baker Street by Kevin Wittek Stream and Save Baker Street - Distributed by DistroKid

Check out the song I recorded over the holidays, an instrumental version of Gerry Rafferty's Baker Street.
First time doing everything in Logic, all guitars done using Neural DSP.

Cover by Neslihan Wittek <3

cc @calvobianco.com , who was asking for music content :D

distrokid.com/hyperfollow/...

1 year ago 4 0 1 0