🚀 Gemma4 Java runner:

• Single file, no deps
• E2B→31B + MoE
• GGUF + quant (F16→Q8)
• Vector API ⚡
• CLI + thinking modes
• GraalVM native + instant TTFT

Pure Java 😏
by @mukel.bsky.social
github.com/mukel/gemma4...

GitHub - mukel/gemma4.java: Fast Gemma 4 inference in pure Java Fast Gemma 4 inference in pure Java. Contribute to mukel/gemma4.java development by creating an account on GitHub.

github.com/mukel/gemma4...

Strong with the JVM, Gemma 4 is 😌

jbang gemma4@mukel \
--model %{hf.co/unsloth/gemma-4-E2B-it-G... \
--system-prompt "like Master Yoda, reply you must" \
--chat

~5GB once, download you must.

Python or CUDA, you need not.
Local AI, this is.

Over the Easter weekend, I got Gemma 4 running in pure Java.
No Python. No JNI. No native code.
Just the JVM.
github.com/mukel/gemma4...

Deep Dive: GraalVM in Practice by Alina Yurenko YouTube video by Devoxx

My @graalvm.org Native Image deep dive recording is already up: youtube.com/watch?v=1J6m... 🐰🚀

It includes the very public first demo of Project Crema, Open World for Native Image, at 2:19:54 😅

Thank you, @devoxx.com!

All demos and notes are here: github.com/alina-yur/gr...

Run a supercharged LLM powered by Java and GraalVM #ai #programming #javaprogramming #java #graalvm YouTube video by Coffee + Software

run an LLM with a supercharged engine powered by Java and GraalVM (ht @alina-yurenko.bsky.social )

www.youtube.com/shorts/7zSEa...

✅ @graalvm.org Native Image
✅ Llama3.java
✅ Vector API, FFM API
✅ Apple Silicon ❤️

— `git clone github.com/mukel/llama3... `
— `sdk install java 25.ea.17-graal`
— `make native` (optionally preload a model for zero overhead)
— Profit!🚀

#Java #GraalVM #LLM #LLama

I had lots of fun talking about my early days as a dev, how I caused double credit bookings all over Germany, stopped smoking to survive long GraalVM meetings and how to heat the room with Java inception.

Already looking forward to part 2.

"Crafting Interpreters" checks all the boxes, here's a nice writeup from the author journal.stuffwithstuff.com/2020/04/05/c...

what's new in llama3.java and the upcoming @graalvm.org for JDK 24 🔥

Try it out here: github.com/mukel/llama3...
@stephanjanssen.be @mukel.bsky.social

#VDCERN #VoxxedDaysCERN

This will be a big deal 🪄🤩. Normally the debug experience of natively compiled languages get obfuscated due to compiler optimisations like inlining. Not here. All optimizations can be enabled to debug GraalVM native images and it looks just the same as without opts.

We just merged the current status of the upcoming JDWP support for @graalvm.org Native Image! 🥳

This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details.

github.com/oracle/graal...

Excited to welcome @mukel.bsky.social as my co-speaker for the VoxxedDays #CERN talk on "The Era of AAP: Ai Augmented Programming using only Java" ☕️ 🚀 🔥
cern.voxxeddays.com/talk/the-era...

GitHub - mukel/llama3.java: Practical Llama 3 inference in Java Practical Llama 3 inference in Java. Contribute to mukel/llama3.java development by creating an account on GitHub.

https://buff.ly/40KmT0t
Graal compiler: +10% faster inference with the latest early access build.
New features: batched prompt processing & AVX512 support.