Headed to @cvprconference.bsky.social in Nashville! I'll be presenting our work on Multimodal Reward-guided Decoding. Let's connect if you're around!

TFW you find a memory leak in your code two days before the rebuttal's deadline

Heading to Singapore for the next 1.5 weeks for @iclr-conf.bsky.social. If you're around and want to meet up, hit me up!

"Tokenize Everything!" Luke Zettlemoyer of
@uofwa.bsky.social on using GPT-like autoregressive techniques for training multimodal models (text, images, audio etc.) at the Simons Institute workshop on The Future of Language Models and Transformers simons.berkeley.edu/workshops/fu...

Yes! I always recommend this book to fellow researchers for good coding practices :)

Gemini 2.0 and the evolution of agentic AI with Oriol Vinyals YouTube video by Google DeepMind

I quite like this analogy by Oriol Vinyals:
* LLM ~= core electric brain
* Agent ~= LLM with a digital body

youtu.be/78mEYaztGaw

Curious about how to effectively steer the behavior of multimodal LLMs during inference to improve their visual grounding?

Join me today at 4:30pm at the AFM workshop at @NeurIPSConf, where I'll be presenting a poster on my work. Come by to learn more!

openreview.net/forum?id=VWJ...

Controlling Multimodal LLMs via Reward-guided Decoding As Multimodal Large Language Models (MLLMs) gain widespread applicability, it is becoming increasingly desirable to adapt them for diverse user needs. In this paper, we study the adaptation of...

Tomorrow at 3:15pm I'll be presenting my work at @mila-quebec.bsky.social's booth (#104) at @neuripsconf.bsky.social. Come to learn more about controlling multimodal LLMs via reward-guided decoding!

🔗 openreview.net/forum?id=VWJ...

All this being said, Meta/FAIR remains the only place where you can do open AI research with a group of stellar colleagues ten times larger than any university + big-tech computational capabilities level.

Oh I love the idea! I'll be happy to contribute :)

A bit late to the party but here we are!