🎃 We had an extra-fun seminar yesterday—with a touch of Halloween spirit! 👾

Thanks to @TomerWolfson for joining us!

Considering a PhD in NLP/Speech? 🤔
Need guidance with your application materials?

@jhuclsp is offering a student-run application mentoring program for prospective applicants from underrepresented backgrounds.

📝 Learn more & apply: forms.gle/PMWByc6J3vD...
📅 Deadline: Nov 20

Bringing together our incredible current and admitted students—future leaders, innovators, and changemakers!

🚨 You are only evaluating a slice of your test-time scaling model's performance! 🚨

📈 We consider how models’ confidence in their answers changes as test-time compute increases. Reasoning longer helps models answer more confidently!

📝: arxiv.org/abs/2502.13962

MAGMaR Workshop MAGMaR

New Workshop on Multimodal Augmented Generation via MultimodAl Retrieval (MAGMaR) to be held at @aclmeeting.bsky.social ACL in Vienna this summer. We have a new shared task that stumps most LLMs - including ones pretrained on our test collection. nlp.jhu.edu/magmar/