Back in the interview chair with a general recap of the AI research ecosystem with one of my favorite people to talk to. Ross Taylor (former Llama reasoning lead) is back for round 2!
In this episode we cover some of everything.
Taking a quick break from Twitter
Most important plot from IO today -- AI usage is skyrocketing. This is real.
OpenAI finally released the RL finetuning API today. I still stand by what I wrote about it 4 months ago while at some random NeurIPS cafe.
www.interconnects.ai/p/openais-re...
The one thing 2025 may be remembered for is when tool use and RL started to take off -- not just math and code. It feels like a major step in a new direction.
A lot of people vastly underestimate the amount of companies that cannot use Qwen and DeepSeek open models because they come from China. It's a common thing and makes the adoption of open models significantly slowed across enterprises (and mostly to Llama/Gemma).
Cc Adam Curtis
🧵 🧵 🧵 I think that making LLMs resistant to exhibiting harmful behavior under few-shot tampering attacks might be one of the most useful goals for AI risk management in the next year.
Stoked to get the 1B OLMo 2 model out -- this will likely be our most used model. Getting a 1B model we were happy with was a wandering path. I've written some lessons from training it below.
TLDR is that its hard to know what is a good base model! natolambert.substack.com/p/in-between...
Matt Clifford bahahahah
Hoberman
I don’t get the valuation. Someone explain it to me.
Can we all just welcome and embrace our broligarchy era… xox 💁🏻♀️😘💋
Does anyone know what this bill is about? Why was it rushed through with no public discussion? Feels ominous.
bills.parliament.uk/bills/3825
Definitely checking the progress of this tweet from mars 😂🚀… year 2203 😅 … and Google still won’t have had a mass delete and unsubscribe button 😒 ffs 🤦🏽♀️
Why does @gmail make it so hard to manage subscriptions?! Surely there should be a mass unsubscribe and mass deletion button somewhere. It’s 2025 soon!
I really need to get to zero inbox one day. At this rate I don’t think I’ll make it before I die! 💀
I just need to say this was pre the big Ai machine learning big data days 😂😂😂
People thought I was a nutcase for thinking I could build market solutions or products with data 😂😂😂
I sat it out for the market to come round 😂😏
Girl dreams ✨💫
When I was studying economics. I hated that in London your options were: banking, finance or consulting to get a living wage.
I would pray stats and research would pay well! I loved data, but research and econometric jobs paid terribly
Sometimes prayers are answered 🙏🤩🌟
Anthropic logo 👇🏾🙈
Where do 99% of under 40s get 99% of their news from?
- Twitter
- reddit
- YouTube (and other video platforms)
- blogs
- telegram
(Or a mix of these)
i.e. influencers
It’s been like that for decades
Some ppl just noticed 😂
Wakey wakey 👋🏽
.@OpenAI is going after a lot of startup’s lunches 🙈 can’t they stick to scaling 😂😒
Hello! I’m back too 👋🏽
Or at least trying to come back
I’m back! You have so many followers already 🙈
Where is everyone? Struggling with Twitter a little 😂
Google thinks bucketham pale ass is Buckingham palace 😂
Courtesy of my American tourist friends 😂🇺🇸
#london #america
Am I just reproducing my other social channels? Anyway, follow Rula. She’s mega smart.
