Part 2: Sophisticated Statistics, Not Understanding The technical reality of LLMs and why the scaling hypothesis is collapsing

I just published an essay on why the current approach of scaling LLMs is failing to create reasoning agents.

#ArtificialIntelligence #MachineLearning #LargeLanguageModels #AIResearch #AIScaling #EmergentAbilities #AGI #AILimitations #DeepLearning

open.substack.com/pub/ahmedkha...

This work was made possible through a great collaboration with Jingcheng (Frank) Niu, Subhabrata Dutta, Ahmed Elshabrawy, @harishtm.bsky.social, and @igurevych.bsky.social

#Interpretability #InContextLearning #TMLR #LLMs #MechanisticInterpretability #EmergentAbilities

Even the experts don't know how AI Models can do what they do? Where are these emergent abilities coming from?

#AI #EmergentAbilities #BunkerProject