Our work with @georgkeller.bsky.social on testing predictive processing (PP) models in cortex is out on biorvix now! www.biorxiv.org/content/10.6... A short thread on our findings and thoughts on where we should move on from PP below.

I don’t think so, as far as I can see they are "öffentlich-rechtlich", meaning that they are funded by the German state.

1/6 New preprint 🚀 How does the cortex learn to represent things and how they move without reconstructing sensory stimuli? We developed a circuit-centric recurrent predictive learning (RPL) model based on JEPAs.
🔗 doi.org/10.1101/2025...
Led by @atenagm.bsky.social @mshalvagal.bsky.social

Thanks Vicky!

A huge thanks to @timkietzmann.bsky.social, @psulewski.bsky.social and the whole Kietzmann lab for the supervision and endless support!!

Predictive remapping and allocentric coding as consequences of energy efficiency in recurrent neural network models of active vision This study gives an example of how complex computations in neural networks can emerge from simple physical principles. Training a model to optimize internal energy efficiency while performing eye move...

www.cell.com/patterns/ful...

🚨 Out in Patterns!

We asked ourselves, if complex neural dynamics like predictive remapping and allocentric coding can emerge from simple physical principles, in this case Energy Efficiency. Turns out they can!
More information in the 🧵 below.

I am super excited to see this one out in the wild.

Introducing CorText: a framework that fuses brain data directly into a large language model, allowing for interactive neural readout using natural language.

tl;dr: you can now chat with a brain scan 🧠💬

1/n

Henry Molaison - Wikipedia

A quite famous patient that had a hippocampus lesion. en.wikipedia.org/wiki/Henry_M...

ob man in der eigenen Wohngegend Probleme mit Flüchtlingen hätte. Auf diese Frage (die recht nah an der ursprünglichen Stadtbild-Aussage ist) haben 74% mit Nein geantwortet. Die Mehrheit hat also der ursprünglichen Aussage widersprochen und der neuen konkreteren zugestimmt

In der konkretisierten Form, ja. Die ursprüngliche Aussage (an die die meisten denken wenn man von der Stadtbild-Aussage spricht) ging aber nur um Migranten, Aufenthaltsstatus, aktuelle Arbeit oder Einhalten von Regeln waren nicht genannt. In der Umfrage vom ZDF gab es auch eine Frage, ob 1/2

In dem Kommentar des ZDF steht, dass der Kontext jetzt erst im Nachhinein hinzugefügt wurde

www.instagram.com/p/DQLhSMuDdK...

Another Friday feat: Philip Sulewski's (@psulewski.bsky.social) and @thonor.bsky.social's
modelling work. Predictive remapping and allocentric coding as consequences of energy efficiency in RNN models of active vision

Time: Friday, August 15, 2:00 – 5:00 pm,
Location: Poster C112, de Brug & E‑Hall

High-level visual representations in the human brain are aligned with large language models - Nature Machine Intelligence Doerig, Kietzmann and colleagues show that the brain’s response to visual scenes can be modelled using language-based AI representations. By linking brain activity to caption-based embeddings from lar...

🚨 Finally out in Nature Machine Intelligence!!
"Visual representations in the human brain are aligned with large language models"
🔗 www.nature.com/articles/s42...

End-to-end topographic networks as models of cortical map formation and human visual behaviour - Nature Human Behaviour Lu et al. introduce all-topographic neural networks as a parsimonious model of the human visual cortex.

This one should work:

www.nature.com/articles/s41...

My first ever preprint is now out. We show the emergence of complex computations given only the rather simple underlying goal of energy efficiency.