Advertisement · 728 × 90

Posts by Kyle

The idea that every social problem needs a technical solution is so myopic. If you're worried about the smarts of the population, why not just fund public education? And if you're worried about Skynet, maybe try regulating the AI industries...

3 days ago 124 42 6 2

If you are planning to submit a paper to @neuripsconf.bsky.social and you need to create a new @openreview.bsky.social profile, do it today:

OpenReview's profile moderation process is stricter than before, thus it may take longer for new users to have their account activated (up to 2 weeks).

1 week ago 17 7 0 0

We know models aren’t great at counting the “r”s in “strawberry” but why? The answer isn’t as simple as tokenizers!

1 week ago 30 4 1 0
Post image

I wrote and posted this to Instagram a couple of days ago and it became my most-read poem ever. I’m honored I get to feel big feelings alongside you all. I’m posting it here too and want to use this space more consistently. Hello friends ❤️

1 week ago 8327 2291 296 115

The only reasonable response from Americans is to protest in the streets of every city until Congress removes the President.

2 weeks ago 4 1 0 0

Remarkable that the US is bombing a country of tens of millions of people and crashing the world energy market, but the American mainstream media is captivated by a pilot rescue story.

2 weeks ago 182 36 11 4

Some reports say over 500 schools, 55 libraries, & 25 universities hit.
You can debate the numbers, but hitting Sharif University & Beheshti is like hitting MIT & Stanford. I keep wondering: How would the scientific community respond differently if it was those universities? What’s the difference?

2 weeks ago 473 191 6 5
Advertisement

Absolutely heartbreaking. So many mathematicians I know studied there, men AND women.

Maryam Mirzakhani studied there.

If this isn't enough to cancel/relocate from the US the International Congress of Mathematicians #ICM2026, nothing will be.

2 weeks ago 462 213 2 5

It is insane that Americans will wake up and go to work tomorrow.

We should be on strike until the president is impeached, convicted, and tried for war crimes.

2 weeks ago 1 0 0 0
Runtimes by batch size, hidden layer size, and parallel/serial computation

Runtimes by batch size, hidden layer size, and parallel/serial computation

Our new preprint on parallelizing training of temporally precise spiking neural networks is out!

We show up to 44x speedups over a conventional sequential baseline. 1/N

1 month ago 12 4 1 1
Image with text to email your senators to urge them not to confirm Jim O’Neill as Director of the National Science Foundation.

Image with text to email your senators to urge them not to confirm Jim O’Neill as Director of the National Science Foundation.

Email your senators to urge them not to confirm Jim O’Neill as Director of the National Science Foundation.

He's not a scientist, has no relevant expertise, promoted vaccine misinformation, helped gut the CDC, and his Silicon Valley ties raise questions about protecting the public interest.
(1/2🧵)

1 month ago 429 299 11 25

Woah you have vending machines with kurkure??

1 month ago 2 0 0 1

Obviously systematic change trumps all…but if you are going to make a personal choice, turns out the best thing you can do is get rid of your car.

1 month ago 3 1 0 0
Straight of Hormuz, with Buddha imposed, text: The realization that the lack of oil isn't causing your suffering, but the desire for oil itself, on your path to enlightenment.

Straight of Hormuz, with Buddha imposed, text: The realization that the lack of oil isn't causing your suffering, but the desire for oil itself, on your path to enlightenment.

Possible solution to the Strait of Hormuz?

1 month ago 9485 2377 90 63
Advertisement
Post image

What they actually argue (see their last section) is that *if* a neural network did these things, then it must be implementing a symbolic system under the hood, but this would shed no light on cognitive architecture itself (i.e., the algorithms that are being implemented).

1 month ago 31 3 2 0

This gets to the heart of modern debates: are neural networks fundamentally alternative hypotheses about the nature of intelligence, or are they particularly powerful/efficient implementations of classical ideas about intelligence? Are certain cognitive features in some sense inevitable?

1 month ago 19 1 1 0

By which I mean that they let me do a lot of non critical tasks like say, making UIs, but they don’t radically transform my core tasks yet

1 month ago 44 2 3 0
Post image
1 month ago 116 19 1 1

The Cowley Group at CSHL has an opening for a bioAI PhD student to start Fall 2026 to work on closed-loop AI models for visual processing (see below). You *must* have a Master's degree in a quant/eng/cs field.

www.cshl.edu/phd-program/...

Please reach out to me if interested!
I'll be at Cosyne.

1 month ago 11 10 1 1
Preview
Compact deep neural network models of the visual cortex Nature - Parsimonious deep neural network models can be used for prediction of visual neuron responses.

DNN models of the brain are getting bigger. Are we replacing one complicated system in vivo with another in silico?

In new work, we seek the *smallest* DNN models of visual cortex, balancing prediction with parsimony.

It turns out these compact models are surprisingly small!

rdcu.be/e5H8G

1 month ago 127 47 3 4
Post image

What arxiv.org/abs/2512.24873

1 month ago 30 5 4 1
google doesn't endorse marriage through differentiation for constants and exponentials

google doesn't endorse marriage through differentiation for constants and exponentials

"I'm a mathematical constant and my partner is an exponential function she insists we get differentiated but I am worried should I agree?"

1 month ago 46 13 3 0

I am here to torch every soft-focus retrospective on statesman and institutionalist Robin Vos. No one has done more to break the state of Wisconsin than this man.

1 month ago 50 5 3 1
Post image Post image Post image Post image
2 months ago 12 1 1 0
Advertisement
Video

Here's a version that lets me look at individual layers and heads (a layer just being the mean of all of its heads). Notice some heads really care about specific tokens that others don't.

2 months ago 22 1 2 0

You wrote “average attention score as the prompt progresses” so I was just clarifying for myself average over what

2 months ago 0 0 1 0

So the opacity is a running average score?

2 months ago 0 0 1 0
Video

What do LLMs see?

I wrote a lil' tool that extracts the attention matrices out of open models and creates this typing visual, with each token's opacity changing according to its average attention score as the prompt progresses. Dimmer words are considered less important to the model.

2 months ago 258 42 17 8
Screenshot of the vancouver metro area rendered by the Stamen Design water color tileset, and it's gorgeous. it looks like a real water color painting

Screenshot of the vancouver metro area rendered by the Stamen Design water color tileset, and it's gorgeous. it looks like a real water color painting

i just discovered Stamen's Watercolor tileset and it's just beautiful! I wish all maps where this beautiful.

Bring more whimsy and beauty to websites

2 months ago 81 7 3 0

We had this beautiful internet, and now it's filled with slop. Outside of my circles, I don't trust digital interactions with people, and I know they don't trust me either. (Some effects spill over into real life too.)

Was it worth it? Time will tell.

2 months ago 22 2 0 1