The Super Weight in Large Language Models Recent works have shown a surprising result: a small fraction of Large Language Model (LLM) parameter outliers are disproportionately important to the quality of the model. LLMs contain billions of pa...

The Super Weight in Large Language Models

Setting as few as a single weight to zero will make various LLMs go from generating coherent text to outputting gibberish.

arxiv.org/abs/2411.07191

The birth of a star as seen by the James Webb Space Telescope

Good morning bluesky 😊 To start things off on a positive note, here is one of my fave places - plitvice lakes, Croatia 🇭🇷

Love it! I'm really impressed with the bow articulations you can hear on the violin

Hey, would love to be added as well :)