Contemplating LayerNorm Centering around mean centering

Posted about LayerNorm. oirs.substack.com/p/contemplat...

GitHub - oir/startle: Instantly start a CLI from a function, functions, or a class Instantly start a CLI from a function, functions, or a class - oir/startle

Been working on github.com/oir/startle, which lets you quickly turn python functions or (data)classes into CLIs. If you like Fire, Typer, or HfArgumentParser but interested to check out an alternative, take a look! #python #opensource

🚨 First ever post here~ New paper out! Instruct models are not always the best. Scaling down 📉 instruction tuning strength via partial adaptation leads to material gains 🚀 on few-shot in-context learning NLP tasks across model families and sizes.

arxiv.org/abs/2504.11626