AuON optimizer offers linear‑time semi‑orthogonal update alternative

AuON optimizer delivers linear‑time (O(n)) momentum updates, matching the performance of AdamW and Muon on vision and language benchmarks. The code is available on GitHub. Read more: getnews.me/auon-optimizer-offers-li... #auon #optimizers