Bluesky Explorer

#

Hashtag

#NeuIPS2024

Kempner Institute at Harvard University

@kempnerinstitute

1 year ago

Mixture of Parrots 🦜🦜🦜: Experts Improve Memorization More Than Reasoning - Kempner Institute Mixture-of-Experts (MoEs) are the backbone of many frontier models (GPT-4, Gemini, DBRX, Mixtral, Deepseek, Qwen2) that have achieved remarkable performance on a variety of tasks. They replace the…

The #KempnerInsitute is ready for another day of #NeuIPS2024! Stop by the M3L workshop for a talk on “Mixture of Parrots” - read more in our blog:

1 0 0 0