Sparse Mixture of Experts Boosts Prompt-Based Continual Learning

SMoPE uses a sparse mixture‑of‑experts for prompts, activating only experts per input, reducing interference and compute compared to task‑specific prompts. Read more: getnews.me/sparse-mixture-of-expert... #continuallearning #promptbased