Do LLMs need rationales for learning from mistakes? 🤔
When LLMs learn from previous incorrect answers, they typically observe corrective feedback in the form of rationales explaining each mistake. In our new preprint, we find these rationales do not help, in fact they hurt performance!

🧵

New preprint out! Thrilled to share our new work led by @lisaalaz.bsky.social

Check out @lisaalaz.bsky.social's internship work with us @cohere.com questioning the rationale behind rationales 🔥