Learned Task Vectors Enhance LLM Performance and Explain ICL

Learned Task Vectors (LTVs) trained directly outperform extracted TVs, achieving higher accuracy on benchmarks and can be placed at any transformer layer or token position. getnews.me/learned-task-vectors-enh... #learnedtaskvectors #incontextlearning