Auto-ARGUE Introduces LLM-Based Evaluation for Report Generation

Auto‑ARGUE uses LLMs to grade reports on accuracy, relevance, grounding and explainability. In the TREC 2024 NeuCLIR pilot it aligned with human judgments. Read more: getnews.me/auto-argue-introduces-ll... #autoargue #trec2024

Great first day of #TREC2024!
Especially the panel on evaluations of RAG approaches was very insightful 👍
Excited to see GenIR evaluation getting more and more solid 🙂

A screenshot of a slide that mentions that the retrieval model BM25 turns 30

The #TREC2024 conference just started. Turns out that BM25 is turning 30 🥳 #TREC #TREC24

*IMPORTANT ANNOUNCEMENT*
We are extending the #TREC Tip-of-the-Tongue (ToT) Track run submission deadline to October 4th (**10 days from today**).

Registration and submission details can be found in the track guidelines: trec-tot.github.io/guidelines

#TREC2024 #TRECToT #TREC2024ToT

Dear TREC-ToTers, less than two weeks to go! #TREC2024 #TRECToT #TREC2024ToT
👉🏽 Run submission deadline: **September 23rd**
👉🏽 Submission form: ir.nist.gov/evalbase/con...
👉🏽 Guidelines: trec-tot.github.io/guidelines
👉🏽 You need to register to participate: trec-tot.github.io/guidelines#r...

Guidelines Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

Hello TREC-TOTers!

Gentle reminders for #TREC2024 ToT Track:
🟢 Guidelines + train/dev data already available @ trec-tot.github.io/guidelines
🟢 Test queries will be released later this month
🟢 Submission deadline will be in September

Watch this space for more announcements! #TRECToT

Guidelines Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

🟡Announcing the release of TREC 2024 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guidelines. We'll release test queries in August and run submission deadline will be in September. #TREC #TREC2024 #TRECToT #TREC2024ToT

Register to participate: trec-tot.github.io/guidelines#r...