Great wrap-up for #EVALITA2026! ๐ฅ
Glad to have helped organize this edition and to see many interesting discussions!
Great response to our task Cruciverb-IT (with Ciaccio C., @gsarti.com, DellโOrletta F., @malvinanissim.bsky.social)!
Thanks to all co-organizers and @ailc-nlp.bsky.social! #NLProc
The โFederico Sangatiโ Best System Award has gone to "RES2 at IMPOLS 2026: Implicit Content Classification via Span-Awareness, Hierarchical Multi-Task Learning and Synthetic Data".
Congratulations to the winners and a loving thought to our colleague Federico Sangati
#EVALITA2026
#EVALITA2026 is ongoing in Bari! Here are some pics of the opening and of the keynote talk by Paolo Rosso "Tu chiamale se vuoi emozioni: The impact of emotions on disinformation and sexism identification".
on my way to #EVALITA2026 where Iโll present team TiGRO ๏ฟผ โs work (Stefano Azzeni, Malvina Nissim @gsarti.com) on fallacy detection (btw, we ranked #1) @gronlp.bsky.social @facultyofartsug.bsky.social @ailc-nlp.bsky.social
Registration for #EVALITA2026 is now open!
The tentative schedule is available on the official website: plenty of tasks, an invited keynote, and a panel! ๐ฅ
See you in Bari! ๐ฎ๐น
#NLProc @ailc-nlp.bsky.social
The #EVALITA2026 final workshop will be held in Bari on February 26-27th, 2026!
REGISTRATION is now open (in order to support the community, participants are requested to become members of AILC before registering for the workshop): www.ai-lc.it/en/evalita-r...
Letโs present the tasks at #EVALITA2026!
Last but not least: FadeIT ๐๐ฌ
Can your system spot fallacies in social media posts?
FadeIT focuses on Italian texts about migration, climate change & public health.
Detect flawed reasoning โ where it spreads fastest.
#NLProc
Letโs present the tasks at #EVALITA2026!
Tenth up: PFB โ Prometeia Financial Benchmark ๐ถ๐
Can LLMs handle finance?
PFB evaluates open & closed models on domain-specific MCQs, with a twist: each question has a complexity score.
2 tasks: Italian and Multilingual QA
From GPT to finance pro.
#NLProc
Letโs present the tasks at #EVALITA2026!
Ninth up: Cruciverb-IT ๐งฉ๐ฎ๐น
Ready to crack some Italian crosswords?
Cruciverb-IT offers a challenging playground for NLP systems:
1๏ธโฃ Answer clues from real crosswords
2๏ธโฃ Autonomously solve full crossword grids
Wordplay meets AI.
#NLProc
Letโs present the tasks at #EVALITA2026!
Eighth up: SVELA ๐ง ๐งฝ
Can LLMs forget on purpose?
SVELA tackles Machine Unlearning: design and evaluate metrics to verify if a model forgets specific knowledge while keeping the rest intact.
Selective forgetting, measurable impact.
#NLProc
Letโs present the tasks at #EVALITA2026!
Third up: ATE-IT ๐ท๏ธ
Time to extract key concepts automatically, with the first large-scale eval of Automatic Term Extraction for Italian on institutional texts.
Subtasks:
๐น Term Extraction
๐น Term Variants Clustering
Letโs make terminology smarter.
#NLProc
Letโs present the tasks at #EVALITA2026!
Second up: GSI:detect
Can machines detect gender stereotypes in Italian texts?
๐ง Score sentences for stereotypical content
๐ท๏ธ Classify them into stereotype categories
From classification to social awareness.
#NLProc
Letโs present the tasks at #EVALITA2026!
First up: EXPLAINITA ๐
Can you explain what a latent neuron means?
๐ง Describe Sparse Autoencoder latents
๐ Decide if a text activates a latent based on its explanation
From prediction to interpretability ๐ฌ
#NLProc
Now with sleek flyers to test your skills in Italian crossword solving! ๐ค Join our #EVALITA2026 task!
Plenty of exciting and challenging tasks in EVALITA 2026 ๐
Check out the Call for Interest and consider participating ๐ docs.google.com/forms/d/e/1F...
#EVALITA2026 #NLPRoc
๐ The Call for Interest is out!
๐ข Want to participate in one of the EVALITA 2026 tasks? Check out the CFI and get ready to join the challenge ๐ www.evalita.it/campaigns/ev...
In the next few days, weโll introduce the tasks one by one. Stay tuned!
#EVALITA2026 #NLProc #ItalianNLP
Language puzzles from "La Settimana Enigmistica" keep you up at night? Fear not! ๐งฉ Our new shared task on automatic crossword solving is now live at #EVALITA2026. Be sure to check it out!
๐จ Exciting news from #EVALITA2026 (@ailc-nlp.bsky.social)!
I'm co-organizing Cruciverb-IT, the first shared task on crossword solving ๐งฉโ๏ธ together with Ciaccio C., @gsarti.com, Dell'Orletta F. and @malvinanissim.bsky.social!
If you love cracking crosswords (or cracking models that do), join us! ๐
Just one week left to submit your task proposal for #EVALITA2026!
Deadline: Monday, 28th July ๐๐
Don't miss the chance to be part of the evaluation campaign! ๐ฅณ #NLProc @ailc-nlp.bsky.social
The second #CFP of #EVALITA2026 is out! ๐ฅ Deadline for submitting task proposals is July 28th 2025!
#NLProc
The second #CFP of EVALITA 2026 is out and published in the workshop website ๐ www.evalita.it/campaigns/ev... ๐ July 28th 2025 (extended!): submission of task proposals ๐ August 7th 2025 (extended!): notification of task proposal acceptance ๐ฎ๐น #EVALITA2026 #NLProc
The first Call for Tasks of #EVALITA2026 is out! ๐ฅ
Deadline for submitting your task proposal is July 21th 2025!
@ailc-nlp.bsky.social #NLProc
The first #CFP of EVALITA 2026 is out and published in the workshop website ๐ evalita.it/campaigns/ev... ๐ July 21th 2025: submission of task proposals ๐ July 31th 2025: notification of task proposal acceptance ๐ฎ๐น #EVALITA2026 #NLProc
