SHROOM-CAP Shared Task at CHOMPS Workshop

Participate in the SHROOM-CAP shared task on cross-lingual hallucination detection for scientific content generated by LLMs. Register by 31.07.2025 and submit results by 12.10.2025.

The SHROOM-CAP shared task is announced, focusing on cross-lingual hallucination detection for scientific publications. It is co-located with the CHOMPS-2025 workshop at IJCNLP-AACL 2025.

Key highlights include:

• LLM-centered
• Cross-lingual annotations
• Hallucination and fluency prediction

Participants are invited to detect hallucinations in scientific content generated by LLMs across 9 languages. The task includes developing systems to accurately identify hallucinations and submitting system description papers.

Key dates:

• Train set available: 31.07.2025
• Test phase ends: 12.10.2025
• System description papers due: 25.10.2025

To participate, register your team and join the Google group. Submit results on the submission platform before 12.10.2025.

Tags: SHROOM-CAP, hallucination detection, LLMs, CHOMPS-2025, IJCNLP-AACL 2025, cross-lingual, scientific content