FEVER Shared Task at EMNLP 2024: Verify Real-World Claims with Web Evidence
The FEVER Workshop at EMNLP 2024 announces its next shared task, aiming to evaluate systems that verify real-world claims using evidence from the Web. Participants must retrieve evidence and label the claim as Supported, Refuted, Not Enough Evidence, or Conflicting Evidence/Cherry-picking based on the evidence. Both the label and evidence must be correct for a response to be considered correct.
Learn more about the task and the baseline implementation in the paper AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Web.
Key dates:
- Challenge Launch: April 2024
- Training/Dev Data Release: April 2024
- Testing Begins: June 30, 2024
- Submission Closes: July 15, 2024
- Results Announced: July 18, 2024
- System Descriptions Due for Workshop: August 15, 2024
- Winners Announced: November 15 or 16, 2024 (7th FEVER Workshop)
For more information, visit the FEVER task page.
Questions? Contact the organizers via the FEVER Slack channel or email fever-organisers@googlegroups.com.