BEA 2025 Shared Task: Evaluating AI-Powered Tutors
Evaluate the quality of AI-powered tutors in educational dialogues with the BEA 2025 Shared Task.
The 1st CFP for the BEA 2025 Shared Task is now open, focusing on the pedagogical ability assessment of AI-powered tutors. This task aims to evaluate the quality of tutor responses in educational dialogues, specifically in the mathematical domain.
Five tracks are available for participation: Mistake Identification, Mistake Location, Pedagogical Guidance, Actionability, and Guess the Tutor Identity. Participants can register using the following link.
Important dates include:
- March 12, 2025: Development data release
- April 9, 2025: Test data release
- April 23, 2025: System submissions due
- April 30, 2025: Evaluation of results
- May 21, 2025: System papers due
- May 28, 2025: Paper reviews returned
- June 9, 2025: Final camera-ready submissions
- July 31 and August 1, 2025: BEA 2025 workshop at ACL
Visit the shared task website for more information. Contact the organizers at bea.sharedtask.2025@gmail.com.
Tags: BEA 2025, Shared Task, AI-powered tutors, pedagogical ability assessment, educational dialogues, mathematical domain