SciVQA: Scientific Visual Question Answering Shared Task
The SciVQA Shared Task at SDP 2025 invites researchers to develop multimodal QA systems using scientific figures from ACL Anthology and arXiv papers. Important dates and submission details are provided.
The SciVQA Shared Task, part of the SDP 2025 Workshop, invites researchers to develop multimodal QA systems using a dataset of scientific figures from ACL Anthology and arXiv papers. Each figure is annotated with seven QA pairs and includes metadata such as caption, figure ID, and figure type.
The task focuses on closed-ended visual and non-visual questions, with evaluations using metrics like BLEU, METEOR, and ROUGE. Automated evaluations will be conducted through the Codabench platform.
Important Dates:
- Release of training data: April 1, 2025
- Release of testing data: April 15, 2025
- Deadline for system submissions: May 16, 2025
- Paper submission deadline: May 23, 2025
- Notification of acceptance: June 13, 2025
- Camera-ready paper due: June 20, 2025
- Workshop: July 31, 2025 or August 1, 2025 (TBA)
Participants are encouraged to submit papers on their systems, with successful submissions published in the SDP 2025 workshop proceedings.
For more information, visit the SciVQA Shared Task page and the SDP 2025 Workshop page.
Tags: SciVQA, Scientific Visual Question Answering, SDP 2025, ACL Anthology, arXiv, Multimodal QA, Codabench, Research Workshop