Call for NTCIR-19 Task Proposals
Call for task proposals for NTCIR-19, focusing on information access with East Asian languages and English. Submit by March 31, 2025.
Researchers and practitioners are invited to submit task proposals for NTCIR-19, the 19th evaluation conference focusing on information access with East Asian languages and English. The conference aims to advance the state of the art and foster collaboration among research teams globally.
Important Dates:
- March 31, 2025: Task Proposal Submission Due (Anywhere on Earth)
- May 15, 2025: Acceptance Notification of Task Proposals
- June 10-13, 2025: NTCIR-18 Conference in Tokyo, Japan
Submission Link: Submit Task Proposal
NTCIR-19 Tentative Schedule:
- January 2026: Dataset release
- January-June 2026: dry run
- March-July 2026: formal run
- August 1, 2026: evaluation results return
- August 1, 2026: task overview release (draft)
- September 1, 2026: submission due of participant papers (draft)
- November 1, 2026: camera-ready participant paper due
- December 2026: NTCIR-19 conference in Tokyo, Japan
Who Should Submit NTCIR-19 Task Proposals?
Proposals are welcome from researchers addressing significant challenges in information access, particularly those involving large language models (LLMs). Proposals should focus on practical tasks and real-world applicability, utilizing authentic data and addressing evaluation challenges.
Proposal Types:
- Core Task: Fosters research on a specific information access problem with a common evaluation ground.
- Pilot Task: Focuses on novel information access problems with uncertainties in task design or organization.
Review Criteria:
- Importance to the information access community and society
- Timeliness of the task
- Organizers’ commitment
- Financial sustainability
- Sound evaluation methodology
- Detailed data description
- Language scope
Tags: NTCIR-19, task proposals, information access, large language models, research conference, evaluation framework, data release