ML Scientist

Connecting Scholars with the Latest Academic News and Career Paths

Conference CallsFeatured

GEM2 Workshop @ ACL 2025: Call for Papers & Dataset Release

GEM2 workshop at ACL 2025: Call for papers and dataset release for LLM evaluation research.

The GEM2 workshop, part of ACL 2025, invites submissions on meaningful, efficient, and robust evaluation of LLMs. A large dataset of 1B model predictions, prompts, and gold standard references has been released, including DOVE and DataDecide.

Important dates:

  • April 11: Direct paper submission deadline (ARR)
  • May 5: Pre-reviewed (ARR) commitment deadline
  • May 19: Notification of acceptance
  • June 6: Camera-ready paper deadline
  • July 7: Pre-recorded videos due
  • July 31 – August 1: Workshop at ACL in Vienna

Check the GEM website for submission links, templates, and more details. Email gem-benchmark-chairs@googlegroups.com with questions.

Tags: GEM2 workshop, ACL 2025, LLM evaluation, dataset release, DOVE, DataDecide, natural language processing, research workshop