GenBench: The Second Workshop on Generalisation (Benchmarking) in NLP @ EMNLP 2024

GenBench, the second workshop on generalisation (benchmarking) in NLP, will be held in conjunction with EMNLP 2024. The workshop aims to bring together various expert communities to discuss challenging questions related to generalisation in NLP, crowd-source challenging generalisation benchmarks for large language models (LLMs), and make progress on open questions related to generalisation. Topics of interest include opinion or position papers about generalisation, analyses of how existing or new models generalise, empirical studies that propose new paradigms to evaluate generalisation, meta-analyses, and studies on the relationship between generalisation and fairness or robustness.

The workshop calls for two types of submissions: regular workshop submissions and collaborative benchmarking task (CBT) submissions. Regular workshop submissions can be archival papers or extended abstracts, while CBT submissions consist of a data/task artefact and a companion paper. Submissions for both categories are due on August 15, 2024, with notification of acceptance on September 20, 2024. The camera-ready deadline is October 4, 2024, and the workshop will take place on November 15 or 16, 2024.

For more information, visit the workshop website or email the organizers at genbench at googlegroups.com.