Compete in the ACM MM’24 Grand Challenge: MultiMediate

The ACM Multimedia 2024 Grand Challenge, MultiMediate, is now open for participation. This challenge focuses on facilitating and measuring progress on key social behavior sensing and analysis tasks, with an emphasis on artificial mediators that support conversations. This year’s challenge highlights the estimation of engagement across different domains, as well as backchannel detection, eye contact detection, and bodily behavior recognition.

The Engagement Estimation Task requires participants to create engagement estimation approaches that can transfer across various context factors, such as culture, group composition, and professional vs. private contexts. The challenge utilizes the Novice-Expert Interaction (NoXi) database for training and introduces three novel out-of-domain datasets for evaluation. These datasets include additional data in the NoXi setting from four additional languages, data from co-located group discussions, and dyadic speed dating interactions in a videoconferencing setting.

For the Continuing Tasks, the challenge welcomes submissions for Eye contact detection, backchannel detection, and bodily behavior recognition. These tasks utilize the MPIIGroupInteraction dataset, which consists of group discussions of 3-4 participants.

To participate, access the datasets and baseline implementations on the MultiMediate website. Submit predictions for evaluation against ground truth on their servers. The paper submission deadline is on 12 July 2024. The organizers include experts from the German Research Center for Artificial Intelligence, Augsburg University, University of Stuttgart, and INRIA Sophia Antipolis.