Workshop BCI-MM 2024

Scope and Topics

Our workshop strategically aligns with the ACM MM 2024 theme, "Engaging Users with Multimedia," focusing particularly on Emotional and Social Signals. Additionally, it synergises with the theme of "Understanding Multimedia Content," emphasising Vision and Language, and Media Interpretation. In light of the significant strides made in processing human physiological signals from neuroimaging modalities, BCI emerges as a pivotal framework for modelling human behaviour and cognition patterns. Moreover, it opens avenues for establishing “direct” communication pathways between humans and machines for multimedia applications. Our workshop expects to directly address the core aspects of engaging multimedia experiences and provide insights into the cognitive understanding of multimedia content.

The workshop's significance lies in its ability to harness information derived from natural human behaviour and associated brain cognition patterns. This, in turn, empowers machine learning and human-in-the-loop decision-making in multimedia domains, spanning video/image processing and natural language interpretation. Human-centric AI applications like BCI and affective computing are gaining traction due to their efficacy in training highly accurate models, leveraging human physiological signals for robust representation learning. The outcomes of our workshop will contribute substantially to the development of innovative BCI techniques, enhancing the understanding and modelling of multimedia systems and applications.

BCI represents a current hotspot by curating exceptional papers that explore the integration of human informatics with multimedia applications, and our workshop is poised to offer ACM MM 2024 attendees a comprehensive snapshot of the latest advances in this rapidly evolving field. The workshop's multidisciplinary nature ensures that it will draw a significant number of participants, fostering a vibrant exchange of ideas and insights. Our proposed workshop not only aligns with the thematic focus of ACM Multimedia 2024 but also stands as a crucial platform for fostering collaboration and innovation in the dynamic intersection of BCI, multimedia, and human-centric technologies.

Call For Paper

The purpose of this workshop is to bring together state-of-the-art BCI research (and industry if possible) to help multimedia understanding, discuss the opportunities and challenges emerging in BCI techniques to better multimedia understanding, and introduce interesting real-world advanced BCI prototypes and systems with multimedia applications. To this end, we aim to solicit original research and/or demo, dataset, and survey papers in (but not limited to) the following topics:

BCI for multimedia analysis based on cognitive data, such as EEG, fMRI, fNIRS, etc.
LLM-aligned BCI for better multimedia computing and understanding.
Automatic decoding of brain activity patterns for multimedia understanding.
BCI modelling or learning cognitive processes in multimedia applications.
BCI Internet of Things for multimedia applications.
BCI-inspired human-agent interaction and learning for multimedia applications.
BCI platforms, systems, and architecture for multimedia applications.
New BCI concepts for multimedia representation, learning, and discovery.

SUBMISSIONS

-->

Preparation: Authors must prepare their papers using the ACM MM paper template, which can be found via the link: https://2024.acmmm.org/regular-papers/. Welcome to submit short papers (4 pages plus 1-page reference) and/or regular papers (8 pages plus up to 2-page reference), and welcome to submit the demo, dataset, and survey paper that can contribute to the workshop's themes.
Submission: Papers have to be submitted via Openreview portal https://openreview.net/group?id=acmmm.org/ACMMM/2024/Workshop/BCI/. All submitted papers will undergo a rigorous peer-review process.
Proceeding: The accepted papers must be presented at the workshop following the policies of ACM MM 2024, and all accepted papers at the workshop will be included in the ACM Digital Library https://dl.acm.org/.

Workshop Chairs

Zehong (Jimmy) Cao

University of South Australia
Australia

Tzyy-Ping Jung

University of California San Diego
USA

Peng Xu

University of Electronic Science and Technology of China
China

IMPORTANT DATES

Workshop paper submissions should align with the important dates required by ACM MM 2024. The important times are at 23:59 of the stated deadline date, Anywhere on Earth (AoE) timezone
Paper submission: July 26, 2024 (extended)
Notification of acceptance: August 12, 2024
Camera ready due: August 25, 2024

AGENDA

Workshop Time: 9:00AM-12:15PM, 28 October 2024

Workshop Venue: Meeting Room 214, Melbourne Convention and Exhibition Centre

9:00AM-9:10AM Welcome - workshop chairs

Session 1：

9:10AM-9:30AM Enhancing End-to-End Autonomous Driving Systems Through Synchronized Human Behavior Data (Full Paper), Presented by Yiqun Duan from University of Technology Sydney
9:30AM-9:50AM Joint Contrastive Learning with Feature Alignment for Cross-Corpus EEG-based Emotion Recognition (Full Paper), Presented by Qile Liu from Shenzhen University
9:50AM-10:10AM Towards Linguistic Neural Representation Learning and Sentence Retrieval from Electroencephalogram Recordings (Full Paper), Presented by Jinzhao Zhou from University of Technology Sydney
10:10AM-10:30AM Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognition (Full Paper), Presented by Zhili Lai from South China University of Technology

10:30AM-11:00AM Morning tea

Session 2：

11:00AM-11:20AM EEG-Based Contrastive Learning Models For Object Perception Using Multisensory Image-Audio Stimuli (Full Paper), Presented by Xuan-The Tran from University of Technology Sydney
11:20AM-11:35AM A Case Study on the Effects of Auditory Cues in Influencing Spatial Memory and Representation for a Person who is Blind, Presented by Minh Nguyen from University of Technology Sydney (Short Paper)
11:35AM-11:50AM Decoding Working Memory Representation Based on single-trial EEG By a Deep Learning Framework (Short Paper), Presented by Cheng Li from Chongqing University of Posts and Telecommunications
11:50AM-12:05PM Brain-Computer Interface Meets Information Retrieval: Perspective on Next-generation Information System (Short Paper), Presented by Ziyi Ye from Tsinghua University

12:05PM-12:15PM Close - announce best paper & best student paper

All presented papers will be published in the workshop proceeding in the ACM Digital Library.