Connectionists: Call for papers: Workshop on Benchmarking and Expanding AI Multimodal Approaches (BEAM) @ CVPR 2025

[Laszlo A. Jeni]

**************************************************************************
1st Workshop on Benchmarking and Expanding AI Multimodal Approaches (BEAM)
Co-located with CVPR 2025
Dates: June 11th/12th, 2025
Place: Nashville, TN, USA (Co-located with CVPR 2025)
Website: https://beam-workshop2025.github.io/
CMT is open: https://cmt3.research.microsoft.com/BEAM2025/
**************************************************************************

-----------
DESCRIPTION
-----------

The 1st Workshop on Benchmarking and Expanding AI Multimodal Approaches at
CVPR 2025 aims to build a forum to discuss ongoing efforts in industry and
academia, share best practices, and engage the community in working towards
more comprehensive AI evaluation framework incorporating audio, visual, and
textual inputs, addressing the limitations of current unimodal benchmarks.
The event will feature discussions highlighting the evolution and future of
multimodal AI benchmarks, exploring methodologies and their real-world
applications. It will conclude with a dynamic panel discussion, offering
insights into the challenges and solutions for creating robust multimodal
benchmarks and fostering interdisciplinary collaboration and innovation in
AI benchmarking standards.

======
Topics
======

We invite submissions of full-length papers (8 pages excluding the
references) for workshop proceedings. The topics covered in the workshop
include but are not limited to:
- Challenges in Multimodal AI Evaluation: Current limitations and the need
for integrated assessments.
- Designing Multimodal Benchmarks: Strategies for creating realistic and
comprehensive tasks.
- Ethical and Fair AI Evaluation: Addressing biases to ensure fairness
across different demographic groups.
- Multimodal AI in Real-World Applications: Case studies demonstrating the
application of multimodal systems.
- Future Directions in AI Benchmarking: Innovative methods and technologies.

----------
SUBMISSION
----------

All accepted papers will be published as part of CVPR 2025 workshop
proceedings, therefore, should follow the same paper guidelines of the
conference.
The papers will be subject to a double-blind review process, i.e. authors
must not identify themselves on the submitted papers. The reviewing process
is single-stage without rebuttals.
https://cvpr.thecvf.com/Conferences/2025/AuthorGuidelines
https://github.com/cvpr-org/author-kit/releases

For paper submission, please use the CMT site:
https://cmt3.research.microsoft.com/BEAM2025/

---------------
IMPORTANT DATES
---------------

March 11: Submission of full papers
March 25: Notification of acceptance
April 5: Camera-ready full paper submission
Workshop Date: June 11th or 12th (half-day)

-------------------
WORKSHOP ORGANIZERS
-------------------

Laszlo A. Jeni (CMU) Xu Zhang (Amazon)
Liuyue Xie (CMU) Morteza Ziyadi (Amazon)
Mosam Dabhi (CMU) Hao Yang (Amazon)
Rohan Choudhury (CMU) Yang Zou (Amazon)
Ananya Bal (CMU) Zhaowei Cai (Amazon)
Ce Zheng (CMU) Maria Zontak (Amazon)
Xiang Yue (CMU) Ashwin Swaminathan (Amazon)
Davide Modolo (Amazon)

+------------------------------------------
| Laszlo A. Jeni, PhD
|   Assistant Research Professor
|   Robotics Institute
|   Carnegie Mellon University
| Web: http://www.laszlojeni.com
| Email: laszlojeni at cmu.edu
| Tel:   (+1) 412-268-4461
+------------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20250218/b6c2408a/attachment-0001.html>