Multimodal Learning Systems

Established: January 10, 2021

Mission

The goal of this program is to provide a venue to disseminate, discuss, and synthesize the latest developments in the area of multimodal learning systems including the recent developments in multimodal foundation model research. The program intends to push the boundaries of the foundational aspects of this field, to build bridges between researchers and practitioners currently active in multiple unimodal communities, as well as expanding and exploring the applications of multimodal learning systems.

Highlights

- 17-19 January 2024: ELLIS Multimodal Learning Systems Workshop on Multimodal Foundation Models, Oberwolfach-Walke, Germany
- 12-15 March 2024: ELLIS Winter School on Foundation Models, Amsterdam, The Netherlands.
- 27-31 January 2025: ELIAS-ELLIS-VISMAC Winter School, Brunico, Italy
- 18-21 March 2025: ELLIS Winter School on Foundation Models, Amsterdam, The Netherlands.
- ELIAS project: European Lighthouse of AI for Sustainability - Horizon Europe
- ELLIOT project: European Large Open Multimodal Foundation Models for Scalable Robust Generation - Horizon Europe

Collaborations

ELLIS programs:
- Geometric Deep Learning (Max Welling (UvA))
- Human-centric Machine Learning (Nuria Oliver (ALC), Bruno Lepri (FBK))
- Interactive Learning and Interventional Representations (Nicolò Cesa-Bianchi (UNIMI), Massimiliano Pontil (IIT), John Shawe-Taylor (JSI))
- Machine Learning and Computer Vision (Rita Cucchiara (UNIMORE), Josef Sivic (CTU))
- Natural Intelligence (Matthias Bethge (UT))
- Learning for Graphics and Vision (Elisa Ricci)
- Robust Machine Learning (Sami Kaski, Frank Hutter)

Industry:
- Snapchat
- Picsart
- Cisco
- Qualcomm
- Valeo
- Yooz
- Voxist

People

ELLIS Edge Newsletter
Join the 6,000+ people who get the monthly newsletter filled with the latest news, jobs, events and insights from the ELLIS Network.