Research
ELLIS fosters international collaboration across domains, connecting top researchers while investing in the next generation of AI talent.
Members
ELLIS Members are leading scientists in machine learning and AI, shaping Europe's global position in these fields.
About
ELLIS is a pan-European AI network of excellence built upon machine learning as the driver for modern AI.
Multi modal video learning
Video streams consist of multiple modalities, e.g., RGB frames, optical flow, audio. Their natural correspondence provides rich semantic information to achieve effective multi-modal perception and learning. In this project, our aim is to understand the video content by analyzing multiple modalities and decide which modality to trust in different scenarios, especially under harsh vision conditions. To this end, various cross-modal interaction modules will be developed to fit specific tasks, such as action recognition, repetition counting, activity localization.
Industry Track
October 1st, 2019 - September 1st, 2023
Exchange Advisor
Research
About
