Research
Members
About
News
Events

ELLIS fosters international collaboration across domains, connecting top researchers while investing in the next generation of AI talent.

PhD & Postdoc Program Sites Research Programs Jobs ELLIS PhD Award Projects Building on ELLIS Conference Contributions

Members

ELLIS Members are leading scientists in machine learning and AI, shaping Europe's global position in these fields.

Become a Member Members List Become a Fellow Fellows List

About

ELLIS is a network of excellence connecting top AI researchers across European borders to strengthen the leadership of AI made in Europe.

Board Organisation ELLIS Open Letter ELLIS Position Paper Contact For Media ELLIS FAQ Partnerships

Scaling Vision Transformers to 22 Billion Parameters

2023

proceedings.mlr.press

Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd Van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby