Research
ELLIS fosters international collaboration across domains, connecting top researchers while investing in the next generation of AI talent.
Members
ELLIS Members are leading scientists in machine learning and AI, shaping Europe's global position in these fields.
About
ELLIS is a network of excellence connecting top AI researchers across European borders to strengthen the leadership of AI made in Europe.
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
2024
Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu
ELLIS Authors
Author Locations
No location data available for the ELLIS authors of this paper.
Research
About
