Research
ELLIS fosters international collaboration across domains, connecting top researchers while investing in the next generation of AI talent.
Members
ELLIS Members are leading scientists in machine learning and AI, shaping Europe's global position in these fields.
About
ELLIS is a network of excellence connecting top AI researchers across European borders to strengthen the leadership of AI made in Europe.
Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
2025
Zhenghao Lin, Zihao Tang, Xiao Liu, Yeyun Gong, Yi Cheng, Qi Chen, Hang Li, Ying Xin, Ziyue Yang, Kailai Yang, Yu Yan, Xiao Liang, Shuai Lu, Yiming Huang, Zheheng Luo, Lei Qu, Xuan Feng, Yaoxiang Wang, Yuqing Xia, Feiyang Chen, Yuting Jiang, Yasen Hu, Hao Ni, Binyang Li, Guoshuai Zhao, Jui-Hao Chiang, Zhongxin Guo, Chen Lin, Kun Kuang, Wenjie Li, Yelong Shen, Jian Jiao, Peng Cheng, Mao Yang
ELLIS Authors
Author Locations
No location data available for the ELLIS authors of this paper.
Research
About
