Elastic Weight Consolidation for Reduction of Catastrophic Forgetting in GPT-2

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, J. Bohg, Antoine Bosselut, E. Brunskill, Erik Brynjolfsson, S. Buch, Dallas Card, Rodrigo Castellon, Niladri S. Chatterji, Annie Chen, Kathleen A. Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, J. Etchemendy, Kawin Ethayarajh, Fei-Fei Li, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah D. Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, P. Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Pang Omar Khattab, Wei Koh, M. Krass, Ranjay Kr-303 ishna, Rohith Kuditipudi, Ananya Kumar, Faisal Lad-304 hak, Mina Lee, Tony Lee, J. Leskovec, Isabelle Levent, Xiang Lisa, Xuechen Li, Tengyu Li, Ma Ali, Christopher D Malik, Suvir Mirchan-307 dani Manning, Eric Mitchell, Zanele Munyikwa, Suraj Nair, A. Narayan, Deepak Narayanan, Benjamin Newman, Hongyu Reich, Frieda Ren, Yusuf Rong, Roohani Camilo, Jack Ruiz, Christopher Ryan, Dorsa Ré, Shiori Sadigh, Keshav Sagawa, Andy Santhanam, Krishnan Shih, Alex Srinivasan, Rohan Tamkin, Armin W Taori, Florian Thomas, Rose E Tramèr, William Wang, Bo Wang, Jiajun Wu, Yuhuai Wu, Sang Michael Wu, Michihiro Xie, Jiax-uan Yasunaga, Matei You, Michael Zaharia, Tianyi Zhang, Zhang Xikun, Yuhui Zhang, Lucia Zhang, Kaitlyn Zheng, Zhou Percy, Liang, Michael McCloskey, Neal J Cohen, Catas-351, G. I. Parisi, Ronald Kemker, Jose L. Part, C. Kanan, Stefan Wermter. 2019, Continual, Alec Radford, Jeffrey Wu, R. Child, D. Luan