What are Adapters Really Efficient At?

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Mitesh M. Khapra, Pratyush Kumar, V. Rudra, Murthy Anoop, Kunchukuttan. 2022, Naama-677, Adam Roberts, Stella Biderman, Teven Le Scao, Saiful Bari, Sheng Shen, Zheng-Xin Yong, Hai-682 ley Schoelkopf, Xiangru Tang, Dragomir R. Radev, Al-683 ham, Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Jonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé, Kyunghyun Cho, Iryna Gurevych, Clifton Poth, Aishwarya, Ivan Kamath, Sebastian Vuli´c, Kyunghyun Ruder, Gregor Geigle, Max Glockner, Jonas Beck, Nils Pfeiffer, Reimers Iryna, Victor Sanh, Colin Raffel, Lintang Bach, Zaid Sutawika, Antoine Alyafeai, Arnaud Chaffin, Arun Stiegler, Manan Raja, Dey Saiful, Canwen Bari, Urmish Xu, Thakker, Shanya Sharma, Eliza Szczechla, Taewoon, Gunjan Kim, Nihal Chhablani, Nayak, Debajyoti, Jonathan Datta, Mike Tian-Jian Chang, Han Jiang, Matteo Wang, S. Mânica, Zheng Xin Shen, Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Tripathi Neeraj, Jos Rozen, Abheesht Sharma, A. Santilli, Thibault Févry, Jason Alan Fries, Maarten Sap, Hannah Rashkin, Derek Chen, Ronan, Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Adam R. Brown, Adam Santoro, Adrià Gupta, Agnieszka Garriga-Alonso, Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Par-765, Allen Nie, Aman Hussain, Amanda Askell, Anantharaman S. Iyer, Anders Andreassen, Andrea Madotto, A. Santilli, Andreas Stuhlmüller, Andrew M. Dai, Andrew La, Andrew Lampinen, Angela Zou, Angelica Jiang, Anh Chen, Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabas-773, Arul Menezes, Arun Kirubarajan, Asher Mul-774, Ashish lokandov, Austin Sabharwal, Herrick, Avia, A. Efrat, Ayla Erdem, B. Karaka¸s, Ryan Roberts, B. S. Loe, Barret Zoph, Bartlomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam, Benjamin Neyshabur, Benno Inden, Berk Stein, Ek-779 mekci, Bill Yuchen, Blake Lin, Cameron Howald, Cameron Diao, Catherine Dour, Cedrick Stinson, Ar-781 César, Chandan Ferri Ramírez, Charles Singh, Christopher D. Manning, Christopher Potts, Cindy 785 Ramirez, Clara Rivera, Clemencia Siro, Colin Raf-786, Courtney Ashcraft, Cristina Garbacea, Dan Sileo, Daniel H Garrette, Dan Hendrycks, Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, D. Gilboa, David Dohan, D. Drakard, David Ju-792, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Tam, mán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang, Gonzalo Jaimovitch-807 López, Gregor Betz, Guy Gur-Ari, Hana Galijase-808 vic, Hannah Kim, Harsh Mehta, H. Bogar, Henry Shevlin, Hinrich Schütze, H. Yakura, Hongming Zhang, Hugh Mee Wong, Ian Ng, Isaac Noble, Jaap Jumelet, Jack Geissinger, John Kernion, Jacob Hilton, Jae-813 hoon Lee, J. Fisac, James B. Simon, James Koppel, James Zheng, James Zou, Jan Ko-815 co´n, Jana Thompson, Jared Kaplan, Jarema Radom, Joyce Chua, Kamil Kanclerz, Karen Livescu, Karl Krauth, Karthik Gopalakrishnan, Katerina Ignatyeva, K. Markert, Kaustubh D. Dhole, Kevin Gim-827 pel, Kevin Omondi, K. Mathewson, Kristen Chi-828 afullo, Ksenia Shkaruta, Kumar Shridhar, Kyle Mc-829 Donell, Kyle Richardson, Laria Reynolds, Leo Gao, Li Zhang, Liam Dugan, Lianhui Qin, Lidia Contreras Ochando, Louis-Philippe Morency, Luca Moschella, Maarten ¸Senel, Maarten Bosma, Manaal Farooqi, Mantas Faruqui, Marco Mazeika, Marco Baturan, Marco Marelli, Maria Jose Maru, Marie Ramírez Quintana, Tolkiehn Mario, Martha Giulianelli, Martin Lewis, L. PotthastMatthew, Matthew L. Leavitt, Mátyás Schu-840 bert Hagen, Medina Orduna, Melody Baitemirova, Arnaud Melvin, Michael A McElrath, Michael Yee, Michael Co-842 hen, Michael Gu, M. Ivanitskiy, Michael Star-843 ritt, M. Strube, Michele Sw˛edrowski, Michihiro Bevilacqua, Mihir Yasunaga, Mike Kale, Mimee Cain, Mirac Xu, Mo Suzgun, Monica Tiwari, Moin Bansal, Mor Aminnaseri, Mozhdeh Geva, Mukund Gheini, T. Varma, Nanyun Peng, tish Shirish Keskar, Niveditha Iyer, Noah Fiedel, Nuan Wen, Oliver Zhang, Omar Agha, Omar Elbaghdadi, Omer Levy, Owain Evans, Pablo Antonio, Moreno Casares, Parth Doshi, Jason Wei, Maarten Bosma, Vincent Y. Zhao, Adams Wei Guu, Brian Yu, Nan Lester, An-921 Du, M. Dai, Quoc V. Le, Finetuned, Adina Williams, Nikita Nangia, Samuel R. Bowman, Thomas Wolf, Lysandre Debut, Clement Chaumond, Anthony Delangue, Pier-339 Moi, Tim ric Cistac, Rémi Rault, Morgan Louf, Funtow-900 Joe, Sam Davison, Patrick Shleifer, V. Platen, Clara Ma, Yacine Jernite, J. Plu, Canwen Xu, Sylvain Gugger, Mariama Drame, Yinfei Yang, Yuan Zhang, Chris Tar, Hailey Schoelkopf, Niklas Muen-954, Alham Fikri, D. Adelani, M Saiful Bari, Lintang Sutawika, Zhihan Zhang, Wenhao Yu, Mengxia Yu, Zhichun Guo, Jonathan May