M3ViT: Mixture-Of-Experts Vision Transformer for Efficient Multi-Task Learning with Model-Accelerator Co-Design

Item #:

068431-2062

Details

DOI: https://doi.org/10.52202/068431-2062
Author(s): Tianlong Chen, Yu Cheng, Zhiwen Fan, Cong Hao, Ziyu Jiang, Hanxue Liang, Rishov Sarkar, Zhangyang Wang, Kai Zou
Pages: 28441-28457 (17 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 35
Date/Location: Held 28 November - 9 December 2022, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 35
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/068431-2062
Author(s): Tianlong Chen, Yu Cheng, Zhiwen Fan, Cong Hao, Ziyu Jiang, Hanxue Liang, Rishov Sarkar, Zhangyang Wang, Kai Zou
Pages: 28441-28457 (17 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 35
Date/Location: Held 28 November - 9 December 2022, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 35
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)