Once Read is Enough: Domain-specific Pretraining-free Language Models with Cluster-guided Sparse Experts for Long-tail Domain Knowledge

Item #:

079017-2822

Details

DOI: https://doi.org/10.52202/079017-2822
Author(s): Mengyi Chen, Yixuan Chen, Robert Dick, Fang Dong, Mingzhi Dong, Ning Gu, Dongsheng Li, Tun Lu, Qin Lv, Li Shang, Yubin Shi, Yujiang Wang, Fan Yang, Xiaochen Yang, Jixian Zhou, Rui Zhu
Pages: 88956-88980 (25 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 37
Date/Location: Held 10-15 December 2024, Vancouver, Canada.
Series: Advances in Neural Information Processing Systems 37
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/079017-2822
Author(s): Mengyi Chen, Yixuan Chen, Robert Dick, Fang Dong, Mingzhi Dong, Ning Gu, Dongsheng Li, Tun Lu, Qin Lv, Li Shang, Yubin Shi, Yujiang Wang, Fan Yang, Xiaochen Yang, Jixian Zhou, Rui Zhu
Pages: 88956-88980 (25 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 37
Date/Location: Held 10-15 December 2024, Vancouver, Canada.
Series: Advances in Neural Information Processing Systems 37
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)