RedPajama: an Open Dataset for Training Large Language Models

Item #:

079017-3697

Details

DOI: https://doi.org/10.52202/079017-3697
Author(s): Shane Adams, Virginia Adams, Anton Alexandrov, Quentin Anthony, Ben Athiwaratkun, Rahul Chalamala, Kezhen Chen, Tri Dao, Daniel Fu, Percy Liang, Xiaozhong Lyu, Huu Nguyen, Yonatan Oren, Christopher Ré, Irina Rish, Max Ryabinin, et al.
Pages: 116462-116492 (31 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 37
Date/Location: Held 10-15 December 2024, Vancouver, Canada.
Series: Advances in Neural Information Processing Systems 37
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/079017-3697
Author(s): Shane Adams, Virginia Adams, Anton Alexandrov, Quentin Anthony, Ben Athiwaratkun, Rahul Chalamala, Kezhen Chen, Tri Dao, Daniel Fu, Percy Liang, Xiaozhong Lyu, Huu Nguyen, Yonatan Oren, Christopher Ré, Irina Rish, Max Ryabinin, et al.
Pages: 116462-116492 (31 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 37
Date/Location: Held 10-15 December 2024, Vancouver, Canada.
Series: Advances in Neural Information Processing Systems 37
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)