MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers

Item #:

075280-3447

Details

DOI: https://doi.org/10.52202/075280-3447
Author(s): Armen Aghajanyan, Colin Flaherty, Mike Lewis, Daniel Simig, Lili Yu, Luke Zettlemoyer
Pages: 78808-78823 (16 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 36
Date/Location: Held 10-16 December 2023, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 36
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/075280-3447
Author(s): Armen Aghajanyan, Colin Flaherty, Mike Lewis, Daniel Simig, Lili Yu, Luke Zettlemoyer
Pages: 78808-78823 (16 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 36
Date/Location: Held 10-16 December 2023, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 36
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)