Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture

Item #:

075280-3390

Details

DOI: https://doi.org/10.52202/075280-3390
Author(s): Simran Arora, Evan Sabri Eyuboglu, Dan Fu, Jessica Grogan, Isys Johnson, Michael Poli, Christopher Ré, Atri Rudra, Benjamin Spector, Armin Thomas
Pages: 77546-77603 (58 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 36
Date/Location: Held 10-16 December 2023, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 36
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/075280-3390
Author(s): Simran Arora, Evan Sabri Eyuboglu, Dan Fu, Jessica Grogan, Isys Johnson, Michael Poli, Christopher Ré, Atri Rudra, Benjamin Spector, Armin Thomas
Pages: 77546-77603 (58 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 36
Date/Location: Held 10-16 December 2023, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 36
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)