In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness

Item #:

079017-2942

Details

DOI: https://doi.org/10.52202/079017-2942
Author(s): Liam Collins, Aryan Mokhtari, Advait Parulekar, Sujay Sanghavi, Sanjay Shakkottai
Pages: 92638-92696 (59 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 37
Date/Location: Held 10-15 December 2024, Vancouver, Canada.
Series: Advances in Neural Information Processing Systems 37
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/079017-2942
Author(s): Liam Collins, Aryan Mokhtari, Advait Parulekar, Sujay Sanghavi, Sanjay Shakkottai
Pages: 92638-92696 (59 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 37
Date/Location: Held 10-15 December 2024, Vancouver, Canada.
Series: Advances in Neural Information Processing Systems 37
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)