$S^3$: Increasing GPU Utilization during Generative Inference for Higher Throughput

$S^3$: Increasing GPU Utilization during Generative Inference for Higher Throughput

Item #:: 075280-0791
UPC:

Download PDF

Details

DOI: https://doi.org/10.52202/075280-0791
Author(s): David Brooks, Yunho Jin, Gu-Yeon Wei, Chun-Feng Wu
Pages: 18015-18027 (13 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 36
Date/Location: Held 10-16 December 2023, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 36
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

Description

Members/Attendees

Tab 4

Details
Description
Members/Attendees
Tab 4

DOI: https://doi.org/10.52202/075280-0791
Author(s): David Brooks, Yunho Jin, Gu-Yeon Wei, Chun-Feng Wu
Pages: 18015-18027 (13 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 36
Date/Location: Held 10-16 December 2023, New Orleans, Louisiana, USA.
Series: Advances in Neural Information Processing Systems 36
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)