Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration

Item #:
079017-2923

Details

Description

 

Members/Attendees

 

Tab 4