Rong Xiao

affiliation not provided to SSRN

No Address Available

SCHOLARLY PAPERS

1

DOWNLOADS

5

TOTAL CITATIONS

0

Scholarly Papers (1)

1.

Bita: Bi-Directional Tuning for Lossless Acceleration in Large Language Models

Number of pages: 23 Posted: 30 Dec 2024
affiliation not provided to SSRN, affiliation not provided to SSRN, affiliation not provided to SSRN, affiliation not provided to SSRN, Shenzhen Intellifusion Ltd. - Department of AI Technology Center, affiliation not provided to SSRN and affiliation not provided to SSRN
Downloads 5 (1,302,804)

Abstract:

Loading...

LLM, semi-autoregressive generation, speculative decoding, Prompt Tuning, draft verification