Skip to content

Comments

Support incremental streaming of logprob/token_ids between scheduler and detokenizer#6225

Merged
merrymercy merged 5 commits intomainfrom
lianmin/incremental-stream
May 12, 2025
Merged

Support incremental streaming of logprob/token_ids between scheduler and detokenizer#6225
merrymercy merged 5 commits intomainfrom
lianmin/incremental-stream

Commits

Commits on May 12, 2025