Skip to content

Add detok in chat completion fn for non stream mode when VLLM_DETOKENIZE_ON_OPENAI_SERVER=true#1768

Merged
michalkuligowski merged 3 commits intohabana_mainfrom
separk/detok_nonstream
Aug 29, 2025
Merged

Add detok in chat completion fn for non stream mode when VLLM_DETOKENIZE_ON_OPENAI_SERVER=true#1768
michalkuligowski merged 3 commits intohabana_mainfrom
separk/detok_nonstream

Commits

Commits on Aug 18, 2025

Commits on Aug 25, 2025

Commits on Aug 26, 2025