[model-gateway] reduce cpu overhead#15316

slin1237 merged 1 commit intomainsgl-project/sglang:mainfrom

metric-n/13sgl-project/sglang:metric-n/13Copy head branch name to clipboard