-
Notifications
You must be signed in to change notification settings - Fork 4.5k
Closed
Labels
cicontinue integration relatedcontinue integration relatedenhancementNew feature or requestNew feature or requestinactive
Description
Checklist
- If this is not a feature request but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
- Please use English. Otherwise, it will be closed.
Motivation
If the model is the exact same architecture, we can use a smaller model to speed up CI? Currently some tests are taking a long time.
Also we can increase the BS for many accuracy related tests.
E.g, Gemma 27B -> 1B
We may also have to adjust accuracy related tests if this happens.
Related resources
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
cicontinue integration relatedcontinue integration relatedenhancementNew feature or requestNew feature or requestinactive