fix(cost-map): add us-south1 to vertex qwen3-235b-a22b-instruct-2507-maas#25382
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
|
Greptile SummaryThis PR adds Confidence Score: 5/5Safe to merge — minimal, targeted metadata fix with no code logic changes. Both JSON files are updated consistently; the change is a one-line addition to a supported_regions array. No logic, no tests, no schema, no security surface affected. No files require special attention.
|
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Adds "us-south1" to supported_regions for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maas; no other fields changed. |
| litellm/model_prices_and_context_window_backup.json | Mirror of the primary JSON change — adds "us-south1" to the same model's supported_regions; kept in sync with model_prices_and_context_window.json. |
Flowchart
%%{init: {'theme': 'neutral'}}%%
flowchart TD
A["LiteLLM receives request\nfor vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maas\nregion: us-south1"] --> B{"Is us-south1 in\nsupported_regions?"}
B -- "Before fix: NO" --> C["⚠️ Warning: region unsupported\nRoutes to 'global' instead"]
B -- "After fix: YES" --> D["✅ Routes to us-south1\nas configured"]
Reviews (1): Last reviewed commit: "fix(cost-map): add us-south1 to vertex q..." | Re-trigger Greptile
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Refs #25380
Summary
Add
us-south1tosupported_regionsfor the Vertex Qwen model:vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maasThis updates both:
model_prices_and_context_window.jsonlitellm/model_prices_and_context_window_backup.jsonWhy
LiteLLM's packaged metadata currently lists only:
["global"]for this model.
When LiteLLM is configured to use this Vertex Qwen model in us-south1, it warns that the region is unsupported and routes to global instead.
Observed warning:
Vertex AI model 'qwen/qwen3-235b-a22b-instruct-2507-maas' does not support region 'us-south1' (supported: ['global']). Routing to 'global'.I also verified the packaged metadata inside the latest Docker image:
ghcr.io/berriai/litellm:main-stable
and it currently reports:
["global"]
for this model's supported_regions.
What changed
Added us-south1 to:
Validation
This matches working behavior against Vertex AI for the same model in us-south1.
As a local workaround before this patch, overriding LiteLLM's cost map to add us-south1 removed the warning and allowed the expected us-south1 configuration to work correctly.