-
Notifications
You must be signed in to change notification settings - Fork 4.5k
Closed
Labels
Description
Bug Fixes
- [router][grpc] Fix background tasks stored with wrong id #11945
- [router][grpc] Fix wram-up random token ids for small models #11887
- [router][grpc] Remove
continue_final_messageinChatTemplateParamsand addminijinja-contrib#11882 - [router] clean up workflow logs to debug for implementation details logs #11886
- Fix openai input_text type compatibility #11935
- fix(sql-router): fix conflict port in test #11826
- [router][grpc] Fix tool call id in
parse_json_schema_response#12152 - [router] fix router release workflow and add build test in PR #12315
- [router][grpc] Fix inconsistent behavior of conversation_id not found #12299
- [bug] fix router installation to include additional dependency #12348
- [bug] fix router pypi license file #12345
Features
- [router][grpc] Support
v1/responsesAPI for non GPT OSS models #11926 - [router] create worker removal step and clean up worker manager #11921
- [grpc] Support gRPC standard health check #11955
- [router] Support multiple worker URLs for OpenAI router #11723
- [router] MCP Manager - Support Connection Pooling, Tool Inventory and Proxy #12097
- [router] Add mTLS Support for Router-to-Worker Communication #12019
- [router] implement response api get input item function and refactor input/output store #11924
- [router] use safety_identifier replace user on chat history storage #12185
- [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support #12153
- [router] upgrade grpc dependency and py 3.13 3.14 support #12284
- [router] support arm, windows, mac, linux, reduce wheel size and number #12285
- [router] harmony responses api streaming support #12395
- [router] web_search_preview tool basic implementation #12290
- [router] web_search_preview tool basic implementation #12290
Enhancement, Code Clean Up
- [router] Add gRPC E2E test suite #11790
- [router] centralize mcp tool args handling #12155
- [router] fix ut router config init to use build pattern #12084
- [router] migrate app context to builder pattern 1/n #12086
- [router] migrate app context to builder pattern 2/n #12089
- [router] Add builder pattern for RouterConfig with zero duplication #12030
- [router] change ci names and update log level in ci #12021
- [router][CI] Clean up imports and prints statements in sgl-router/py_test #12024
- [router][grpc] Remove gpt_oss parsers and remove _parser suffix in tool parser files #12091
- [router] cleaned up all the redundant comments in the config module #12147
- [router][grpc] Add
ResponsesContextand fix error propagation in responses api #12164 - [misc][grpc] Remove duplicate log #12168
- [router] Remove SharedXxxStorage type aliases to make Arc explicit #12171
- [router] add spec.rs to enables tests under spec folder #11734
- [doc] update router document #11767
- [router] Add comprehensive E2E tests for Response API #11988
- [router] Refactor data connector architecture with unified storage modules #12096
- [sgl-route] Optimize the use of constant slices and retain to simplif… #12159
- [router] update router docker to use maturin and build from local #12350
- [router] refactor mcp to use LRU and fix pooling bug #12346
Responses API
- Hosted WebSearchTool Integration when WebSearchTool in input
- WebSearch/MCP Streaming handling
- Structure outputs, functions calls and bulk inputs
Reactions are currently unavailable