-
Notifications
You must be signed in to change notification settings - Fork 4.7k
Closed
Description
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
Hi.
SageMaker Endpoints will listen for invocations at /invocations and for health checks at /health (ref). On modifying the server to listen on these endpoints, sglang can be used for SageMaker endpoints for hosting models. Is it possible to add support for this?
Thanks
Related resources
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels