Skip to content

[Feature] Add SageMaker Support #3739

@andjsmi

Description

@andjsmi

Checklist

Motivation

Hi.

SageMaker Endpoints will listen for invocations at /invocations and for health checks at /health (ref). On modifying the server to listen on these endpoints, sglang can be used for SageMaker endpoints for hosting models. Is it possible to add support for this?

Thanks

Related resources

No response

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions