-
Notifications
You must be signed in to change notification settings - Fork 59
[feature request] Support Compose models #367
Copy link
Copy link
Labels
dockerPull requests that update Docker codePull requests that update Docker codeenhancementNew feature or requestNew feature or requestgoPull requests that update Go codePull requests that update Go codegood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed
Metadata
Metadata
Assignees
Labels
dockerPull requests that update Docker codePull requests that update Docker codeenhancementNew feature or requestNew feature or requestgoPull requests that update Go codePull requests that update Go codegood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed
Docker Compose now supports at the root level
models: https://docs.docker.com/ai/compose/models-and-compose/.Basic example:
It seems that the goal will be to add
modelssupport in theprovisioners: https://github.com/score-spec/score-compose/blob/main/internal/provisioners/core.go#L85.Open question: for
patch-templatestoo? Not sure...As a reference, today we can do that via a
service'sproviderlike illustrated below, but this will be deprecated soon:https://github.com/score-spec/community-provisioners/blob/main/llm-model/score-compose/10-dmr-llm-model-via-service-provider.provisioners.yaml