Skip to content

score-compose - Add 3 ways to provision llm-model with DMR#47

Merged
mathieu-benoit merged 6 commits intomainfrom
llm-model
Oct 28, 2025
Merged

score-compose - Add 3 ways to provision llm-model with DMR#47
mathieu-benoit merged 6 commits intomainfrom
llm-model

Conversation

@mathieu-benoit
Copy link
Copy Markdown
Contributor

@mathieu-benoit mathieu-benoit commented Oct 28, 2025

score-compose - Add 3 ways to provision LLM Models with Docker Model Runner (DMR).

score-compose provisioners list
File Type Class Params Outputs Description
10-dmr-llm-model-via-curl-cmd.provisioners.yaml llm-model (any) model model, url, api-key Runs curl to download the model with the Docker Model Runner (DMR).
10-dmr-llm-model-via-curl-service.provisioners.yaml llm-model (any) model model, url, api-key Generates a curl service downloading the model with the Docker Model Runner (DMR).
10-dmr-llm-model-via-service-provider.provisioners.yaml llm-model (any) model model, url, api-key Generates the LLM model service via the Docker Model Runner (DMR) provider.

Score file example:

apiVersion: score.dev/v1b1
metadata:
  name: my-workload
containers:
  my-container:
    image: busybox
    command: ["/bin/sh"]
    args: ["-c", "while true; do echo $LLM_BASE_URL; sleep 5; done"]
    variables:
      LLM_MODEL_NAME: "${resources.model.model}"
      LLM_BASE_URL: "${resources.model.url}"
resources:
  model:
    type: llm-model
    params:
      model: ai/smollm2:135M-Q4_0

Resources:

Signed-off-by: Mathieu Benoit <mathieu-benoit@hotmail.fr>
Signed-off-by: Mathieu Benoit <mathieu-benoit@hotmail.fr>
Signed-off-by: Mathieu Benoit <mathieu-benoit@hotmail.fr>
Signed-off-by: Mathieu Benoit <mathieu-benoit@hotmail.fr>
Signed-off-by: Mathieu Benoit <mathieu-benoit@hotmail.fr>
@mathieu-benoit mathieu-benoit changed the title score-compose - Add 3 ways to provision LLM Models with DMR score-compose - Add 3 ways to provision llm-model with DMR Oct 28, 2025
Signed-off-by: Mathieu Benoit <mathieu-benoit@hotmail.fr>
@mathieu-benoit mathieu-benoit merged commit 3eab785 into main Oct 28, 2025
2 checks passed
@mathieu-benoit mathieu-benoit deleted the llm-model branch October 28, 2025 19:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant