TODOs:
- Codespace setup with DMR
- Kubernetes
- https://docs.docker.com/ai/model-runner/api-reference/
- https://github.com/AdminTurnedDevOps/agentic-demo-repo/blob/main/kagent-oss/llama-k8s-agentic/setup-llama.md
- https://github.com/docker/model-runner/blob/main/charts/docker-model-runner/templates/deployment.yaml
- https://k33g.hashnode.dev/first-contact-with-docker-model-runner-in-golang#heading-run-the-program-using-docker-compose
- https://github.com/Reshrahim/todoapp-ai/blob/main/recipes/kubernetes-llama/main.tf
- https://github.com/docker/compose-bridge-transformer
With Ollama:
sequenceDiagram
Command->>+Files: score-compose init
Files-->>+Files: ollama.tpl
Files-->>+Files: ollama-puller-provisioner.yaml
Command->>+Files: score-compose generate
Files-->>+Files: compose.yaml
Command->>+Docker: docker compose up
Docker-->>+Docker: ollama pull gemma3:270m
Docker-->>+Docker: ollama pull smollm2:135m
With DMR:
sequenceDiagram
Command->>+Files: score-compose init
Files-->>+Files: dmr-service-provisioner.yaml
Command->>+Files: score-compose generate
Files-->>+Files: compose.yaml
Command->>+Docker: docker compose up
Docker-->>+Docker: docker model pull ai/smollm2
Docker-->>+Docker: docker model pull ai/gemma3