Repositories list

• llm-d-workload-variant-autoscaler

  Public

  llm-d/llm-d-workload-variant-autoscaler’s past year of commit activity
  Variant optimization autoscaler for distributed inference workloads

  Go

  •

  Apache License 2.0

  •4848 forks•3838 stars•111111 issues•3131 pull requests•Updated Apr 20, 2026Apr 20, 2026

• llm-d-inference-scheduler

  Public

  llm-d/llm-d-inference-scheduler’s past year of commit activity
  Inference scheduler for llm-d

  kubernetesainetworking+ 2

  kubernetesainetworkinginferencegateway-api

  Go

  •

  Apache License 2.0

  •167167 forks•169169 stars•7272 issues•1919 pull requests•Updated Apr 20, 2026Apr 20, 2026

• llm-d-benchmark

  Public

  llm-d/llm-d-benchmark’s past year of commit activity
  llm-d benchmark scripts and tooling

  incubating

  incubating

  Python

  •

  Apache License 2.0

  •7070 forks•5757 stars•4949 issues•2424 pull requests•Updated Apr 20, 2026Apr 20, 2026

• llm-d

  Public

  llm-d/llm-d’s past year of commit activity
  Achieve state of the art inference performance with modern accelerators on Kubernetes

  Shell

  •

  Apache License 2.0

  •424424 forks•3k3k stars•175175 issues•7171 pull requests•Updated Apr 19, 2026Apr 19, 2026

• llm-d-prism

  Public

  llm-d/llm-d-prism’s past year of commit activity
  Performance analysis for distributed inference systems

  JavaScript

  •

  Apache License 2.0

  •77 forks•77 stars•11 issue•11 pull request•Updated Apr 19, 2026Apr 19, 2026

• llm-d-inference-sim

  Public

  llm-d/llm-d-inference-sim’s past year of commit activity
  A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

  incubating

  incubating

  Go

  •

  Apache License 2.0

  •7575 forks•116116 stars•3232 issues•66 pull requests•Updated Apr 19, 2026Apr 19, 2026

• llm-d-kv-cache

  Public

  llm-d/llm-d-kv-cache’s past year of commit activity
  Distributed KV cache scheduling & offloading libraries

  aiincubating

  aiincubating

  Go

  •

  Apache License 2.0

  •112112 forks•131131 stars•5959 issues•3232 pull requests•Updated Apr 19, 2026Apr 19, 2026

• llm-d.github.io

  Public

  llm-d/llm-d.github.io’s past year of commit activity
  Website for llm-d: This repository builds the website seen at llm-d.ai

  documentationopensourceai+ 1

  documentationopensourceaidocusaurus

  JavaScript

  •

  Apache License 2.0

  •2626 forks•1111 stars•1212 issues•11 pull request•Updated Apr 17, 2026Apr 17, 2026

• llm-d-go-template

  Public template

  llm-d/llm-d-go-template’s past year of commit activity
  Go microservice template for llm-d repos. Use 'Use this template' to create a new Go project with standard CI, linting, Prow, and governance.

  Makefile

  •

  Apache License 2.0

  •33 forks•00 stars•11 issue•11 pull request•Updated Apr 17, 2026Apr 17, 2026

• llm-d-latency-predictor

  Public

  llm-d/llm-d-latency-predictor’s past year of commit activity
  Makefile

  •

  Apache License 2.0

  •00 forks•00 stars•00 issues•77 pull requests•Updated Apr 16, 2026Apr 16, 2026

• llm-d-inference-payload-processor

  Public

  llm-d/llm-d-inference-payload-processor’s past year of commit activity
  Inference payload processor for llm-d

  Makefile

  •

  Apache License 2.0

  •11 fork•11 star•11 issue•66 pull requests•Updated Apr 16, 2026Apr 16, 2026

• llm-d-infra

  Public

  llm-d/llm-d-infra’s past year of commit activity
  repo for CI and infrastructure required to maintain llm-d org member repos

  Shell

  •

  Apache License 2.0

  •55 forks•00 stars•3535 issues•44 pull requests•Updated Apr 16, 2026Apr 16, 2026

• llm-d-python-template

  Public template

  llm-d/llm-d-python-template’s past year of commit activity
  Python project template for llm-d repos. Use 'Use this template' to create a new Python project with standard CI, linting, Prow, and governance.

  Makefile

  •

  Apache License 2.0

  •22 forks•11 star•11 issue•11 pull request•Updated Apr 16, 2026Apr 16, 2026

• llm-d-pd-utils

  Public
  Makefile

  •77 forks•55 stars•1111 issues•55 pull requests•Updated Mar 10, 2026Mar 10, 2026

• .github

  Public

  llm-d/.github’s past year of commit activity
  22 forks•00 stars•11 issue•00 pull requests•Updated Mar 5, 2026Mar 5, 2026

• llm-d-routing-sidecar

  Public archive

  llm-d/llm-d-routing-sidecar’s past year of commit activity
  Incubating P/D sidecar for llm-d

  incubating

  incubating

  Go

  •

  Apache License 2.0

  •2929 forks•1717 stars•00 issues•11 pull request•Updated Nov 13, 2025Nov 13, 2025

• llm-d-deployer

  Public archive
  Helm charts for llm-d

  helmhelm-chartllm-d

  helmhelm-chartllm-d

  Shell

  •

  Apache License 2.0

  •5757 forks•5252 stars•3434 issues•1717 pull requests•Updated Jul 22, 2025Jul 22, 2025

• llm-d-model-service

  Public archive

  llm-d/llm-d-model-service’s past year of commit activity
  Simplified model deployment on llm-d

  incubating

  incubating

  Go

  •

  Apache License 2.0

  •1515 forks•2828 stars•2929 issues•66 pull requests•Updated Jul 2, 2025Jul 2, 2025