Popular repositories Loading

1. azure-rest-api-specs azure-rest-api-specs Public

   Forked from Azure/azure-rest-api-specs

   The source for REST API specifications for Microsoft Azure.

2. llgtrt llgtrt Public

   Forked from guidance-ai/llgtrt

   TensorRT-LLM server with Structured Outputs (JSON) built with Rust

   Rust

3. MaaS-LLGTRT MaaS-LLGTRT Public

4. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

   C++

5. ucxx ucxx Public

   Forked from GuanLuo/ucxx

   C++

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python