Popular repositories Loading

1. loop-convert loop-convert Public

   Testing Clang AST manipulation techniques

   C++ 1

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

3. torchair torchair Public

   Forked from Ascend/torchair

   Python

4. pytorch pytorch Public

   Forked from Ascend/pytorch

   Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. bench360 bench360 Public

   Forked from slinusc/bench360

   Bench360 is a modular benchmarking suite for local LLM deployments. It offers a full-stack, extensible pipeline to evaluate the latency, throughput, quality, and cost of LLM inference on consumer a…

   Python