Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 86.5k 19.5k

2. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 7.5k 1.3k

3. llm-d/llm-d-kv-cache llm-d/llm-d-kv-cache Public

   Distributed KV cache scheduling & offloading libraries

   Go 162 148

4. ornladios/ADIOS2 ornladios/ADIOS2 Public

   Next generation of ADIOS developed in the Exascale Computing Program

   C++ 323 152