Pinned Loading

1. ome-projects/ome ome-projects/ome Public

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 451 79

2. lightseekorg/smg lightseekorg/smg Public

   Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat histor…

   Rust 269 78

3. sgl-project/genai-bench sgl-project/genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 298 51

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 28k 6k

5. rlworkgroup/garage rlworkgroup/garage Public

   A toolkit for reproducible reinforcement learning research.

   Python 2.1k 325