Pinned Loading

1. ome-projects/ome ome-projects/ome Public

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 472 83

2. lightseekorg/smg lightseekorg/smg Public

   Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

   Rust 367 110

3. sgl-project/genai-bench sgl-project/genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 307 51

4. rlworkgroup/garage rlworkgroup/garage Public

   A toolkit for reproducible reinforcement learning research.

   Python 2.1k 326