Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 85k 18.8k

2. vllm-project/router vllm-project/router Public

   A high-performance and light-weight router for vLLM large scale deployment

   Rust 288 99

3. SemiAnalysisAI/InferenceX SemiAnalysisAI/InferenceX Public

   Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3

   Python 1.2k 210

4. dotfiles dotfiles Public

   Use at your own risk

   Shell