Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 85k 18.7k

2. guoqingbao/xinfer guoqingbao/xinfer Public

   Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

   Rust 275 38

3. kernel_benchmarks kernel_benchmarks Public

   Python

4. BusDB BusDB Public

   Rust

5. HlsParser HlsParser Public

   Parser for hls playlist files (*.m3u8)

   Go