Pinned Loading

1. Searches Searches Public

   Python Implementation of uninformed searches

   Python

2. DataStructuresForPython DataStructuresForPython Public

   Neatly written data structures in Python! With Tests! Feel feel to use this as-is, or as a base for your own implementation

   Python 2

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 74.9k 15k

4. vllm-project/llm-compressor vllm-project/llm-compressor Public

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python 3k 462

5. vllm-project/compressed-tensors vllm-project/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 268 72

6. vllm-project/speculators vllm-project/speculators Public

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python 322 61