Pinned Loading

1. vllm-project/speculators vllm-project/speculators Public

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python 322 61

2. vllm-project/llm-compressor vllm-project/llm-compressor Public

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python 3k 462

3. vllm-project/compressed-tensors vllm-project/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 268 72

4. mlframework mlframework Public

   A simple ml framework written in Rust

   Rust

5. AI_for_TSP AI_for_TSP Public

   Winning solution to the AI for TSP Competition: Track 2

   Python 4

6. savepath savepath Public

   A Command Line Tool to simplify file operations

   Rust 2