Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 93.1k 22.9k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 36.7k 9.3k

3. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 104k 31.1k

4. onnx/onnx onnx/onnx Public

   Open standard for machine learning interoperability

   Python 21.6k 4k

5. microsoft/onnxruntime microsoft/onnxruntime Public

   ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

   C++ 22k 4.3k

6. microsoft/onnxscript microsoft/onnxscript Public

   ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.

   Python 456 138