A high-throughput and memory-efficient inference and serving engine for LLMs

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

QualityScaler - image/video AI upscaler app

Stable Diffusion web UI

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Build AI agents for your PC

AMD-SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution

Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3

OpenCL integration for Python, plus shiny features

⚡️ Get notified as soon as your next CPU, GPU, or game console is in stock

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU performance.

RealScaler - image/video AI upscaler app (Real-ESRGAN)

Nabla: High-Performance Scientific Computing

Fully Open Language Models with Stellar Performance

FluidFrames | video AI frame-generation app

[DEPRECATED] Moved to ROCm/rocm-libraries repo

No-code CLI designed for accelerating ONNX workflows

web UI for GPU-accelerated ONNX pipelines like Stable Diffusion, even on Windows and AMD

AMD Strix Halo local LLM guide: setup for Ryzen AI MAX+ 395 / Radeon 8060S, Ollama, llama.cpp Vulkan/RADV, ROCm, raw evidence, direct 100 t/s 30B Qwen, 140 t/s CHADROCK MTP, 120B GGUF.

NiceScaler - image/video deeplearning upscaler (OpenCV)