MLCommons (@MLCommons) / X

Pinned

MLPerf Endpoints v0.7 is live - a foundation release for AI inference benchmarking. Initial results from Coreweave, Google, Intel, KRAI, and NVIDIA. Four principles: Current, Comprehensive, Comparable, Commentary. Blog: mlcommons.org/2026/07/mlperf…

MLCommons

@MLCommons

Jul 22

Benchmark a brain tumor AI model on real patient MRI data. No data leaves the hospital. No model weights exposed. That's MedPerf + @googlecloud Confidential Space, demonstrated live at #GoogleCloudNext 2026. mlcommons.org/2026/06/medper…

MLCommons

@MLCommons

Jul 14

There's an AI Reliability Map. Most of it is still empty. Benchmarking clusters in a few cells. Enterprise AI readiness needs the full grid. AIRR is mapping what others skip: mlcommons.org/2026/04/airr-m…

MLCommons

@MLCommons

Jul 9

MLCommons is introducing an Edge Agentic Inference benchmark for MLPerf Inference v6.1. Single accelerator. One user. Multi-turn tool-calling. Hard 32K context wall. Model: Qwen3.6-27B Q4_K_M Accuracy gate: BFCL v4 Deadline: July 31, 2026 Read more: mlcommons.org/2026/07/mlperf…

MLCommons

@MLCommons

Jul 8

MLPerf Inference now measures multi-turn agents. 990 trajectories, Kimi K2.6 + Qwen3.6-35B-A3B, Pareto-curve performance, three-level accuracy. Built on MLPerf Endpoints. mlcommons.org/2026/07/agenti… MLPerf #AgenticAI #LLM #Inference #Kimi #Qwen #MLCommons