Skip to content
@devicemark

devicemark

Reproducible on-device LLM benchmarks — leaderboard for iPhone

devicemark

Reproducible on-device LLM benchmarks — which models actually run on an iPhone, how smart they stay, and how fast they decode. Measurement, not voting.

Maintained by Daisuke Majima (MLBoy) — who also ports the Core AI model zoo most aimodel rows come from (disclosed; every gate and recipe is public) and wrote the textbook The Art of Core AI (JA).

Popular repositories Loading

  1. devicemark.github.io devicemark.github.io Public

    On-device LLM leaderboard: intelligence × decode speed measured on an iPhone, with Apple's built-in model as the baseline. Want a model on it? Open an issue with its Hugging Face link.

    HTML 3

  2. .github .github Public

Repositories

Showing 2 of 2 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…