Local AI, measured on hardware you can buy

Every number comes with the machine it ran on, the settings that failed, and the date it was checked.

Measured runs in the database
73
Experiment records
11
Hardware configurations
1
Most recent verification
Sep 9, 2026

Latest measurements

All benchmark articles

No measured article has been published yet. The first experiment is in progress; when it lands it appears here, and the runs behind it go into the database below.

Not measured here

These report what other people published — a model card, a release note, an incident report. Nothing in them was run on hardware in this lab. Each one says so at the top, and each one names the measurement that would settle it.

Where the measurements live

Both clusters run on the same two machines, which is what makes the CUDA versus Apple Silicon comparisons worth anything: the model, the quantization and the context length are held fixed across platforms.

How to read a page here

Directly tested
Run on the hardware named in the test environment block on that page.
Official source
Taken from vendor or project documentation, linked at the point it is used.
Inferred
Derived from measurements taken on a different configuration, and marked as such.
Not tested
Reported by others and repeated without reproduction here.
Stale
Last verified more than 90 days ago. Stale records stay visible rather than being quietly deleted, because knowing a number is old is more useful than not finding it at all.

The rules behind those labels are in the editorial policy, and the way experiments are run and recorded is in the methodology.