datasets · idc-benchmarks

MMLU

57-subject multiple-choice exam spanning STEM, humanities, law — primary capability benchmark.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Weight file SHA-256	e3d7b3cca46adbf8c13b8d2ec599fc1ef530214eae9438855bb104c01df2fcdf

Re-check this yourself → Source → Full record →

What is recorded

Publisher	idc-benchmarks
Origin	United States
Licence	MIT
Modality	Text
Pulls recorded here	140,000

Elsewhere in the registry

All datasets → Browse with filters → What will run on my hardware? →

Registry record as of 2026-06-06. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.