optimizers · eleutherai

GaLore

Gradient Low-Rank Projection reduces full-rank training memory by 65% with no accuracy loss.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Weight file SHA-256	000bf34c8989131006719339e407172d99ef4b5ca194bb95cf980bcca701e763

Re-check this yourself → Source → Full record →

What is recorded

Publisher	eleutherai
Origin	United States
Licence	MIT
Pulls recorded here	16,002

Elsewhere in the registry

All optimizers → Browse with filters → What will run on my hardware? →

Registry record as of 2026-06-06. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.