optimizers · stanford

Sophia

Second-order clipped optimizer using a light Hessian diagonal estimate. ~2x faster pretraining vs AdamW.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Weight file SHA-256	281cc06f91910e51a3e02c494cb58bcfa39029fb551dc4a532c66027451f08b1

Re-check this yourself → Source → Full record →

What is recorded

Publisher	stanford
Origin	United States
Licence	MIT
Pulls recorded here	13,503

Elsewhere in the registry

All optimizers → Browse with filters → What will run on my hardware? →

Registry record as of 2026-06-06. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.