optimizers · pytorch

RAdam

Rectified Adam with automatic variance warmup; stable training without LR warmup.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Weight file SHA-256	7ee4ea5561d61e637a0fdb00cdb836946c6038762b5b1fddb24e6c4c9a81d71b

Re-check this yourself → Source → Full record →

What is recorded

Publisher	pytorch
Origin	United States
Licence	MIT
Pulls recorded here	37,002

Elsewhere in the registry

All optimizers → Browse with filters → What will run on my hardware? →

Registry record as of 2026-06-06. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.