architectures · xai

Grok MoE Architecture

Mixture-of-Experts decoder with grouped query attention and rotary embeddings.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Weight file SHA-256	6d661d2cd4ed4d94a9f4c688eb83a62fd85d59f308399b97e59bb041b86949e6

Re-check this yourself → Source → Full record →

What is recorded

Publisher	xai
Origin	United States
Licence	Apache-2.0
Modality	Text
Pulls recorded here	27,001

Elsewhere in the registry

All architectures → Browse with filters → What will run on my hardware? →

Registry record as of 2026-06-06. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.