architectures · lgai-exaone
Sparse mixture-of-experts backbone behind LG AI Research's K-EXAONE models: 128 experts with 8 routed per token, grouped-query attention over 64 query heads against 8 key/value heads, and sliding-window attention. Declared as model_type `exaone_moe`.
| Publisher | lgai-exaone |
|---|---|
| Origin | South Korea |
| Licence | Apache-2.0 |
Registry record as of 2026-08-14. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.