architectures · internlm
Third-generation decoder-only transformer from the Shanghai AI Laboratory InternLM project, using grouped-query attention and rotary position embeddings, with long-context training as a stated design goal. Declared as model_type `internlm3`.
| Publisher | internlm |
|---|---|
| Origin | China |
| Licence | Apache-2.0 |
Registry record as of 2026-08-14. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.