models · google
Catalogued from llm-stats Open LLM Leaderboard at Quarantine — unverified, pending attestation.
| Method | hf-published-sha256 |
|---|
| Publisher | |
|---|---|
| Origin | United States |
| Licence | Apache-2.0 |
| Parameters | 7,996,156,490 (8B) |
| Native precision | BF16 |
| Pulls recorded here | 5 |
| Downloads reported upstream | 5,634,734 |
| Hardware | Build measured | Decode @ 8K | Memory @ 8K | Decode mode |
|---|---|---|---|---|
| NVIDIA GeForce RTX 5090 32GB | Q4_K_M | 230 tok/s | 8.4 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | Q4_K_M | 210 tok/s | 5.4 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | FP8-Dynamic | 179 tok/s | 24.8 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | fp8 | 179 tok/s | 24.8 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | FP8-Dynamic | 177 tok/s | 85.4 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | fp8 | 177 tok/s | 85.4 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | FP8 | 168 tok/s | 85.4 GB | ordinary |
| NVIDIA RTX 6000 Ada 48GB | Q4_K_M | 162 tok/s | 8.3 GB | ordinary |
Measured by local.ai, not by us: 73 runs, 65 more not listed. Each names its engine pinned by image digest and the exact serve command, in the full record.
Registry record as of 2026-09-26. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.