models · google
Catalogued from llm-stats Open LLM Leaderboard at Quarantine — unverified, pending attestation.
| Method | hf-published-sha256 |
|---|
| Publisher | |
|---|---|
| Origin | United States |
| Licence | Apache-2.0 |
| Parameters | 5,123,178,051 (5.12B) |
| Native precision | BF16 |
| Pulls recorded here | 6 |
| Downloads reported upstream | 2,952,135 |
| Hardware | Build measured | Decode @ 8K | Memory @ 8K | Decode mode |
|---|---|---|---|---|
| NVIDIA GeForce RTX 5090 32GB | UD-Q4_K_XL | 338 tok/s | 4.3 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | UD-Q4_K_XL | 301 tok/s | 3.4 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | UD-Q8_K_XL | 282 tok/s | 5.5 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | FP8-Dynamic | 263 tok/s | 25.5 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | fp8 | 263 tok/s | 25.5 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | UD-Q8_K_XL | 253 tok/s | 5.5 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | FP8-Dynamic | 249 tok/s | 85.7 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | fp8 | 249 tok/s | 85.7 GB | ordinary |
Measured by local.ai, not by us: 84 runs, 76 more not listed. Each names its engine pinned by image digest and the exact serve command, in the full record.
Registry record as of 2026-09-26. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.