models · nvidia
Catalogued from local.ai local-inference benchmark index at Quarantine — unverified, pending attestation.
| Method | hf-published-sha256 |
|---|
| Publisher | nvidia |
|---|---|
| Origin | United States |
| Licence | unknown |
| Publisher’s own licence statement | other |
| Parameters | 18,328,194,880 (18.3B) |
| Native precision | U8 |
| Downloads reported upstream | 1,405,475 |
| Hardware | Build measured | Decode @ 8K | Memory @ 8K | Decode mode |
|---|---|---|---|---|
| NVIDIA RTX PRO 6000 Blackwell 96GB | NVFP4 | 298 tok/s | 88.3 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | NVFP4 | 283 tok/s | 27.5 GB | ordinary |
| NVIDIA RTX 6000 Ada 48GB | NVFP4 | 209 tok/s | 42.7 GB | ordinary |
| NVIDIA DGX Spark 128GB | NVFP4 | 55.5 tok/s | 108.3 GB | ordinary |
Measured by local.ai, not by us: 4 runs. Each names its engine pinned by image digest and the exact serve command, in the full record.
Registry record as of 2026-09-01. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.