models · hcompany
Catalogued from local.ai local-inference benchmark index at Quarantine — unverified, pending attestation.
| Method | hf-published-sha256 |
|---|
| Publisher | hcompany |
|---|---|
| Origin | Not recorded. The harvest wrote its own source name into this field, which tells us nothing about jurisdiction. |
| Licence | Apache-2.0 |
| Parameters | 35,107,181,936 (35.1B) |
| Native precision | BF16 |
| Downloads reported upstream | 45,497 |
| Hardware | Build measured | Decode @ 8K | Memory @ 8K | Decode mode |
|---|---|---|---|---|
| NVIDIA RTX PRO 6000 Blackwell 96GB | NVFP4 | 279 tok/s | 90.6 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | q4_k_m | 271 tok/s | 22.1 GB | ordinary |
| NVIDIA RTX PRO 6000 Blackwell 96GB | q4_k_m | 263 tok/s | 27.4 GB | ordinary |
| NVIDIA GeForce RTX 5090 32GB | NVFP4 | 231 tok/s | 30.8 GB | ordinary |
| NVIDIA RTX 6000 Ada 48GB | NVFP4 | 192 tok/s | 45.8 GB | ordinary |
| NVIDIA RTX 6000 Ada 48GB | q4_k_m | 189 tok/s | 26.5 GB | ordinary |
| MacBook Pro M5 Max 128GB · 40-core GPU | q4_k_m | 114 tok/s | 27.2 GB | ordinary |
| Mac Studio M3 Ultra 96GB · 80-core GPU | q4_k_m | 94.8 tok/s | 27.2 GB | ordinary |
Measured by local.ai, not by us: 17 runs, 9 more not listed. Each names its engine pinned by image digest and the exact serve command, in the full record.
Registry record as of 2026-09-26. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.