tools · vllm-project

llm-compressor

Compression toolchain that applies quantization and sparsification recipes (GPTQ, AWQ, SmoothQuant, weight and activation schemes) and writes checkpoints in the layout the vLLM runtime loads directly, so the compression step and the serving step agree on format rather than needing a conversion between them.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Re-check this yourself → Source → Full record →

What is recorded

Publisher	vllm-project
Origin	United States
Licence	Apache-2.0

Elsewhere in the registry

All tools → Browse with filters → What will run on my hardware? →

Registry record as of 2026-08-14. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.