tools · openai

tiktoken

Fast Rust-backed BPE tokenizer for OpenAI models. Reversible encoding with very low latency.

Verify

What this registry has checked

Quarantine. We hold the publisher’s own published hash for these weights and have recorded it against this entry. We have not downloaded and hashed the weights ourselves, so the hash is the publisher’s claim, not our measurement.

Weight file SHA-256	b6bef96e5a3ad28e5c4e7460879edb7211cfd6fa2e449c19464a065227f5ff03

Re-check this yourself → Source → Full record →

What is recorded

Publisher	openai
Origin	United States
Licence	MIT
Pulls recorded here	121,001

Elsewhere in the registry

All tools → Browse with filters → What will run on my hardware? →

Registry record as of 2026-06-06. Identity, licence and parameter count are properties of a release and do not move; tier can, and the verify link above re-checks it against the live registry rather than this page.