Unfragile

Verified record · from the answer index

tiktoken

librarytested · static-verifiedscore 65/100signed passport ✓published 78d ago · verified 2026-10-24179,033,638 monthly downloads

tiktoken is a fast BPE tokeniser for use with OpenAI's models

lib:pypi:tiktoken