Verified record · from the answer index
tokenizers
libraryofficialtested · static-verifiedscore 100/100signed passport ✓published 25d ago · verified 2026-10-24166,389,324 monthly downloads
Declared tools (6)
NLPtokenizerBPEtransformerdeeplearning
lib:pypi:tokenizers · published by huggingface · source repository