Verified record · from the answer index
tokenizers
libraryofficialtested · static-verifiedscore 97/100signed passport ✓published 98d ago · verified 2026-08-01214,056,212 monthly downloads
Declared tools (6)
NLPtokenizerBPEtransformerdeeplearning
lib:pypi:tokenizers · published by huggingface · source repository