Unfragile

Verified record · from the answer index

Protego

librarytested · static-verifiedscore 93/100signed passport ✓published 51d ago · verified 2026-11-0710,433,414 monthly downloads

Pure-Python robots.txt parser with support for modern conventions

Declared tools (4)

parserreprobotsrobots.txt

lib:pypi:protego · published by scrapy · source repository