Unfragile

Verified record · from the answer index

spatie/robots-txt

librarytested · static-verifiedscore 18/100signed passport ✓

Determine if a page may be crawled from robots.txt and robots meta tags

lib:packagist:spatie/robots-txt