Robots-txt Alternatives
Similar projects and alternatives to robots-txt
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
PHP Markdown
Parser for Markdown and Markdown Extra derived from the original Markdown.pl by John Gruber.
-
CommonMark PHP
Highly-extensible PHP Markdown parser which fully supports the CommonMark and GFM specs.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
robots-txt reviews and mentions
We haven't tracked posts mentioning robots-txt yet.
Tracking mentions began in Dec 2020.
Stats
crwlrsoft/robots-txt is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of robots-txt is PHP.