Robotstxt Alternatives
Similar projects and alternatives to robotstxt based on common topics and language
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better robotstxt alternative or higher similarity.
robotstxt reviews and mentions
Posts with mentions or reviews of robotstxt.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-06-04.
-
Meet Crusty, Fast Scalable && Polite Broad Web Crawler Built With Rust!
There is https://github.com/Folyd/robotstxt which passes all tests of the google open source robots.txt parser.
Stats
Basic robotstxt repo stats
1
79
0.0
about 3 years ago
Folyd/robotstxt is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of robotstxt is Rust.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com