OpenWebCrawler

This is an open source Python web crawler which is meant to crawl the entire internet starting from a single URL, the goal of this project is to make an efficient, open source, powerful internet-scale web crawler which can be used in any applications and forked in any way as long as the forked project is also open source. Enjoy! (by BeamoINT)

OpenWebCrawler Alternatives

Similar projects and alternatives to OpenWebCrawler based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better OpenWebCrawler alternative or higher similarity.

OpenWebCrawler reviews and mentions

Posts with mentions or reviews of OpenWebCrawler. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic OpenWebCrawler repo stats
1
1
10.0
9 months ago

BeamoINT/OpenWebCrawler is an open source project licensed under GNU General Public License v3.0 only which is an OSI approved license.

The primary programming language of OpenWebCrawler is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com