SaaSHub helps you find the best software and product alternatives Learn more →
Top 6 PHP Crawler Projects
-
RED_HAWK
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
-
diskover-community
Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch
-
siteone-crawler
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
I recommend to try also https://crawler.siteone.io/ for web copying/cloning.
Here is a real copy of the netlify.com website for demonstration: https://crawler.siteone.io/examples-exports/netlify.com/
Here is a sample analysis of the netlify.com website, which this tool can also provide: https://crawler.siteone.io/html/2024-08-23/forever/x2-vuvb0o...
-
-
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
PHP Crawler discussion
PHP Crawler related posts
-
Show HN: Audit and Clone Any Website in Seconds (Open-Source GUI and CLI)
-
How to Build a Robust Web Scraper with Laravel: and Catch 'Em All
-
I created open-source tool - an AI lead generator.
-
Open-source AI lead generator – better than snov.io
-
Are there any NAS hosted solutions for in-place full-text search on documents (not document management, not paperless-ngx)?
-
How to find customers for software houses? Innovate for free!
-
disk analyzer
-
A note from our sponsor - SaaSHub
www.saashub.com | 15 May 2025
Index
What are some of the best open-source Crawler projects in PHP? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | RED_HAWK | 3,275 |
| 2 | crawler | 2,616 |
| 3 | diskover-community | 1,566 |
| 4 | siteone-crawler | 486 |
| 5 | crawler | 361 |
| 6 | curly | 13 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com