Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Crawler Alternatives
Similar projects and alternatives to crawler
-
RED_HAWK
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
diskover-community
Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch
-
gen_retry
Discontinued Utilities for retrying Elixir functions, with configurable delay and backoff.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
web_socket
An exploration into a stand-alone library for Plug applications to easily adopt WebSockets.
crawler reviews and mentions
-
How to Build a Robust Web Scraper with Laravel: and Catch 'Em All
The spatie/crawler package is a powerful tool developed by Spatie, a web development agency known for creating high-quality, open-source packages for the Laravel community. This crawler is designed to simplify the process of building web scrapers and bots in PHP, particularly within the Laravel framework. It provides a flexible and easy-to-use interface to crawl websites and extract needed data efficiently. Click me if you love spatie/crawler, give them a star too, they are the reason that this article exists.
-
Can I use Laravel Dusk to automate downloading an HTML version of a website?
You probably want something like this: https://github.com/spatie/crawler
-
How to setup Wordpress to not crash due to 404 DDoS attack?
Alternatively, write your own basic crawler or adapt an existing package like https://github.com/spatie/crawler.
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Apr 2024
Stats
spatie/crawler is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of crawler is PHP.
Sponsored