crawler
diskover-community
| crawler | diskover-community | |
|---|---|---|
| 3 | 15 | |
| 2,472 | 1,399 | |
| 0.7% | 1.1% | |
| 6.8 | 7.7 | |
| about 2 months ago | 8 days ago | |
| PHP | PHP | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
crawler
-
How to Build a Robust Web Scraper with Laravel: and Catch 'Em All
The spatie/crawler package is a powerful tool developed by Spatie, a web development agency known for creating high-quality, open-source packages for the Laravel community. This crawler is designed to simplify the process of building web scrapers and bots in PHP, particularly within the Laravel framework. It provides a flexible and easy-to-use interface to crawl websites and extract needed data efficiently. Click me if you love spatie/crawler, give them a star too, they are the reason that this article exists.
-
Can I use Laravel Dusk to automate downloading an HTML version of a website?
You probably want something like this: https://github.com/spatie/crawler
-
How to setup Wordpress to not crash due to 404 DDoS attack?
Alternatively, write your own basic crawler or adapt an existing package like https://github.com/spatie/crawler.
diskover-community
-
Are there any NAS hosted solutions for in-place full-text search on documents (not document management, not paperless-ngx)?
I’ve tried this before: https://github.com/diskoverdata/diskover-community
-
'google-like' search engine for files on my NAS
Diskover
- disk analyzer
-
File index, search, and sharing from local discs
I think you’re referring to Diskover. I saw it on here and bookmarked it
- Self hosted web page that indexes all data on a given folder with ability to search? [pi]
-
Looking for an app to vizualize disk usage
Never tried it but Diskover Community Edition there is Linuxserver docker image of it.
- Open source software to visualize and manage your unstructured data
What are some alternatives?
RED_HAWK - All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
ElasticSearch PHP - Official PHP client for Elasticsearch.
scrape - Scrape any website, article or RSS/Atom Feed with ease!
Vidhub - Video sharing website (YouTube clone) with PHP
Guzzle - Guzzle, an extensible PHP HTTP client
awesome-web-scraper - A collection of awesome web scaper, crawler.
aws-elixir - AWS clients for Elixir
UrlHum - The modern, privacy-aware URL Shortener built in PHP.
plug_wait1 - Plug adapter for the wait1 protocol
ntfsheurecovery - NT File System (NTFS) recovery tool
gen_retry - Utilities for retrying Elixir functions, with configurable delay and backoff.
Piwigo - Manage your photos with Piwigo, a full featured open source photo gallery application for the web. Star us on Github! More than 200 plugins and themes available. Join us and contribute!