Top 4 crawling-framework Open-Source Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
sneakpeek
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis (by flulemon)
Hi guys, I've created an open-source low-code Node.js web scraping tool on top of the Puppeteer - https://github.com/miroshnikov/scrapyteer. It offers a small set of functions that are combined in pipelines to define a crawling workflow and a shape of output data. Maybe somebody will find it useful.
crawling-framework related posts
Index
What are some of the best open-source crawling-framework projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | awesome-web-scraping | 6,308 |
| 2 | custom-crawler | 57 |
| 3 | sneakpeek | 36 |
| 4 | scrapyteer | 16 |
Sponsored