scrapyteer
Crawly
scrapyteer | Crawly | |
---|---|---|
1 | 2 | |
18 | 843 | |
- | 1.5% | |
4.0 | 6.6 | |
2 months ago | 12 days ago | |
TypeScript | Elixir | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
scrapyteer
-
Low-code Node.js web scraping tool
Hi guys, I've created an open-source low-code Node.js web scraping tool on top of the Puppeteer - https://github.com/miroshnikov/scrapyteer. It offers a small set of functions that are combined in pipelines to define a crawling workflow and a shape of output data. Maybe somebody will find it useful.
Crawly
- Crawly – Elixir web scraping framework
-
Squirm - This was the night of the crawling terror!
I would say that the usage of Squirm is for crawling purposes and it is a close analogue of https://github.com/elixir-crawly/crawly
What are some alternatives?
Philia - An easy to use imageboard scraper.
Crawler - A high performance web crawler / scraper in Elixir.
outlook-account-generator - Outlook Account Generator helps you create outlook accounts.
scrape - Scrape any website, article or RSS/Atom Feed with ease!
crawler - Library for Rapid (Web) Crawler and Scraper Development
gun - HTTP/1.1, HTTP/2, Websocket client (and more) for Erlang/OTP.
squirm - This was the night of the crawling terror!
finch - Elixir HTTP client, focused on performance
Dataflow kit - Extract structured data from web sites. Web sites scraping.
yuri - Elixir module for easier URI manipulation.
ayakashi - :zap: Ayakashi.io - The next generation web scraping framework
mint - Functional HTTP client for Elixir with support for HTTP/1 and HTTP/2 🌱