Crawly
squirm
Crawly | squirm | |
---|---|---|
2 | 2 | |
840 | 31 | |
1.2% | - | |
6.6 | 4.2 | |
8 days ago | 4 months ago | |
Elixir | Crystal | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Crawly
- Crawly – Elixir web scraping framework
-
Squirm - This was the night of the crawling terror!
I would say that the usage of Squirm is for crawling purposes and it is a close analogue of https://github.com/elixir-crawly/crawly
squirm
What are some alternatives?
Crawler - A high performance web crawler / scraper in Elixir.
scraper - All In One API to easily scrape data from any website, without worrying about captchas and bot detection mecanisms.
scrape - Scrape any website, article or RSS/Atom Feed with ease!
webdriver_pump - Page Object Model library for Crystal. A port (kind of) of Ruby's WatirPump
gun - HTTP/1.1, HTTP/2, Websocket client (and more) for Erlang/OTP.
scrapyteer - Web crawling & scraping framework for Node.js on top of headless Chrome browser
finch - Elixir HTTP client, focused on performance
colly - Elegant Scraper and Crawler Framework for Golang
yuri - Elixir module for easier URI manipulation.
chum - This was the night of the crawling terror! [Moved to: https://github.com/squirm-framework/squirm]
mint - Functional HTTP client for Elixir with support for HTTP/1 and HTTP/2 🌱
anonymous - Anonymous, a high-level web crawling & scraping framework for Crystal.