tanakai
vessel
tanakai | vessel | |
---|---|---|
3 | 2 | |
263 | 606 | |
- | 0.7% | |
6.1 | 5.6 | |
5 months ago | 5 months ago | |
Ruby | Ruby | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tanakai
- Tanakai: Modern web scraping framework written in Ruby
-
Tanakai 1.6.0 (web scraping gem) has been released with support to Ruby 3+
Tanakai intends to be a maintained fork of Kimurai, a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites.
-
Long life to Tanakai, a fork of Kimurai (a modern web scraping framework written in Ruby)
Long life to Tanakai, it has already got support to Chrome CDP through Apparition and Cuprite.
vessel
-
Learning Ruby Basics
What are you using for automation? There's a relatively new gem that I heard good things of, vessel: https://github.com/rubycdp/vessel . It uses ferrum under the hood, a set of Ruby bindings to Chrome/Chromium (https://github.com/rubycdp/ferrum).
-
Ruby web scraping gem that can handle JS?
I've used https://github.com/rubycdp/ferrum as driver for automated testing with capybara for which it works great. It recommends https://github.com/rubycdp/vessel as higher level abstraction for web scraping.
What are some alternatives?
Wombat - Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Kimurai
cuprite - Headless Chrome/Chromium driver for Capybara
kimuraframework - Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites
pismo - Extracts machine-readable metadata and content from Web pages
apparition - Capybara driver for Chrome using CDP
Mechanize - Mechanize is a ruby library that makes automated web interaction easy.
instabot.rb - An instagram bot works without instagram api, only needs your username and password. written in ruby
Upton - A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
The Hawker Ruby gem - The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL