vessel
Mechanize
Our great sponsors
vessel | Mechanize | |
---|---|---|
2 | 1 | |
603 | 4,354 | |
0.8% | 0.3% | |
5.6 | 7.2 | |
4 months ago | 9 days ago | |
Ruby | Ruby | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vessel
-
Learning Ruby Basics
What are you using for automation? There's a relatively new gem that I heard good things of, vessel: https://github.com/rubycdp/vessel . It uses ferrum under the hood, a set of Ruby bindings to Chrome/Chromium (https://github.com/rubycdp/ferrum).
-
Ruby web scraping gem that can handle JS?
I've used https://github.com/rubycdp/ferrum as driver for automated testing with capybara for which it works great. It recommends https://github.com/rubycdp/vessel as higher level abstraction for web scraping.
Mechanize
-
Ruby Web Scraping
mechanize does all this without having to write so much yourself
What are some alternatives?
Kimurai
Wombat - Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
pismo - Extracts machine-readable metadata and content from Web pages
anemone - Anemone web-spider framework
Upton - A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
MetaInspector - Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
The Hawker Ruby gem - The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL
Supplejack API - Supplejack API Mountable Engine
LinkThumbnailer - Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.