Ruby Crawler

Open-source Ruby projects categorized as Crawler
Edit details
Topics: Scraper Ruby Web Crawling Scrapy kimurai
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 6 Ruby Crawler Projects

  • arachni

    Web Application Security Scanner Framework

    • Project mention: Self-Host Vulnerability Scanner | /r/selfhosted | 2023-07-09

  • Wombat

    Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • kimuraframework

    Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites

  • spidr

    A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use. (by postmodern)

  • tanakai

    Tanakai is a modern web scraping framework written in Ruby. A fork of Kimurai.

    • Project mention: Tanakai: Modern web scraping framework written in Ruby | news.ycombinator.com | 2023-10-25

  • snapcrawl

    Crawl a website and take screenshots

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Ruby Crawler related posts

Index

What are some of the best open-source Crawler projects in Ruby? This list will help you:

Project Stars
1 arachni 3,645
2 Wombat 1,303
3 kimuraframework 999
4 spidr 792
5 tanakai 260
6 snapcrawl 54

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com