Crawler

A high performance web crawler / scraper in Elixir. (by fredwu)

Crawler Alternatives

Similar projects and alternatives to Crawler

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Crawler alternative or higher similarity.

Crawler discussion

Log in or Post with

Crawler reviews and mentions

Posts with mentions or reviews of Crawler. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-04-01.
  • Ask HN: Freelancer? Seeking freelancer? (April 2022)
    5 projects | news.ycombinator.com | 1 Apr 2022
    SEEKING WORK | Melbourne, Australia | Remote Preferred

    - Technologies: Elixir, Ruby, React, JS

    - Résumé/CV: https://fredwu.me/cv.pdf

    - Email: ifredwu at gmail dot com

    My name’s Fred Wu, I’m an experienced Elixir and Ruby developer who has worked on multiple commercial projects as well as having released multiple open source Hex packages and Rubygems.

    I work at a fintech startup as CTO, leading a small team. During Covid I've been pumping out around 40 extra hours per week on freelancing work. My day job involves mostly the non-coding part of problem solving so it's a nice mix of pace for me to keep my coding skills sharp during the evenings and on weekends.

    I’ve been using Elixir for half a decade, ruby for over a decade, lead and built multiple commercial B2B & B2C SaaS projects. I’ve always been very hands on, and have worked with multiple tech stacks in the past, including JS/React, PHP, Golang, and most recently Clojure at the startup I’m currently working at.

    - My blog and talks: https://fredwu.me/

    - My Github profile: https://github.com/fredwu

    - My LinkedIn profile: https://www.linkedin.com/in/wufred/

    As you probably noticed I have quite a few projects on Github. Some of the more interesting ones are:

    - Crawler, a high performance web crawler built in Elixir: https://github.com/fredwu/crawler

    - Simple Bayes, a naive bayes machine learning implementation in Elixir: https://github.com/fredwu/simple_bayes

    - OPQ, a simple in-memory queue with worker pooling and rate limiting in Elixir: https://github.com/fredwu/opq

    - And a few years ago when I was heavily involved in the ruby/rails community, I had done an experimental project building a "layer 0" ORM on top of ActiveRecord and Sequel: https://github.com/fredwu/datamappify

    If you think my skills and experience could add value to the project I’d love to chat more. You could reach me at ifredwu at gmail dot com. Thanks!

  • [For Hire] Expert-level Elixir/Ruby freelancer - with established open source projects and decades of experience
    4 projects | /r/forhire | 20 Jan 2022
    Crawler, a high performance web crawler built in Elixir: https://github.com/fredwu/crawler
  • Complete, Production-Ready Phoenix Reference Applications
    28 projects | /r/elixir | 15 Nov 2021
    Crawler
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 14 Jul 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic Crawler repo stats
3
930
6.8
25 days ago

fredwu/crawler is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of Crawler is Elixir.


Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com