Web scraping library

This page summarizes the projects mentioned and recommended in the original post on /r/haskell

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • scalpel

    A high level web scraping library for Haskell. (by fimad)

    This may be of interest: https://github.com/fimad/scalpel

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • marlo

    a search engine for humans

    Check out my library lasercutter. It's good at scraping data out of trees. As-is, it's probably too low level for what you want, but there is an HTML tree parser and then set of combinators which I'd be happy to turn into a library if it were desired.

  • webdriver

    A Haskell client for the Selenium WebDriver protocol.

    Here's a slightly different solution which could work: this Haskell library for Selenium works fine - I've used it. You could navigate to the page using Selenium and whatever supported browser you like (Chrome, Firefox, Edge etc.) and then evaluate a Javascript snippet on the page, via the Selenium API, to retrieve the value you want. One potential advantage of this is it'll work on highly Javascript-dependent pages.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • How to scrape Hacker News to create a daily email summary

    1 project | dev.to | 23 Oct 2024
  • Ng-News 24/41: effect()'s Future, Angular 💔 Playwright CT

    6 projects | dev.to | 16 Oct 2024
  • Web scraping- Interesting!

    1 project | dev.to | 5 Sep 2024
  • Scrape the web with puppeteer!

    1 project | dev.to | 28 Aug 2024
  • Day21 of 100DaysOfCode

    1 project | dev.to | 22 Aug 2024

Did you konow that Haskell is
the 22nd most popular programming language
based on number of metions?