Javascript for webcrawling and scraping

This page summarizes the projects mentioned and recommended in the original post on /r/learnjavascript
HTTP HTTP Client JavaScript NodeJS Promise

SurveyJS
Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
Our great sponsors

  • axios

    Promise based HTTP client for the browser and node.js

    • Yep, totally doable with nodejs, you could use a library (like https://www.npmjs.com/package/axios) to send requests to web pages you want to crawl, then extract the needed content from html (https://www.npmjs.com/package/cheerio) and save the results.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts