How I met your...Scraper?

This page summarizes the projects mentioned and recommended in the original post on dev.to

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • scraper-template

    This is a scrapper template repo; Stack: NodeJS, Express, Puppeteer and Nodemailer

  • Note: There is available also a template project on GitHub in case it could be useful and save you some time.

  • puppeteer-extra

    💯 Teach puppeteer new tricks through plugins.

  • The page scraped for this post behaves "interesting", sometimes the reCaptcha is ignored, some others appear right after submitting the login, so randomly fails; I opened an issue in puppeteer-extra, an npm lib extension for puppeteer which works hand-to-hand with 2captcha, I'm watching the issue closely, in case of getting a fix for the random issue I'll edit the post.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
  • postman-app-support

    Postman is an API platform for building and using APIs. Postman simplifies each step of the API lifecycle and streamlines collaboration so you can create better APIs—faster.

  • For running this locally Postman is the tool(don't judge me too much, I am used to it... used to Postman I meant, anyway)

  • puppeteer

    Node.js API for Chrome

  • Puppeteer

  • Nodemon.io

    Monitor for any changes in your node.js application and automatically restart the server - perfect for development

  • Nodemon

  • node

    Node.js JavaScript runtime ✨🐢🚀✨

  • NodeJS

  • Express

    Fast, unopinionated, minimalist web framework for node.

  • Express

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts