How do I build an app which scrapes data of a website in the background and shows the scraped data back to the user in the same web app/chrome extension?

This page summarizes the projects mentioned and recommended in the original post on /r/webscraping

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • wappalyzer

    Discontinued Identify technology on websites.

  • So let suppose I want to build a technology profiling/intelligence tool which is basically an extension which taking current website URL as input then passing this URL to an API which will go to the https://builtwith.com/ then get the data and at last show it to the user on the app/extension.(at this moment you could ask me, why don't I use APIs provided by wappalyzer/buitwith, etc itself from them but this is purely educational experiment where I want to try out this)

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts