Top 10 JavaScript Webscraping Projects

• browser-fingerprinting

  8 3,830 1.0 JavaScript

  Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Project mention: A site that tracks the price of a Big Mac in every US McDonald's | news.ycombinator.com | 2024-01-13

Yes, there is a lot written about it. Here is one link I have saved:

https://github.com/niespodd/browser-fingerprinting

• clicknium-docs

  8 150 3.1 JavaScript

  A next-generation GUI automation framework for Web and Desktop Application Testing and Automation.

  

• SurveyJS

  surveyjs.io sponsored

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• css-selector-tool

  1 104 7.7 JavaScript

  A low-code data extractor for websites with built in proxy and parsing capabilities. Great for testing and debugging css selectors

Project mention: Show HN: A tool to quickly extract data from websites | news.ycombinator.com | 2024-03-06

• google-search-results-nodejs

  57 72 2.7 JavaScript

  SerpApi client library for Node.js. Previously: Google Search Results Node.js.

  

Project mention: Google Search Parameters (2024 Guide) | dev.to | 2024-04-22

The Google Search URL parameters are important to understand whether you are maximizing the conversion rate in your ad groups and optimizing your cost per click(CPC) rates in Google Analytics for your ad campaigns, improving your SEO(Search Engine Optimization) metrics for your e-commerce business, or collecting data for your social media project. Using custom parameters for your search will affect the Search Engine Result Page (SERP) data significantly in your favor. SerpApi unlocks the power of SERP data to you with minimal effort, the fastest response times, and in the most complete form.

• Oxylabs

  0 38 5.3 JavaScript

  Web scraping, data parsing and automation tutorials.

  

• hotels-scraper-js

  1 13 4.2 JavaScript

  Scrape Airbnb, Booking, Hotels.com from a single JavaScript module. ❗No longer maintained.

• devto-stats-card

  1 9 3.8 JavaScript

  Display your Dev.to blog followers count and total post views count in a card image.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• CodexDrake

  0 7 6.1 JavaScript

  An open source, privacy-first, self-hosting capable and blazing fast search engine written in JavaScript. Browse anonymously and safely without the need to pay third-party APIs. 👀

• File-Engine

  1 4 5.1 JavaScript

Project mention: A web scraper to extract files from google | /r/coolgithubprojects | 2023-08-04

• Gym-Booking-Discord-Bot

  2 4 0.0 JavaScript

  Book Me Bot™ | www.bookmebot.com | A Facebook + Discord Chatbot that guarantees you a workout booking time at your local Fit4Less, LA Fitness, or CrunchFitness gym!

JavaScript Webscraping related posts

• Cold Email Marketing with Open-Source Email Extractor
  2 projects | dev.to | 7 Jul 2023
• How busy is it at Fit4Less on Edinburgh nowadays?
  1 project | /r/Guelph | 22 Mar 2021
• New auto booking tool for Fit4less users :)
  1 project | /r/GYM | 22 Mar 2021
• Do I really need to customize a scaper for every input page URL?
  2 projects | /r/webscraping | 4 Jan 2021

Index

Sponsored

The modern identity platform for B2B SaaS

The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

workos.com

Do not miss the trending JavaScript projects with our weekly report!