Playwright Scraping infinite loading & pagination

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • playwright-scraping

    Playwright Scraping infinite loading & pagination

    In this post, we'll explore how to harness the power of Playwright for web scraping using JavaScript, you can find the full code on GitHub repository. In our scenario will try to extract public products from an e-commerce website, note that the scraping is not explicitly prohibit in its terms of service, and in order to avoid a lot of requests that could impact the server resources will try to extract only the first three pages of products (just for learning purposes). Detail the steps involved in scraping process:

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • Playwright

    Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

    Playwright is a powerful tool developed by Microsoft, it allows developers to write reliable end-to-end tests and perform browser automation tasks with ease. What sets Playwright apart is its ability to work seamlessly across multiple browsers (Chrome, Firefox, and WebKit), it provides a consistent and efficient way to interact with web pages, extract data, and automate repetitive tasks. Moreover, it supports various programming languages such as Node.js, Python, Java, and .NET, that’s making it a versatile choice for web scraping projects. Whether you're scraping public data for analysis, building a web crawler, or automating manual workflows, Playwright has you covered.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Efficient Autotesting with Qase: Playwright and GitLab CI Integration

    1 project | dev.to | 15 Jul 2024
  • Episode 24/26: TinyConf, ng-Belgrade, Why always upgrade?

    1 project | dev.to | 3 Jul 2024
  • Automation testing with Playwright

    1 project | dev.to | 27 Jun 2024
  • Playwright – A Framework for Web Testing and Automation

    1 project | news.ycombinator.com | 31 May 2024
  • Playwright VS Code Extension, projects and global setup

    2 projects | dev.to | 21 May 2024

Did you konow that TypeScript is
the 2nd most popular programming language
based on number of metions?