Web scraping with Python

1. WolfensteinCGA

   1 14 327 2.8 C

   Wolfenstein 3D with a CGA renderer

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. Playwright

   2 447 68,612 10.0 TypeScript

   Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

   

   By definition, Playwright is an open-source framework for web testing and automation developed and maintained by Microsoft.

4. httpx

   3 59 13,592 8.6 Python

   A next generation HTTP client for Python. 🦋

   

   HTTPX is a fully featured HTTP client library for Python 3, including an integrated command-line client while providing both sync and async APIs.

5. scrapy-playwright

   4 14 1,081 7.9 Python

   🎭 Playwright integration for Scrapy

   

   To integrate Playwright with Scrapy, we will use the scrapy-playwright library. Then, we will scrape https://www.mintmobile.com/product/google-pixel-7-pro-bundle/ to demonstrate how to extract data from a website using Playwright and Scrapy.

Suggest a related project