Top 7 Python python-scraper Projects

python-scraper

• Add a project

1. SeleniumBase

   1 22 12,780 9.7 Python

   📊 Python's all-in-one framework for web crawling, scraping, and testing. Supports pytest. CDP Mode provides stealth. Includes many tools.

   

   Project mention: Scraping German Rental Price Data – Part I: Whole Lotta Captchas | news.ycombinator.com | 2025-07-29

   Not yet! But it's on my list to try out next after giving SeleniumBase[1] a chance.

   [1] https://github.com/seleniumbase/SeleniumBase

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. botasaurus

   2 8 4,797 9.5 Python

   The All in One Framework to Build Undefeatable Scrapers

   

4. scrapfly-scrapers

   3 6 1,003 9.4 Python

   Scalable Python web scraping scripts for +40 popular domains

   

   Project mention: 5 Best Free Web Scraping Tools in 2026 | dev.to | 2026-04-30

   Instead of trying to bypass blocks manually, you send a request to their API and let it deal with proxies, headers, browser rendering, and fingerprinting. Scrapfly solves this by managing the infrastructure for you.

5. Reddit_Scrapper

   4 1 188 7.7 Python

   Scrape Reddit for marketing pain points using GPT — built to fuel Cronlytic's growth. (by Mohamedsaleh14)

   

   Project mention: Show HN: Open-source AI tool for Reddit lead generation | news.ycombinator.com | 2025-06-21

6. tls-requests

   5 1 154 8.0 Python

   TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

   

7. weheartpy

   6 2 4 7.3 Python

   A fast, reliable API wrapper for weheartit.com

   

8. youtube-scrapy-scraper

   7 1 3 2.3 Python

   Professional YouTube data scraper built with Scrapy framework. Extract video search results, channel analytics, subscriber counts, view metrics, and trending content. Features anti-bot protection, proxy rotation, CSV/JSON export, and comprehensive data validation. Perfect for content research, competitor analysis, and YouTube API alternatives.

   

   Project mention: Building a YouTube Scraper with Scrapy: A Developer's Journey | dev.to | 2025-07-10

   The complete code is available on GitHub: youtube-scrapy-scraper

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!