Python scraping-websites

Open-source Python projects categorized as scraping-websites

Top 14 Python scraping-website Projects

  • cloudflare-scrape

    A Python module to bypass Cloudflare's anti-bot page.

  • Edu-Mail-Generator

    Generate Free Edu Mail(s) within minutes

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • google-maps-scraper

    👋 HOLA 👋 HOLA 👋 HOLA ! ENJOY OUR GOOGLE MAPS SCRAPER 🚀 TO EFFORTLESSLY EXTRACT DATA SUCH AS NAMES, ADDRESSES, PHONE NUMBERS, REVIEWS, WEBSITES, AND RATINGS FROM GOOGLE MAPS WITH EASE! 🤖

  • Project mention: I create a google maps scraper, let me know your thoughts | /r/webscraping | 2023-07-06

    My scrapers runs at 120 Listing per 10 Minutes. So yours is quite Fast. You can see my scraper at https://github.com/omkarcloud/google-maps-scraper. It is quite popular with 95 Stars.

  • sarenka

    OSINT tool - gets data from services like shodan, censys etc. in one app

  • ebayScraper

    Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel

  • SpyScrap

    CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.

  • zippyshare-scraper

    A module to get direct downloadable links from zippyshare download page.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • outscraper-python

    The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from your code.

  • Project mention: outscraper-python VS google-maps-scraper - a user suggested alternative | libhunt.com/r/outscraper-python | 2023-05-14
  • TeslaServiceManualScraper

    This script will download the Tesla Service Manual onto a local doc folder for offline access.

  • proxy_web_crawler

    Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords

  • clicknium-samples

    Clicknium Python automation Samples

  • FirstCyclingAPI

    An unofficial Python API wrapper for firstcycling.com

  • document-dl

    Command line program to download documents from web portals

  • Flipkart-website-scrape

    Scrape Flipkart website using BeautifulSoup, requests and store data in CSV file and MySql

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python scraping-websites related posts

Index

What are some of the best open-source scraping-website projects in Python? This list will help you:

Project Stars
1 cloudflare-scrape 3,291
2 Edu-Mail-Generator 788
3 google-maps-scraper 714
4 sarenka 614
5 ebayScraper 178
6 SpyScrap 142
7 zippyshare-scraper 108
8 outscraper-python 61
9 TeslaServiceManualScraper 61
10 proxy_web_crawler 41
11 clicknium-samples 24
12 FirstCyclingAPI 22
13 document-dl 20
14 Flipkart-website-scrape 1

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com