Python scrapers

Open-source Python projects categorized as scrapers

Top 5 Python scraper Projects

  • openstates-scrapers

    source for Open States scrapers

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • alltheplaces

    A set of spiders and scrapers to extract location information from places that post their location on the internet.

  • Project mention: Differentiating between hypermarkets and supermarkets. | /r/openstreetmap | 2023-12-09

    Maybe a different approach? https://www.alltheplaces.xyz/ has stores grouped by name

  • scraperx

    Library for scraping websites or apis at any scale

  • sneakpeek

    Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis (by flulemon)

  • twig

    twig.py - a twitter web3 influencer truffle pig used for finding engaged users (by paulpierre)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python scrapers discussion

Log in or Post with

Python scrapers related posts

  • Differentiating between hypermarkets and supermarkets.

    1 project | /r/openstreetmap | 9 Dec 2023
  • Meta, Microsoft and Amazon team up on maps project

    1 project | news.ycombinator.com | 26 Jul 2023
  • A's Stadium Bill Passes Senate

    1 project | /r/vegaslocals | 13 Jun 2023
  • State Assembly moves forward with trio of bills to cut property taxes for the greediest generation (that will be paid for by their grandchildren and great grandchildren)

    1 project | /r/newjersey | 10 Jun 2023
  • Official statement from Lombardo re: A's

    1 project | /r/vegaslocals | 24 May 2023
  • Let the Nevada Legislature Know - Public Money for A's Stadium

    1 project | /r/vegaslocals | 24 May 2023
  • What resources do you use for following the Kansas legislature?

    1 project | /r/kansas | 21 Mar 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 14 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source scraper projects in Python? This list will help you:

Project Stars
1 openstates-scrapers 844
2 alltheplaces 579
3 scraperx 53
4 sneakpeek 37
5 twig 5

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com