Python webscraper

Open-source Python projects categorized as webscraper | Edit details

Top 7 Python webscraper Projects

  • rightmove_webscraper.py

    Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

  • Stocker

    Financial Web Scraper & Sentiment Classifier (by dwallach1)

    Project mention: I made a bot that analyzes sentiment on /r/wallstreetbets, and you can use it too. | reddit.com/r/algotradingcrypto | 2021-08-21

    dwallach1/Stocker: Financial Web Scraper & Sentiment Classifier (github.com)

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • CoWin-Vaccine-Notifier

    Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.

  • scraperx

    Library for scraping websites or apis at any scale

    Project mention: Looking for help/advice with scraping a website for download links | reddit.com/r/DataHoarder | 2021-07-13

    Slight plug, but I made an example scraper using a scraping framework I made called ScraperX - https://github.com/xtream1101/scraperx

  • SearchifyX

    Stealthy answer searcher

    Project mention: is there anything else i can do to complete my edgenuity faster? | reddit.com/r/edgenuity | 2022-04-12
  • raspberry-pi-stock-checker

    A configurable python webscraper that checks raspberry pi stocks from verified sellers

    Project mention: I made a Raspberry Pi Stock Checker | reddit.com/r/Python | 2022-02-05

    I been trying to get a raspberry pi 4 for the last 6 months and they are always out of stock due to the global chip shortage. So I made a python webscraper that does the job for me. Simple request + beautiful soup. Check it out on github: https://github.com/louie-cai/raspberry-pi-stock-checker. Contributions are very welcome.

  • poolbooru_gelscraper

    a simple python script for scraping images off gelbooru pools.

    Project mention: Damnit did it again | reddit.com/r/ProgrammerHumor | 2022-03-12

    I have A Gelbooru pool image scraper on GitHub if you're interested.

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-04-12.

Python webscraper related posts

Index

What are some of the best open-source webscraper projects in Python? This list will help you:

Project Stars
1 rightmove_webscraper.py 170
2 Stocker 113
3 CoWin-Vaccine-Notifier 100
4 scraperx 46
5 SearchifyX 18
6 raspberry-pi-stock-checker 11
7 poolbooru_gelscraper 1
Find remote jobs at our new job board 99remotejobs.com. There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com