Top 7 Python webscraper Projects
-
rightmove_webscraper.py
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
-
Project mention: I made a bot that analyzes sentiment on /r/wallstreetbets, and you can use it too. | reddit.com/r/algotradingcrypto | 2021-08-21
dwallach1/Stocker: Financial Web Scraper & Sentiment Classifier (github.com)
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
CoWin-Vaccine-Notifier
Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
-
Project mention: Looking for help/advice with scraping a website for download links | reddit.com/r/DataHoarder | 2021-07-13
Slight plug, but I made an example scraper using a scraping framework I made called ScraperX - https://github.com/xtream1101/scraperx
-
Project mention: is there anything else i can do to complete my edgenuity faster? | reddit.com/r/edgenuity | 2022-04-12
-
raspberry-pi-stock-checker
A configurable python webscraper that checks raspberry pi stocks from verified sellers
I been trying to get a raspberry pi 4 for the last 6 months and they are always out of stock due to the global chip shortage. So I made a python webscraper that does the job for me. Simple request + beautiful soup. Check it out on github: https://github.com/louie-cai/raspberry-pi-stock-checker. Contributions are very welcome.
-
I have A Gelbooru pool image scraper on GitHub if you're interested.
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
Python webscraper related posts
- is there anything else i can do to complete my edgenuity faster?
- What cool projects have you make with BeautifulSoup to make your life easier?
- Udemy web scraper to metadata plugin
- Looking for help/advice with scraping a website for download links
- Need help on finding the right xpath for web scrapping
- Thingiverse
Index
What are some of the best open-source webscraper projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | rightmove_webscraper.py | 170 |
| 2 | Stocker | 113 |
| 3 | CoWin-Vaccine-Notifier | 100 |
| 4 | scraperx | 46 |
| 5 | SearchifyX | 18 |
| 6 | raspberry-pi-stock-checker | 11 |
| 7 | poolbooru_gelscraper | 1 |
Are you hiring? Post a new remote job listing for free.
