Top 8 Python scrapper Projects

web-scraping

43 617 0.0 Python

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Project mention: web-scraping: NEW Data - star count:554.0 | /r/algoprojects | 2023-09-25

stweet

3 570 0.0 Python

Advanced python library to scrap Twitter (tweets, users) from unofficial API

Project mention: Failed using the new twitter API or alternatives | /r/learnpython | 2023-05-11

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
comic-dl

1 528 3.9 Python

Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
Bedetheque-Scrapper-2

5 35 7.7 Python

Script that scapes data from Bedetheque.com for ComicRack
CSS2RSS

2 10 5.2 Python

scrapper script for RSSGuard to make an RSS feed for any website using CSS
ask-hn-urls

3 7 1.8 Python

find URLs posted as a part of comments on Hacker news Ask: HN section.
telegram_scripts

1 2 0.0 Python

Miscellaneous telegram scripts built on top of telethon
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
neosekai-dl

2 0 2.3 Python

A Python CLI to download novels from neosekaitranslations.com as PDF

Project mention: Python project to download novel from neosekaitranslations.com as PDF : neosekai-dl | /r/Python | 2023-05-05

hey guys, I just finished working on neosekai-dl, a python project to download novel from neosekaitranslations.com. It uses a scapper API that i built, neosekai-api

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).