Top 3 Python data-scraper Projects

youtube-comment-downloader

4 822 4.0 Python

Simple script for downloading Youtube comments without using the Youtube API

Project mention: Ask HN: YouTube – how to batch scrape comments and details for 300 videos? | news.ycombinator.com | 2024-01-15

I would echo the advice of using a test framework. An alternative would be a browser extension, and using that to query the element ids while manually visiting each site.
The requirement to make it not tied to a Google account rules out what would be my preferred method of getting these via the YT API.
I think there are some open source git repos that already do what you're asking (e.g. https://github.com/egbertbouman/youtube-comment-downloader) but I haven't personally tried any of these.

web-scraping

43 617 0.0 Python

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Project mention: web-scraping: NEW Data - star count:554.0 | /r/algoprojects | 2023-09-25

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
NBA-Draft-Model

2 2 4.8 Python

This is a Python college basketball data scraper + draft model.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).