Top 3 data-scraper Open-Source Projects
-
youtube-comment-downloader
Simple script for downloading Youtube comments without using the Youtube API
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
-
web-scraping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Project mention: Ask HN: YouTube – how to batch scrape comments and details for 300 videos? | news.ycombinator.com | 2024-01-15I would echo the advice of using a test framework. An alternative would be a browser extension, and using that to query the element ids while manually visiting each site.
The requirement to make it not tied to a Google account rules out what would be my preferred method of getting these via the YT API.
I think there are some open source git repos that already do what you're asking (e.g. https://github.com/egbertbouman/youtube-comment-downloader) but I haven't personally tried any of these.
data-scraper discussion
data-scraper related posts
-
Downloading YouTube comments into .html and .json file
-
Created an NBA Draft Model using 3 different machine learning techniques and documented the entire process. The Top 5 is pretty interesting!
-
Spent 6 months learning machine learning to create an NBA Draft Model to predict NBA success from NCAA prospects and documented the whole process. Repository in the article.
Index
What are some of the best open-source data-scraper projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | youtube-comment-downloader | 844 |
| 2 | web-scraping | 678 |
| 3 | NBA-Draft-Model | 3 |
Sponsored