Archiving as much of Soundgasm as possible

• reddit-html-archiver

  12 165 1.8 Python

  archive reddit data as offline friendly web pages

https://github.com/libertysoft3/reddit-html-archiver can accomplish step 1 out of the box Parse for every line including soundgasm and/or other domains you are targeting, and maybe run a dedupe on the list before download to lighten the load on yt-dl since it wasnt optimized for that last I checked that deep (which is YEEEEARS ago fwiw)

• jq

  306 25,063 0.0 C

  Discontinued Command-line JSON processor [Moved to: https://github.com/jqlang/jq] (by stedolan)

  

If you have jq installed then the following command should get a big list of URLs (Replace with big number like 100000)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• gwaripper

  1 27 6.7 Python

  Tool for conveniently downloading audios from r/gonewildaudio and similar subreddits

You can check out GWARipper.

Suggest a related project