SCrawler
wrolpi
Our great sponsors
| SCrawler | wrolpi | |
|---|---|---|
| 25 | 27 | |
| 1,026 | 50 | |
| - | - | |
| 8.6 | 9.5 | |
| about 19 hours ago | 2 days ago | |
| Visual Basic .NET | JavaScript | |
| GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SCrawler
- Could someone please review my reddit-img-dl command
- SCrawler. Reddit, Twitter, Instagram, YouTube and any other sites downloader. New grand update.
- How can I mass download all posts to imgur from my reddit account?
-
Downloading an entire subreddit - in 2023?
Scrawler
-
Just getting into data hoarding
https://github.com/AAndyProgram/SCrawler how can i run this in mac os?
- SCrawler: Reddit, Twitter, Instagram and any other sites downloader.
- Website that can mass download images/gifs/videos at original quality
-
It finally happened. Something I archived was erased from the Internet.
maybe SCrawler? if not, it shouldn't be too difficult to scrape with the API and a custom script.
- SCrawler Alternative for Linux
- GitHub - AAndyProgram/SCrawler: Media downloader from any sites, including Twitter, Reddit, Instagram, XVIDEOS etc.
wrolpi
-
WROLPi v0.11 beta demo
The project website: https://wrolpi.org
-
How to stay connected to the internet during a blackout...
can you make a local copy of it? offline wiki, https://github.com/lrnselfreliance/wrolpi, music/movies...etc
-
Internet in a Box
I thought about creating one of these in the past, but it didn’t fit my needs. I decided to start my own project, called WROLPi. It also uses a Raspbery pi as its base, but also has a Debian installer. I have RPi images available at https://wrolpi.org as well as a link to a demo (the demo needs an update, lots of new features since it’s creation).
The basic premise of WROLPi is creating your own off grid digital library: videos, web archives, PDFs, ebooks, etc. I have full text search for all of these. Offline maps as well via Open Street Map. Wi-Fi hotspot. Automatic downloads of videos (entire channels), RSS feeds, etc.
-
Operation CHARM: a Redditor set up a not-for profit site of a collection of 50,000 car repair manuals from 1982-2013
Look into Internet in a box or WROLpi as ways to serve the content. (A cookie to anyone who writes a howto on getting them both running on the same box; they have some overlap but serve different needs.)
-
prepping data
Creator here, I have pre-built images for Raspberry Pi available at https://wrolpi.org if you are interested.
-
Great feedback on my "portable offline knowledge device"
did i post this to you last time?
-
a powerful or decent pc have any use for prepping?
etc etc
-
What are some files you have on your emergency USB stick?
also, check out wrolpi
-
Ask HN: Those making $0/month or less on side projects – Show and tell
https://wrolpi.org/ Been having a great time on my side-project WROLPi. Its preparedness-oriented software which allows you to create an offline library. Videos, web archives, maps, epub/pdf, etc. Really easy search, low power usage if you run on in a Raspberry Pi. Just put out the first Raspberry Pi image, which makes installation super simple. Hoping to get a Debian image soon.
Currently "videos" is pretty well flushed out. Still some work to do with web archives. Maps has been a huge headache simply because maps are so large. Got PDFs and EPUBs searchable recently.
An abbreviated list of the technologies I've used to built it: Python, ReactJS, Open Street Map, yt-dlp (videos), SingleFile (web archives).
-
Prepping for the loss of the internet.
I have created a project specifically for this. It is free, open-source software. Check it out https://wrolpi.org
What are some alternatives?
ripme - Downloads albums in bulk
meshtastic - Meshtastic project website and documentation
bulk-downloader-for-reddit - Downloads and archives content from reddit
wikipedia-mirror - 🌐 Guide and tools to run a full offline mirror of Wikipedia.org with three different approaches: Nginx caching proxy, Kiwix + ZIM dump, and MediaWiki/XOWA + XML dump
TumblThree - A Tumblr and Twitter Blog Backup Application
Reticulum - The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.
lux - 👾 Fast and simple video download library and CLI tool written in Go
iiab - Internet-in-a-Box - Build your own LIBRARY OF ALEXANDRIA with a Raspberry Pi !
facebook-scraper - Scrape Facebook public pages without an API key
FireDM - python open source (Internet Download Manager) with multi-connections, high speed engine, based on python, LibCurl, and youtube_dl https://github.com/firedm/FireDM
gallery-dl - Command-line program to download image galleries and collections from several image hosting sites
cryptography - cryptography is a package designed to expose cryptographic primitives and recipes to Python developers.