wrolpi
internetarchive
wrolpi | internetarchive | |
---|---|---|
27 | 17 | |
50 | 1,519 | |
- | - | |
9.5 | 8.3 | |
4 days ago | 3 days ago | |
JavaScript | Python | |
GNU General Public License v3.0 only | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wrolpi
-
WROLPi v0.11 beta demo
The project website: https://wrolpi.org
-
How to stay connected to the internet during a blackout...
can you make a local copy of it? offline wiki, https://github.com/lrnselfreliance/wrolpi, music/movies...etc
-
Internet in a Box
I thought about creating one of these in the past, but it didnโt fit my needs. I decided to start my own project, called WROLPi. It also uses a Raspbery pi as its base, but also has a Debian installer. I have RPi images available at https://wrolpi.org as well as a link to a demo (the demo needs an update, lots of new features since itโs creation).
The basic premise of WROLPi is creating your own off grid digital library: videos, web archives, PDFs, ebooks, etc. I have full text search for all of these. Offline maps as well via Open Street Map. Wi-Fi hotspot. Automatic downloads of videos (entire channels), RSS feeds, etc.
-
Operation CHARM: a Redditor set up a not-for profit site of a collection of 50,000 car repair manuals from 1982-2013
Look into Internet in a box or WROLpi as ways to serve the content. (A cookie to anyone who writes a howto on getting them both running on the same box; they have some overlap but serve different needs.)
-
prepping data
Creator here, I have pre-built images for Raspberry Pi available at https://wrolpi.org if you are interested.
-
Great feedback on my "portable offline knowledge device"
did i post this to you last time?
-
a powerful or decent pc have any use for prepping?
etc etc
-
What are some files you have on your emergency USB stick?
also, check out wrolpi
-
Ask HN: Those making $0/month or less on side projects โ Show and tell
https://wrolpi.org/ Been having a great time on my side-project WROLPi. Its preparedness-oriented software which allows you to create an offline library. Videos, web archives, maps, epub/pdf, etc. Really easy search, low power usage if you run on in a Raspberry Pi. Just put out the first Raspberry Pi image, which makes installation super simple. Hoping to get a Debian image soon.
Currently "videos" is pretty well flushed out. Still some work to do with web archives. Maps has been a huge headache simply because maps are so large. Got PDFs and EPUBs searchable recently.
An abbreviated list of the technologies I've used to built it: Python, ReactJS, Open Street Map, yt-dlp (videos), SingleFile (web archives).
-
Prepping for the loss of the internet.
I have created a project specifically for this. It is free, open-source software. Check it out https://wrolpi.org
internetarchive
-
Official CLI Tool for the Internet Archive
https://github.com/jjjake/internetarchive/commit/952ace47e0e...
Me too, first commit was a bit more than 11 years ago.
-
What do you use to verify the hashes provided by Archive.org?
The --checksum switch of ia verifies the hashes.
- Mass downloading from Archive.org...how?
-
Using Python for Internet Archive Bulk Upload
first, i've tried python and internetarchive scripts only on XP/Vista with the corresponding version for those OS, without success. I moved to linux, instead. While I have a Raspberry Pi (RPi), I tried first on a Virtual Machine, under Windows. I chose Debian (that's what I run on the RPi) but also had a go at FreeBSD. Both have packages (binaries) ready to go and worked flawlessly. From your post, you have enough skills to set up a virtual machine and install a mainstream linux distro, which is basically downloading an iso, mounting it on the VM, clicking next,next,next,ok,done. You then would boot into the desktop and open the CLI (command line interface). Installing internet archive and python is just a matter of copy pasting a couple of commands. On linux, the internet archive package is https://packages.debian.org/stable/utils/internetarchive and I find it easier than grabbing the binaries through cURL, setting up permissions and whatnot. same for python3. it'll do it's thing (grabs all the files it needs, installs, cleans, all automated, and when it's done you're back at the prompt ($ <-- you asked what this operator means in Python but I think you mean when it shows on the documentation; it's just a command prompt, like it would be on windows cmd, for example c:\archives\uploads> waiting for a command) and ready to throw commands. you first need to setup with your credentials. just ia configure it'll ask all it needs and you're ready to upload stuff. mass uploading different items s basically entering the same command for as many times as it's needed. ia does this for you, using a CSV file -- this involves a bit of pre-processing but when set and done it'll save you a lot of time and wait.
-
I'm using 'screen' for some background tasks on a headless RPi server and it doesn't show progress info. Works fine outside it.
More specifically i'm using ia internetarchive, and Putty 0.75 to log into the Pi. All is updated and outside a screen session works fine. When transfering files I get a progress bar, %, speed and timestamps. But when on a screen all I get it the name of the file being uploaded and nothing else. It only changes when one file finishes and moves to the next or when all is uploaded. No other progress info.
-
Top Python Coding Repos
requests - A simple, yet elegant, HTTP library. sanic - Next generation Python web server/framework | Build fast. Run fast. click - Python composable command line interface toolkit elasticsearch-dsl-py - High level Python client for Elasticsearch panel - A high-level app and dashboarding solution for Python internetarchive - A Python and Command-Line Interface to Archive.org coconut - Simple, elegant, Pythonic functional programming
- It finally happened. Something I archived was erased from the Internet.
- Looking for some help in downloading a few thousand files from archive.org on ubuntu. wget is estimated to take 2 months... I figured I should ask the fellow data-hoarders!
-
How can I mirror big folder from Archive.org
You can do that with the Internet Archive's Python client by jjjake: https://github.com/jjjake/internetarchive
-
Wii WBFS games?
If you're comfortable with command line, you can use the internet archive python script to download stuff from archive.org ( https://github.com/jjjake/internetarchive )
What are some alternatives?
meshtastic - Meshtastic project website and documentation
archiveOrgImageDownloader - A python script that will download pages from a borrowed book from the Internet Archive archive.org library and save them as images.
wikipedia-mirror - ๐ Guide and tools to run a full offline mirror of Wikipedia.org with three different approaches: Nginx caching proxy, Kiwix + ZIM dump, and MediaWiki/XOWA + XML dump
rfsh - RFSH: Run shell scripts in batch, concurrently, fully customized with variable .
Reticulum - The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.
WinPython - A free Python-distribution for Windows platform, including prebuilt packages for Scientific Python.
iiab - Internet-in-a-Box - Build your own LIBRARY OF ALEXANDRIA with a Raspberry Pi !
SCrawler - ๐ณ๏ธโ๐ Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.
FireDM - python open source (Internet Download Manager) with multi-connections, high speed engine, based on python, LibCurl, and youtube_dl https://github.com/firedm/FireDM
instaloader - Download pictures (or videos) along with their captions and other metadata from Instagram.
GGet - Multithreaded download accelerator written in Go