wikiteam
reddit-save
| wikiteam | reddit-save | |
|---|---|---|
| 23 | 6 | |
| 688 | 124 | |
| 1.3% | - | |
| 3.8 | 4.4 | |
| about 1 month ago | 4 months ago | |
| Python | Python | |
| GNU General Public License v3.0 only | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wikiteam
-
Miraheze to Shut Down
WikiTeam is working on the archival, with the usual XML dumps and image dumps. You can follow updates and see how to help:
https://github.com/WikiTeam/wikiteam/issues/465#issuecomment...
https://wiki.archiveteam.org/index.php/Miraheze
Already before the announcement we had XML dumps for thousands of Miraheze wikis.
- Dan Parker has accidentally deleted Yugipedia without recent backup
-
Questions about mirroring fandom/wiki sites
The thread linked has the information you need. Read me on the Github page for WikiTeam's dump generator.
- WikiTeam: We archive wikis, from Wikipedia to tiniest wikis
- PSA: Fandom has acquired GameSpot, GameFAQ’s, metacritic and more.
-
Best way to archive a wiki "Powered by MediaWiki"
ArchiveTeam WikiTeam has download tooling: https://github.com/WikiTeam/wikiteam
-
Archiving Wiki (Fandom) Pages
Hi all - I'm trying to archive a number of fandom pages. Upon checking out this subreddit, I've found a few ways of doing so, and am currently working with the WikiTeam python tool (https://github.com/WikiTeam/wikiteam)
-
[Censorship] Fandom Wiki (formerly Wikia) is deleting wikis on sexual topics November 24, such as the Monster Girl Encyclopedia wiki
Httrack is a good choice for having a local copy of the wiki you can browse personally, but note that if you ever have to back up a wiki in a formal suitable for migrating to another wiki site, something like ArchiveTeam's WikiTeam tool would be suitable. It also has a built-in tool to upload the resulting backup to archive.org, like how someone has done so with the MGQ wiki here.
-
Fandom Wiki (formerly Wikia) is deleting wikis on sexual topics in 2 weeks
I found ArchiveTeam's WikiTeam tool relatively easy to use. I just had to download the repository from github (from the Code: Download Zip in the top right), have Python installed, open a command prompt in the folder, copy-paste the commands from their front page, have it fail complaining about missing modules, look up the command to install Python modules, and install the modules it needs. Their tutorial has additional instructions for uploading the resulting archives to archive.org and for downloading lists of wikis.
-
I need help with WikiTeam
If anyone has used this app please help me. I have followed the instruction in the readme.txt https://github.com/WikiTeam/wikiteam and I have the dumpgenerator.py but, when I run it with this commands:
reddit-save
-
Download Saved Reddit posts into Obsidian automatically in .md format
This was the base of it: https://github.com/samirelanduk/reddit-save
- What is a self-hostable service you wish existed?
-
Is there a good list of up-to-date data archiving tools for different websites?
I'm mostly on reddit and I use reddit-save. It works well! Biggest issue is I'd like to be able to archive a thread to an arbitrary length.
- I fear this sub will be quarantined soon. Is there a way to archive stuff?
-
Limiting Access to Removed and Deleted Post Pages
reddit-save
-
Starting my own Data Hoarding
Reddit: yes, we are on reddit and there is considerable amount of science and art. Already archiving all saved posts using reddit-save and some low-traffic subreddits in their entirety using unknown tool.
What are some alternatives?
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
bulk-downloader-for-reddit - Downloads and archives content from reddit
webscrapbook - A browser extension that captures web pages to local device or backend server for future retrieval, organization, annotation, and edit. This project inherits from legacy Firefox add-on ScrapBook X.
TumblThree - A Tumblr and Twitter Blog Backup Application
diskimageprocessor - Tool for automated processing of disk images in BitCurator
youtube-dl - Command-line program to download videos from YouTube.com and other video sites
rexport - Reddit takeout: export your account data as JSON: comments, submissions, upvotes etc. 🦖
bitwarden-to-keepass - Export (most of) your Bitwarden items into KeePass (kdbx) database. That includes logins - with TOTP seeds, URIs, custom fields, attachments and secure notes
reveddit - Review removed content on reddit. Uses the Pushshift API, built on code from removeddit.
mwparserfromhell - A Python parser for MediaWiki wikicode
floccus - :cloud: Sync your bookmarks privately across browsers and devices