wikiteam
ArchiveBox
| wikiteam | ArchiveBox | |
|---|---|---|
| 23 | 248 | |
| 688 | 19,790 | |
| 1.3% | 1.4% | |
| 3.8 | 9.8 | |
| about 1 month ago | 9 days ago | |
| Python | Python | |
| GNU General Public License v3.0 only | MIT |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wikiteam
-
Miraheze to Shut Down
WikiTeam is working on the archival, with the usual XML dumps and image dumps. You can follow updates and see how to help:
https://github.com/WikiTeam/wikiteam/issues/465#issuecomment...
https://wiki.archiveteam.org/index.php/Miraheze
Already before the announcement we had XML dumps for thousands of Miraheze wikis.
- Dan Parker has accidentally deleted Yugipedia without recent backup
-
Questions about mirroring fandom/wiki sites
The thread linked has the information you need. Read me on the Github page for WikiTeam's dump generator.
- WikiTeam: We archive wikis, from Wikipedia to tiniest wikis
- PSA: Fandom has acquired GameSpot, GameFAQ’s, metacritic and more.
-
Best way to archive a wiki "Powered by MediaWiki"
ArchiveTeam WikiTeam has download tooling: https://github.com/WikiTeam/wikiteam
-
Archiving Wiki (Fandom) Pages
Hi all - I'm trying to archive a number of fandom pages. Upon checking out this subreddit, I've found a few ways of doing so, and am currently working with the WikiTeam python tool (https://github.com/WikiTeam/wikiteam)
-
[Censorship] Fandom Wiki (formerly Wikia) is deleting wikis on sexual topics November 24, such as the Monster Girl Encyclopedia wiki
Httrack is a good choice for having a local copy of the wiki you can browse personally, but note that if you ever have to back up a wiki in a formal suitable for migrating to another wiki site, something like ArchiveTeam's WikiTeam tool would be suitable. It also has a built-in tool to upload the resulting backup to archive.org, like how someone has done so with the MGQ wiki here.
-
Fandom Wiki (formerly Wikia) is deleting wikis on sexual topics in 2 weeks
I found ArchiveTeam's WikiTeam tool relatively easy to use. I just had to download the repository from github (from the Code: Download Zip in the top right), have Python installed, open a command prompt in the folder, copy-paste the commands from their front page, have it fail complaining about missing modules, look up the command to install Python modules, and install the modules it needs. Their tutorial has additional instructions for uploading the resulting archives to archive.org and for downloading lists of wikis.
-
I need help with WikiTeam
If anyone has used this app please help me. I have followed the instruction in the readme.txt https://github.com/WikiTeam/wikiteam and I have the dumpgenerator.py but, when I run it with this commands:
ArchiveBox
-
Ask HN: What Underrated Open Source Project Deserves More Recognition?
Two projects I greatly appreciate, allowing me to easily archive my bandcamp and GOG purchases (after the initial setup anyways):
https://github.com/easlice/bandcamp-downloader
https://github.com/Kalanyr/gogrepoc
And I recently learned about archivebox, which I think is going to be a fast favorite and finally let me clear out my mess of tabs/bookmarks: https://github.com/ArchiveBox/ArchiveBox
- YaCy, a distributed Web Search Engine, based on a peer-to-peer network
-
Vice website is shutting down
If you really want to save the content for yourself, use something like https://archivebox.io/
I've been running a local instance for a few years now and download/save tech articles all time. I can search and find them as needed.
-
An Introduction to the WARC File
API is coming soon (relatively, it's still a one-man project)! Stay tuned https://github.com/ArchiveBox/ArchiveBox/issues/496
I have an event-sourcing refactor in progress now to allow us to pluginize functionality like the API (similar to Home Assistant with a plugin app sotre), it will take a month or two. Next up is the REST API using the new plugin system.
-
Ask HN: How can I back up an old vBulletin forum without admin access?
I guess your best chance is to use something like https://archivebox.io/.
-
ArchiveBox – open-source self-hosted web archiving
Yeah this is a cool project but it was discussed 2 days ago.
As mentioned by the maintainer there, they even maintain a list of alternatives, very classy:
https://github.com/ArchiveBox/ArchiveBox/wiki/Web-Archiving-...
- ArchiveBox: Open-source self-hosted web archiving
- Linkhut: A Social Bookmarking Site
- Show HN: Rem: Remember Everything (open source)
- Bookmark manager with a focus on organization?
What are some alternatives?
webscrapbook - A browser extension that captures web pages to local device or backend server for future retrieval, organization, annotation, and edit. This project inherits from legacy Firefox add-on ScrapBook X.
Wallabag - wallabag is a self hostable application for saving web pages: Save and classify articles. Read them later. Freely.
reddit-save - A Python tool for backing up your saved and upvoted posts on reddit to your computer.
paimon-moe - Your best Genshin Impact companion! Help you plan what to farm with ascension calculator and database. Also track your progress with todo and wish counter.
diskimageprocessor - Tool for automated processing of disk images in BitCurator
SingleFile - Web Extension for saving a faithful copy of a complete web page in a single HTML file
rexport - Reddit takeout: export your account data as JSON: comments, submissions, upvotes etc. 🦖
ArchivesSpace - The ArchivesSpace archives management tool
bitwarden-to-keepass - Export (most of) your Bitwarden items into KeePass (kdbx) database. That includes logins - with TOTP seeds, URIs, custom fields, attachments and secure notes
grab-site - The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
mwparserfromhell - A Python parser for MediaWiki wikicode
Archivematica - Free and open-source digital preservation system designed to maintain standards-based, long-term access to collections of digital objects.