Top 4 Python digital-preservation Projects

wikiteam

23 687 3.8 Python

Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.

Project mention: Miraheze to Shut Down | news.ycombinator.com | 2023-06-18

WikiTeam is working on the archival, with the usual XML dumps and image dumps. You can follow updates and see how to help:
https://github.com/WikiTeam/wikiteam/issues/465#issuecomment...
https://wiki.archiveteam.org/index.php/Miraheze
Already before the announcement we had XML dumps for thousands of Miraheze wikis.

Archivematica

4 404 9.0 Python

Free and open-source digital preservation system designed to maintain standards-based, long-term access to collections of digital objects.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
webcrystal

3 24 10.0 Python

An archiving HTTP proxy and on-disk archival format for websites.

Project mention: SearXNG is a free internet metasearch engine | news.ycombinator.com | 2024-04-05

While it lacks a search feature last I checked there's always https://github.com/davidfstr/webcrystal
One .py file. Only one dependency (urllib3).n with a little love the concept could become a full transparent proxy.

diskimageprocessor

1 23 5.4 Python

Tool for automated processing of disk images in BitCurator

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).