Top 5 digital-preservation Open-Source Projects

• wikiteam

  23 695 2.1 Python

  Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.

  

Project mention: Miraheze to Shut Down | news.ycombinator.com | 2023-06-18

WikiTeam is working on the archival, with the usual XML dumps and image dumps. You can follow updates and see how to help:

https://github.com/WikiTeam/wikiteam/issues/465#issuecomment...

https://wiki.archiveteam.org/index.php/Miraheze

Already before the announcement we had XML dumps for thousands of Miraheze wikis.

• Archivematica

  4 410 9.0 Python

  Free and open-source digital preservation system designed to maintain standards-based, long-term access to collections of digital objects.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• archivebox-browser-extension

  3 163 7.3 TypeScript

  Official ArchiveBox browser extension: automatically/manually preserve your browsing history using ArchiveBox.

  

Project mention: Hyperlink Maximalism (2022) | news.ycombinator.com | 2023-07-25

https://chromewebstore.google.com/detail/habonpimjphpdnmcfka... (or https://github.com/tjhorner/archivebox-exporter for source)

Pushes your history to ArchiveBox, which does the heavy lifting storing/processing the content.

Alas, might not work with Epiphany because there's no complete extension support.

But IIRC, it stores its urls in $XDG_DATA_HOME/epiphany/ephy-history.db - so a bit of sqlite and ArchiveBox might do the trick for you.

Note: I'm running something similar, but find that I'd rather not rely on my history, I tend to click on a lot of garbage ;) You might want to curate a bit.

• webcrystal

  3 24 10.0 Python

  An archiving HTTP proxy and on-disk archival format for websites.

Project mention: SearXNG is a free internet metasearch engine | news.ycombinator.com | 2024-04-05

While it lacks a search feature last I checked there's always https://github.com/davidfstr/webcrystal

One .py file. Only one dependency (urllib3).n with a little love the concept could become a full transparent proxy.

• diskimageprocessor

  1 23 5.4 Python

  Tool for automated processing of disk images in BitCurator

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

digital-preservation related posts

• Offpunk 2.0

  2 projects | news.ycombinator.com | 25 Nov 2023

• How to make my existing digital collections more accessible and useful.. and present a backlog I can and want to get through

  1 project | /r/datacurator | 14 Oct 2021

• Archivematica: Open-source digital preservation system

  1 project | /r/CKsTechNews | 2 Oct 2021

• Archivematica: Open-source digital preservation system

  6 projects | news.ycombinator.com | 2 Oct 2021

• Archivematica: open-source digital preservation system

  1 project | /r/opensource | 9 Feb 2021

• A tool that analyze the files on a disk image?

  1 project | /r/learnpython | 10 Jan 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 24 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com