Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work. Learn more →
Top 3 Python Archiving and Digital Preservation (DP) Projects
-
ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
For some things you can use the different options with archivebox.io
-
CKAN
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
Project mention: Metadata Store - Which one to Choose ? OpenMetadata vs Datahub ? | reddit.com/r/dataengineering | 2022-11-17We use Kubernetes as our deployment platform. Any feedback on one of these open source data catalogs ? - https://atlas.apache.org/#/ - https://opendatadiscovery.org/ - https://open-metadata.org/ - https://marquezproject.github.io/marquez/ - https://datahubproject.io/ - https://www.amundsen.io/ - https://ckan.org/ - https://magda.io/
-
CodiumAI
TestGPT | Generating meaningful tests for busy devs. Get non-trivial tests (and trivial, too!) suggested right inside your IDE, so you can code smart, create more value, and stay confident when you push.
-
Archivematica
Free and open-source digital preservation system designed to maintain standards-based, long-term access to collections of digital objects.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-05-18.
Python Archiving and Digital Preservation (DP) related posts
- Need a way of saving websites
- If we lose the Internet Archive, we’re screwed
- End-of-Availability notice for legacy DSM, Surveillance Station, SRM, and more
- Useful browser extensions and their associated selfhosted services.
- Archivebox - trying to hoard 112K bookmarks
- Any options available to organize and save (may be) reddit saved posts?
- Is there a way to save every page, every text, every image, absolutely ever single piece of information that comes into my browser to disk. In an orderly, time-stamped, easily mass searchable manner ?
-
A note from our sponsor - Sonar
www.sonarsource.com | 31 May 2023
Index
What are some of the best open-source Archiving and Digital Preservation (DP) projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | ArchiveBox | 15,824 |
| 2 | CKAN | 3,814 |
| 3 | Archivematica | 359 |
Access the most powerful time series database as a service
Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
www.influxdata.com