Top 6 data-liberation Open-Source Projects

• HPI

  14 1,403 8.5 Python

  Human Programming Interface 🧑👽🤖

Project mention: First Personal Search Engine Prototype | news.ycombinator.com | 2023-12-30

If this is interesting to you, you should check out the interesting work that karlicoss and others have done with "Human Programming Interface" [0] / [1].

I've been kicking this idea around for quite a few years and have gone through multiple iterations before finding HPI and tossing out all my work in favor of building off theirs.

HPI is a great platform to build your own stuff off and benefit from all the work that has already been done because imo building a good foundation is the hardest part. Sean Breckenridge's HPI-API is super interesting and useful, could likely be worked into this search engine concept, quite sure Sean actually has both newsboat and Firefox modules already made.

I wrote modules of my own and made an authentication wrapped HPI-API and a GraphQL instance but currently in the middle of an infra move so nothing super cool to show off.

Lots of interesting stuff in collecting and leveraging your data. If any of this stuff catches your eye, I highly encourage browsing karlicoss' exobrain [2] because there are some interesting things in there.

[0]: https://github.com/karlicoss/HPI

[1]: my own stuff, not trying to step on Karli, just wanted a 3 letter org for my stuff: https://github.com/hpi

[2]: https://beepb00p.xyz/myinfra.html

• pockexport

  1 169 3.5 Python

  Export/access your Pocket data, including highlights!

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• rexport

  5 158 4.9 Python

  Reddit takeout: export your account data as JSON: comments, submissions, upvotes etc. 🦖

• kobuddy

  1 130 4.9 Python

  Kobo database backup and parser: extracts notes, highlights, reading progress and more

• chronicle-etl

  1 121 7.6 Ruby

  📜 A CLI toolkit for extracting and working with your digital history

  

Project mention: Memex like products/communities for gathering personal data? | news.ycombinator.com | 2023-10-23

- Chronicle ETL : a cli for ETL'ing from different data silos https://github.com/chronicle-app/chronicle-etl

• dashboard

  1 21 4.0 Python

data-liberation related posts

• reddit-img-dl: Tool to download media and comments from subreddits or reddit users. Its a fork of the The-Eye-Team/reddit-dl with additional features. I worked on this afew years ago, but it might be useful to the people here with the recent reddit and imgur changes.

  3 projects | /r/DataHoarder | 20 Apr 2023

• I downloaded my reddit comment history, here's the code I used...

  2 projects | /r/bash | 3 Feb 2022

• How often do you refresh reddit profile?

  7 projects | /r/privacytoolsIO | 30 Jun 2021

• Easy way to save entire Reddit account?

  1 project | /r/DataHoarder | 21 May 2021

• Is there a tool/script out there for the downloading and archival of reddit messages(preferably in json)?

  1 project | /r/DataHoarder | 31 Mar 2021

• How I collect and use 50 sources of my personal data

  3 projects | news.ycombinator.com | 6 Feb 2021
• A note from our sponsor - InfluxDB
  www.influxdata.com | 23 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com