Map of my personal data infrastructure

• awesome-quantified-self

  11 2,182 4.7

  :bar_chart: Websites, Resources, Devices, Wearables, Applications, and Platforms for Self Tracking

For data tracking/analysis, you're looking for "quantified self" https://github.com/woop/awesome-quantified-self#awesome-quan...

For exporting and owning the data the keyword is "data liberation"

Otherwise, the keywords are perhaps "personal knowledge management" and "memex". Have some links here, although they all have different components in scope https://beepb00p.xyz/exobrain/memex.html#cmmnts

I usually maintain related links at the end of articles, so perhaps you can find something there, for example https://beepb00p.xyz/sad-infra.html#links

• browser

  1 6 0.0 Go

  Parsing library for Firefox and Chromium user data (by thaliaarchi)

I've exported my data from 35 services, most via GDPR/CCPA exports. I've written a couple scripts to automate some, but it's not painless. I've been working on a Go library [0] for processing local Firefox- and Chromium-based browser data, including history, bookmarks, and extension settings. I hope to eventually have a local-first unified store of my data that's easy to analyze.

https://github.com/andrewarchi/browser

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• org-roam

  147 5,337 3.2 Emacs Lisp

  Rudimentary Roam replica with Org-mode

  

Yep, exobrain is using org-mode export + some tweaks. I've settled on emacs + org-mode a few years ago (perhaps on the fifth attempt it finally clicked). Before it was gitit/Zim/sublime text/random scripts, whatnot. All the shiny apps like Obsidian/Roam/etc have appeared over the last couple of years (and it's awesome!). But I'm too hooked onto emacs now, maybe the only thing I should use more is org-roam [0]. For me the most useful org-mode features perhaps are tags, agenda, org-capture and org-refile. Search is very important, I have a whole post about it [1].

I started a draft describing my 'process' [2], but it's pretty incomplete.. there are some bits scattered across exobrain too.

Also lately I started playing with Logseq [3] to get a more interactive representation of exobrain [4] (warning, it's pretty heavy, needs some optimization and I might have messed up the physics). Logseq could be a great gateway for people who want to get into org-mode but not ready to go 100% Emacs, highly recommend to try it it!

[0] https://github.com/org-roam/org-roam

[1] https://beepb00p.xyz/pkm_processing.html

[2] https://beepb00p.xyz/pkm-search.html

[3] https://github.com/logseq/logseq#logseq

[4] https://beepb00p.xyz/logseq/#/graph

• myinfra

  2 41 1.8 Python

  A diagram of my personal infrastructure

Not the first time, but possibly the biggest thing I've drawn in it...

There definitely are some weird things when you try to plot complicated things, fighting with weird placement, clusters etc. But not sure if it's me or Graphviz to blame for this. But I don't really know a better tool. If I knew how the diagram would look in hindsight I might have drawn in manually in inkscape or something, but when I started I didn't know what I would end up with, so needed to be an automatic tool :)

To minimize the manual work, I ended up with a mix of DSL in python and raw graphviz commands: https://github.com/karlicoss/myinfra/blob/fc6345c31c4e49b534...

Depending on the things you want to represent a better fit might be force layout, for example something like https://observablehq.com/@morvasaaty/d3-force-notes

Suggest a related project