Our great sponsors
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
If this is interesting to you, you should check out the interesting work that karlicoss and others have done with "Human Programming Interface" [0] / [1].
I've been kicking this idea around for quite a few years and have gone through multiple iterations before finding HPI and tossing out all my work in favor of building off theirs.
HPI is a great platform to build your own stuff off and benefit from all the work that has already been done because imo building a good foundation is the hardest part. Sean Breckenridge's HPI-API is super interesting and useful, could likely be worked into this search engine concept, quite sure Sean actually has both newsboat and Firefox modules already made.
I wrote modules of my own and made an authentication wrapped HPI-API and a GraphQL instance but currently in the middle of an infra move so nothing super cool to show off.
Lots of interesting stuff in collecting and leveraging your data. If any of this stuff catches your eye, I highly encourage browsing karlicoss' exobrain [2] because there are some interesting things in there.
[0]: https://github.com/karlicoss/HPI
[1]: my own stuff, not trying to step on Karli, just wanted a 3 letter org for my stuff: https://github.com/hpi
[2]: https://beepb00p.xyz/myinfra.html
I am working on pretty much exactly this same thing :)
Anything you can share yet?
Here is mine: https://github.com/ydennisy/kg1
I built https://mitta.us during Covid. I use it every day and am now working on AI pipelines for the documents saved to it over at https://mitta.ai. It's not a traditional crawler, and only saves what you tell it to save. There's also a Chrome extension to save pages quickly while browsing, and it allows you to remap search in chrome to the console, which then forwards you where you need to go based on the content. Still very much a WIP, but getting there!
Related posts
- “Obtaining My Personal Data from Amazon Was a Nightmare”
- Patterns of personal knowledge base (2023)
- Looking for a highlighting-notes-organized-storage app of some sort
- Seltsames Problem mit Erreichbarkeit eines selbst gehosteten Servers
- I can't find anything to fit my needs, pls help I'm pretty demoralized