Ask HN: Has Anyone Trained a personal LLM using their personal notes?

• obsidian-copilot

  5 427 7.3 Python

  🤖 A prototype assistant for writing and thinking (by eugeneyan)

hadn't seen your repo yet [1] - adding it to my list right now.

Your blog post is really neat on top - thanks for sharing

https://github.com/eugeneyan/obsidian-copilot

• chatbot-ui

  63 26,190 9.4 TypeScript

  AI chat for every model.

[3] https://github.com/mckaywrigley/chatbot-ui

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• github-orgmode-tests

  245 147 4.8

  This is a test project where you can explore how github interprets Org-mode files

- or to visualize and use it as a personal partner.

There's already a ton of open-source UIs such as Chatbot-ui[3] and Reor[4]. And that's just the tip of the iceberg.

Personally, I haven't been consistent enough through the years in note-taking.

So, I'm really curious to learn more about those of you who were and implemented such pipelines.

I'm sure there's a ton of really fascinating experiences.

[1] https://orgmode.org/

• reor

  7 4,175 9.9 TypeScript

  Self-organizing AI note-taking app that runs models locally.

  

[4] https://github.com/reorproject/reor

• obsidian-releases

  1,653 8,004 9.9 JavaScript

  Community plugins list, theme list, and releases of Obsidian.

  

[2] https://obsidian.md/

• private-gpt

  131 51,732 9.2 Python

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

PrivateGPT is a nice tool for this. It's not exactly what you're asking for, but it gets part of the way there.

https://github.com/zylon-ai/private-gpt

• markdown-embeddings-search

  1 1 4.9 Python

  Obisidan notes to pinecone embeddings plus other files in effor to learn llama_index

Not exactly what you're looking for but I a few months ago I spent a day building a llama-index pipeline against my markdown notes with a really privative note crawling implementation, and had surprisingly good results for question answering.

I don't use an org-roam note system but I've been working on a similar and highly opinionated note system that I'm always making tools for. And I'm always interested in seeing people's ideal note systems.

my crude WIP Obsidian / Markdown note RAG tool: https://github.com/bs7280/markdown-embeddings-search

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• til

  4 72 7.7 Python

  Personal Wiki of Interesting things I learn every day at the intersection of software, life & stuff a.k.a my second brain 🧠️ (by Bhupesh-V)

Folks at gitbook are kind enough to give me a LLM over my notes https://til.bhupesh.me

• qdrant

  140 17,943 9.9 Rust

  Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

  

I'm currently looking to implement locally, using QDrant [1] for instance.

I'm just playing around, but it makes sense to have a runnable example for our users at work too :) [2].

[1]. https://qdrant.tech/

Suggest a related project