Is anyone using self hosted LLM day to day and training it like a new employee

• LongMem

  3 732 5.0 Python

  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".

• obsidian-ollama

  3 624 3.1 TypeScript

Having come from Notion also, I LOVE Obsidian for its non-proprietary file structure. Incredible powerful plugins, too.

FWIW, it's not really what you're seeking... but there is a plugin that allows you to invoke an LLM from within Obsidian (via Ollama): https://github.com/hinterdupfinger/obsidian-ollama

In short, it allows you to set up prompts to transform selected text directly within a file, e.g. 'Summarize this selection as a markdown formatted list of key points', 'Write a PRD', 'Translate to [Language]', 'Run this as a prompt', etc.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• lightrail

  10 219 9.0 JavaScript

  Lightrail Monorepo

  

I've been using & contributing to Lightrail (https://github.com/lightrail-ai/lightrail). Each instance comes with a local vectorDB and integrates with apps like Chrome & VSCode, so I can read in content like my notes, emails, etc. It doesn't support self-hosted LLMs yet unfortunately!

• txtai

  355 6,953 9.3 Python

  💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

  

Cool use case, glad to see txtai [1] is helping (I'm the main dev for txtai).

Since you're using txtai, this article I just wrote yesterday might be helpful: https://neuml.hashnode.dev/build-rag-pipelines-with-txtai

Looks like you've received a lot of great ideas here already though!

1 - https://github.com/neuml/txtai

Suggest a related project