Ask HN: How do I train a custom LLM/ChatGPT on my own documents?

• private-gpt

  131 51,882 9.2 Python

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

I explored privateGPT today and gave it a source of documents in txt format. It worked well for some queries but for some it gave responses which were not part of the source documents. Any tips on fixing this? There is an open issue for this problem - https://github.com/imartinez/privateGPT/issues/517

• localGPT

  29 19,193 8.6 Python

  Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

I've used https://github.com/PromtEngineer/localGPT for this and thought it was nice. So I packaged it in a docker container for easy use.

docker run -itd --gpus all -p $(PORT):5111 --name llm-local-wizardlm-7b obald/llm-launcher:0.0.2

just use localhost:port in the browser and upload docs then ask questions in the gui.

Really nice for easy lookup of rules in boardgames and such. As it provides the relevant text from the docs in addition to the query answer.

https://gitlab.com/PeterHedman/llm-local

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• awesome-chatgpt

  1 828 10.0

  🏆 An awe-inspiring collection of resources, encompassing a wide range of tools, documents, resources, applications, and use cases related to ChatGPT. (by awesome-chatgpt)

  

What you're looking for: https://github.com/imartinez/privateGPT

List of tools to bookmark: https://github.com/awesome-chatgpt/awesome-chatgpt

• llm-local

  1 - -

I've used https://github.com/PromtEngineer/localGPT for this and thought it was nice. So I packaged it in a docker container for easy use.

docker run -itd --gpus all -p $(PORT):5111 --name llm-local-wizardlm-7b obald/llm-launcher:0.0.2

just use localhost:port in the browser and upload docs then ask questions in the gui.

Really nice for easy lookup of rules in boardgames and such. As it provides the relevant text from the docs in addition to the query answer.

https://gitlab.com/PeterHedman/llm-local

• LocalAI

  83 19,862 9.9 C++

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

Did you mean user interface or API?

Anyway for UI you could look at chainlit, for API some of the models are already getting wrapped up in an open ai compatible rest interface.

See https://github.com/go-skynet/LocalAI

• askai

  1,753 86 10.0 TypeScript

  Command Line Interface for OpenAi ChatGPT (by yudax42)

https://chat.openai.com

Choose GPT4 and Code Interpreter (you have to turn it on in your Settings).

Then click the “plus” icon in the chat box.

Don’t upload anything sensitive.

Suggest a related project