Running local LLM for info retrieval of technical documents

• BrainChulo

  10 140 9.0 Python

  Harnessing the Memory Power of the Camelids

  

Awesome resource! If I may suggest that you'd add one, some friends and I are working on data retrieval with llm project as well, with our differentiating marker being that we are trying to implement guidance in order to improve the agent efficiency. If you guys wanna take a look :) https://github.com/ChuloAI/BrainChulo

• private-gpt

  131 51,882 9.2 Python

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

I use https://github.com/imartinez/privateGPT for exactly your use case. It worked straight ootb, and it has pretty fast document injestion. My only wish is stable and non compilation GPU inference support. And yes, it will tell you pretty much the text associated with section header or title... even from a PDF document.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project