Need help finding local LLM

• LLMsPracticalGuide

  11 8,561 4.5

  A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

checked e.g.: - https://medium.com/geekculture/list-of-open-sourced-fine-tuned-large-language-models-llm-8d95a2e0dc76 - https://github.com/Mooler0410/LLMsPracticalGuide - https://www.reddit.com/r/LocalLLaMA/comments/12r552r/creating_an_ai_agent_with_vicuna_7b_and_langchain/ - https://www.youtube.com/watch?v=9ISVjh8mdlA

• text-generation-webui

  876 36,552 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

What we're looking for: - running full local - no API-key requirements - no data exposing to external - GPU: available for testing is an GTX 1060 and an RTX 3080 - must run on Windows 10 and Windows 11 (compliance requirement) - for testing we would like to use https://github.com/oobabooga/text-generation-webui - should be able to read PDF (at best without pre processing), Markdown and HTML, .py, .go. Any other format we should be able to convert with pandoc. Currently in total ~30 GB - content: production process information (not only data, a lot of text), user manuals for people working in production and source code - long term goal (~ 6 month): using it with langchain (python not JS)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• localGPT

  29 19,193 8.6 Python

  Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

This might be worth looking at: https://github.com/PromtEngineer/localGPT

• chatdocs

  11 645 6.9 Python

  Chat with your documents offline using AI.

and: https://github.com/marella/chatdocs

Suggest a related project