-
local_llama
This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I would like to use this tool https://github.com/jlonge4/gpt_chatwithPDF/blob/main/gpt_chat_api.py but unfortunately the local version (https://github.com/jlonge4/local_llama) is bound to the CPU and thus quiet slow. Is there any way i could get textgenwebui working with the above stated tool?
I would like to use this tool https://github.com/jlonge4/gpt_chatwithPDF/blob/main/gpt_chat_api.py but unfortunately the local version (https://github.com/jlonge4/local_llama) is bound to the CPU and thus quiet slow. Is there any way i could get textgenwebui working with the above stated tool?