local LLM agent?

• localLLM_langchain

  2 46 3.6 Jupyter Notebook

  Local LLM Agent with Langchain

I was able to make a dumb bot (react framework) using wizardlm 13b and 30b (1.1 for 13b) (using something similar to this: https://github.com/QuangBK/localLLM_langchain/blob/main/localLLM_agent.ipynb, without langchain. But it seems like it really struggles with following the correct format when giving the output. Sometimes, its thought is to search, but instead, it parses a web page. I have tried using natural language and json format output. I've tweeked the prompt several times to varying degrees of success. I've played with the temperature with some success.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project