I made a simple agent demo with Guidance and wizard-mega-13B-GPTQ, feel quite promising.

• localLLM_guidance

  3 147 4.2 Jupyter Notebook

  Local LLM ReAct Agent with Guidance

Also, you can compare Langchain and Guidance here: Guidance Agent and Langchain Agent

• local-guidance

  2 9 8.7 Jupyter Notebook

  A guidance language for controlling large language models.

git clone https://github.com/paolorechia/local-guidance

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama-cpp-python

  55 6,475 9.8 Python

  Python bindings for llama.cpp

• localLLM_langchain

  2 46 3.6 Jupyter Notebook

  Local LLM Agent with Langchain

Also, you can compare Langchain and Guidance here: Guidance Agent and Langchain Agent

• guidance

  89 12,248 9.5 Jupyter Notebook

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

I think you can neatly force the LLM into doing exactly the patterns you need it to follow, by using Microsoft guidance

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project