Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Similar projects and alternatives to guidance
A query language for programming (large) language models.
Python bindings for llama.cpp
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Local LLM Agent with Langchain
Interact privately with your documents using the power of GPT, 100% privately, no data leaks
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Build LLM-backed Ruby applications
hnsqlite integrates hnswlib and sqlite for simple text embedding search
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
4 bits quantization of LLaMA using GPTQ
Local LLM Agent with Guidance
Port of Facebook's LLaMA model in C/C++
All-in-one chatbot client
A guidance language for controlling large language models. (by Maximilian-Winter)
A relatively state of the art LOCAL voice assistant, using the KoboldAI API for the language model
A guidance language for controlling large language models.
gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue
An open source ChatGPT UI.
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
8-bit CUDA functions for PyTorch
AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
guidance reviews and mentions
(2/2) May 2023
14 projects | /r/dailyainews | 2 Jun 2023
A guidance language for controlling LLMs (https://github.com/microsoft/guidance)
LlamaCPP and LangChain Agent Quality
5 projects | /r/LocalLLaMA | 31 May 2023
LLM for information extraction
2 projects | /r/LocalLLaMA | 31 May 2023
That would be very interesting, I myself is interested to know. I've heard some projects can use sampling to make sure the model doesn't get off track from the expected format. Guidence might be able to do that, and I remember someone here mentioned how it supported LLaMA.
Success with a local voice chat agent
4 projects | /r/LocalLLaMA | 26 May 2023
Thinking more about it, it is kinda insane that we can now just tell a model how to use an API. Maybe in the near future, more powerful local models can write their own (simple) scripts so one doesn't have to hardcode the API everytime. Maybe stuff like https://huggingface.co/docs/transformers/transformers_agents can be of some inspiration to you (and ofc others like langchain). Thinking of an idea to use something like https://github.com/microsoft/guidance so that if an LM decides to call an API, it sticks to a template (and then maybe could expand on that)
Would local LLMs in the future be able to run an Ai powered single player roleplaying adventure game in a customized world?
3 projects | /r/LocalLLaMA | 26 May 2023
I am fond of Microsoft Guidance: https://github.com/microsoft/guidance/ which allows you to have highly structured conversations with many different LLMs. Your Python code can jump in and modify the conversation at any time, allowing your program to easily inject tool usage into the conversational chain. I recommend reading each example very carefully.
Does anyone use caching of openAI calls?
2 projects | /r/aipromptprogramming | 26 May 2023
I use Microsoft Guidance for this. https://github.com/microsoft/guidance
Lessons from Creating a VSCode Extension with GPT-4
2 projects | news.ycombinator.com | 25 May 2023
"Prompt engineer" didn't exactly make sense to me until a coworker (graphic design) talked about the prompts that he'd see in Midjourney's discord server. Particularly when he mentioned specifications around camera lenses and perspective and other things I'm not familiar with. Very specific choices, continuing to be added and refined.
Then seeing what guidance is intended to do (LLM-prompt templating) it becomes obvious what people have in mind for this. It won't obviate understanding the lower-level code -- in fact, I expect the value of that skill to increase over time as fewer people bother to learn it -- but it will cut out the time it takes to scaffold an application.
Ideas for extensions?
4 projects | /r/Oobabooga | 24 May 2023
give me https://github.com/microsoft/guidance - would be a heavy upgrade for ooba
QLoRA: Efficient Finetuning of Quantized LLMs
6 projects | news.ycombinator.com | 24 May 2023
This is off-topic, but are there any communities or congregations (that aren't reddit) based around locally hosted LLMs? I'm asking because while I see a bunch of projects for exposing GGML/LLaMA to OpenAI compatible interfaces, some UIs, etc, I can't really find a good community or resources for the concept in general.
I'm working on a front-end for LLMs in general, having re-implemented a working version of OpenAI's code interpreter "plugin" already within the UI, and support for the wealth of third-party OpenAI plugins (I've been testing with the first diagram plugin I found, it works well.) I'm planning to open source it once my breaking changes slow down.
This field moves very fast, I'm looking for feedback (and essentially testers/testing data) on what people want, and looking for prompts/chat logs/guidance templates (https://github.com/microsoft/guidance) for tasks they expect to "just work" with natural language.
Instead of being limited by the monetization for ChatGPT Plus (and limited number of messages every four hours) for extensibility within a chat interface, I want to open it and free it, with a Bring-Your-Own-LLM setup.
GitHub - microsoft/guidance: A guidance language for controlling large language models.
2 projects | /r/aigamedev | 24 May 2023
A note from our sponsor - InfluxDB
www.influxdata.com | 3 Jun 2023
microsoft/guidance is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of guidance is Jupyter Notebook.