guidance

A guidance language for controlling large language models. (by microsoft)

Guidance Alternatives

Similar projects and alternatives to guidance

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better guidance alternative or higher similarity.

guidance reviews and mentions

Posts with mentions or reviews of guidance. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-02.
  • (2/2) May 2023
    14 projects | /r/dailyainews | 2 Jun 2023
    A guidance language for controlling LLMs (https://github.com/microsoft/guidance)
  • LlamaCPP and LangChain Agent Quality
    5 projects | /r/LocalLLaMA | 31 May 2023
  • LLM for information extraction
    2 projects | /r/LocalLLaMA | 31 May 2023
    That would be very interesting, I myself is interested to know. I've heard some projects can use sampling to make sure the model doesn't get off track from the expected format. Guidence might be able to do that, and I remember someone here mentioned how it supported LLaMA.
  • Success with a local voice chat agent
    4 projects | /r/LocalLLaMA | 26 May 2023
    Thinking more about it, it is kinda insane that we can now just tell a model how to use an API. Maybe in the near future, more powerful local models can write their own (simple) scripts so one doesn't have to hardcode the API everytime. Maybe stuff like https://huggingface.co/docs/transformers/transformers_agents can be of some inspiration to you (and ofc others like langchain). Thinking of an idea to use something like https://github.com/microsoft/guidance so that if an LM decides to call an API, it sticks to a template (and then maybe could expand on that)
  • Would local LLMs in the future be able to run an Ai powered single player roleplaying adventure game in a customized world?
    3 projects | /r/LocalLLaMA | 26 May 2023
    I am fond of Microsoft Guidance: https://github.com/microsoft/guidance/ which allows you to have highly structured conversations with many different LLMs. Your Python code can jump in and modify the conversation at any time, allowing your program to easily inject tool usage into the conversational chain. I recommend reading each example very carefully.
  • Does anyone use caching of openAI calls?
    2 projects | /r/aipromptprogramming | 26 May 2023
    I use Microsoft Guidance for this. https://github.com/microsoft/guidance
  • Lessons from Creating a VSCode Extension with GPT-4
    2 projects | news.ycombinator.com | 25 May 2023
    "Prompt engineer" didn't exactly make sense to me until a coworker (graphic design) talked about the prompts that he'd see in Midjourney's discord server. Particularly when he mentioned specifications around camera lenses and perspective and other things I'm not familiar with. Very specific choices, continuing to be added and refined.

    Then seeing what guidance[0] is intended to do (LLM-prompt templating) it becomes obvious what people have in mind for this. It won't obviate understanding the lower-level code -- in fact, I expect the value of that skill to increase over time as fewer people bother to learn it -- but it will cut out the time it takes to scaffold an application.

    [0] https://github.com/microsoft/guidance

  • Ideas for extensions?
    4 projects | /r/Oobabooga | 24 May 2023
    give me https://github.com/microsoft/guidance - would be a heavy upgrade for ooba
  • QLoRA: Efficient Finetuning of Quantized LLMs
    6 projects | news.ycombinator.com | 24 May 2023
    This is off-topic, but are there any communities or congregations (that aren't reddit) based around locally hosted LLMs? I'm asking because while I see a bunch of projects for exposing GGML/LLaMA to OpenAI compatible interfaces, some UIs, etc, I can't really find a good community or resources for the concept in general.

    I'm working on a front-end for LLMs in general, having re-implemented a working version of OpenAI's code interpreter "plugin" already within the UI, and support for the wealth of third-party OpenAI plugins (I've been testing with the first diagram plugin I found, it works well.) I'm planning to open source it once my breaking changes slow down.

    This field moves very fast, I'm looking for feedback (and essentially testers/testing data) on what people want, and looking for prompts/chat logs/guidance templates (https://github.com/microsoft/guidance) for tasks they expect to "just work" with natural language.

    Instead of being limited by the monetization for ChatGPT Plus (and limited number of messages every four hours) for extensibility within a chat interface, I want to open it and free it, with a Bring-Your-Own-LLM setup.

  • GitHub - microsoft/guidance: A guidance language for controlling large language models.
    2 projects | /r/aigamedev | 24 May 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 3 Jun 2023
    Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →

Stats

Basic guidance repo stats
54
8,704
9.7
5 days ago
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com