guidance VS AGiXT

This IS Microsoft Guidance, they seem to have spun off a separate GitHub organization for it.

https://github.com/microsoft/guidance redirects to https://github.com/guidance-ai/guidance now.

... and it sets the value of "armor" to "leather" so that you can use that value later in your code if you wish to. Guidance is pretty powerful, but I find the grammar hard to work with. I think the idea of being able to upload a bit of code or a context-free grammar to guide the model is super smart.

https://github.com/microsoft/guidance/blob/d2c5e3cbb730e337b...

Here's one thing I don't get.

Why all the rigamarole of hoping you get a valid response, adding last-mile validators to detect invalid responses, trying to beg the model to pretty please give me the syntax I'm asking for...

...when you can guarantee a valid JSON syntax by only sampling tokens that are valid? Instead of greedily picking the highest-scoring token every time, you select the highest-scoring token that conforms to the requested format.

This is what Guidance does already, also from Microsoft: https://github.com/microsoft/guidance

But OpenAI apparently does not expose the full scores of all tokens, it only exposes the highest-scoring token. Which is so odd, because if you run models locally, using Guidance is trivial, and you can guarantee your json is correct every time. It's faster to generate, too!

Perhaps something as simple as stating it was first built around OpenAI models and later expanded to local via plugins?

I've been meaning to ask you, have you seen/used MS Guidance[0] 'language' at all? I don't know if it's the right abstraction to interface as a plugin with what you've got in llm cli but there's a lot about Guidance that seems incredibly useful to local inference [token healing and acceleration especially].

[0]https://github.com/microsoft/guidance

LangChain is just too much, personal solutions are great, until you need to compare metrics or methodologies of prompt generation. Then the onus is on these n-parties who are sharing their resources to ensure that all of them used the same templates, they were generated the same way, with the only diff being the models these prompts were run on.

So maybe a simpler library like Microsoft's Guidance (https://github.com/microsoft/guidance)? It does this really well.

I am unclear on the status of the project but here is the conversation that seem to be tracking it: https://github.com/microsoft/guidance/discussions/201

Let's have a subreddit about Guidance!

You should look at guidance for an LLM to fill out a template. Define the output data structure and provide the real estate listing in the context (see the JSON template example here https://github.com/microsoft/guidance)

If you are more interested in AI assistants check out AGiXT. It has some really cool features but it is under heavy development. Not everything works jet and updates break sometimes already working functions. But it is still far better than babyAGI and other proof of concepts.

That's exactly my goal right now too! I have been trying to figure out how to use AGiXT agents to read and write to an "Adventurer's Log" text file to try to mimic a long term memory but honestly I'm not good enough with any of this to get it working yet. The idea I've got rn is that there'd be a DM agent which takes your input and then there'd be "memory" agents which would check text files such as "Adventurer's Log" and "Character Interactions/Relationships" to keep a contiguous understanding of what each character has done, who they've met, what they've been told/haven't been told by certain characters about their motivations. I'm sure there's someone *much* more talented than me working on this already, at this point I've sort of given up on the idea and I'm just waiting for someone to come out with a Tavern style interface where I can paste in world details and character details and just get going!

AGiXT: A Python package for AGI research.

Even if my (for example, privateGPT) LLM is glacially slow I'd still love to be able to say "Mr Holmes, have Mrs Doubtfire verb the data object in order to verb a product for me, please." (eg: analyse the wikipedia article on the peace of westfalia in order to ELI5 a short summary of it). Hopefully she'd crunch away at the data, and at my convenience, I could have her brief me on her conclusions. I'm sure folks here would do something more clever using AGiXT, or having the old girl prepare lesson-plans for Mycroft to deliver (I just think that sort of thing is world-changing-bonkers for anyone wanting to learn anything, perhaps for kids one day), but I'd have to work up to that.

Keep an eye on this project as well. https://github.com/Josh-XT/AGiXT

File upload and automatic agents. It exists it is just buggy. They are working at an insane pace building it. It is practically broke 90% of the time. Maybe it's working better right now. I had success with v1.1.31 as well. https://github.com/Josh-xt/AGiXT

Maybe you want to check out josh-xt/AGiXT it has its roots in langchain so you can see what the prompts look like and the code. They have made a lot of tools as well although you are going to have issues getting it to work. The newest version kinda works and version 1.1.31 I had the fast API backend working. Maybe you can help them out. They need more people to show them bugs. https://github.com/Josh-XT/AGiXT

https://github.com/Josh-XT/AGiXT I have tested this one and it is pretty much the same as AgentGPT, supports many providers + many local models (you can even make it work with oobabooga api which is pretty easy), don’t wait for insane results, the problem right now is context length with the local models, probably going to be an old issue in a few weeks we hope ;)