Would local LLMs in the future be able to run an Ai powered single player roleplaying adventure game in a customized world?

• guidance

  89 12,248 9.5 Jupyter Notebook

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

I am fond of Microsoft Guidance: https://github.com/microsoft/guidance/ which allows you to have highly structured conversations with many different LLMs. Your Python code can jump in and modify the conversation at any time, allowing your program to easily inject tool usage into the conversational chain. I recommend reading each example very carefully.

• guidance

  6 43 9.0 Jupyter Notebook

  A guidance language for controlling large language models. (by Maximilian-Winter)

There is also a fork to allow easy use with llama.cpp: https://github.com/Maximilian-Winter/guidance (use his matching llama-cpp-python fork as well). You can also use it with GPTQ for GPU-accelerated GPTQ-quantized models.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• agnai

  20 453 9.6 TypeScript

  AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.

  

For multiple characters, there have been tries out there so you can try copying from them (I practically am almost clueless about this topic, here is one of these tries) or you could also try making your own idea.

Suggest a related project