Interactive-LLM-Powered-NPCs
codeinterpreter-api
| Interactive-LLM-Powered-NPCs | codeinterpreter-api | |
|---|---|---|
| 3 | 10 | |
| 449 | 3,701 | |
| - | - | |
| 6.9 | 8.7 | |
| 3 months ago | about 1 month ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Interactive-LLM-Powered-NPCs
-
AI: Startup vs Incumbent Value
It is different this time, though. Take a look at this open source project.[1]
This is a system which lets you talk to NPCs in video games. It's a collection of off the shelf components held together by some Python code. The components do this:
- Listen to the user talking and convert speech to text.
- Watch the user's facial expressions via webcam.
- Watch the game, and use face recognition on the game images to determine what character is being addressed.
- Run the user's text through a LLM preloaded with about 30 lines of info about the NPC to generate a reply.
- Generate voice output in a voice generated to match the character's persona.
- Modify the image of the character on screen to animate their facial expressions to match the voice output. This is done on the output image, not by animating the 3D character.
Five years ago, that was science fiction. A year ago, half that stuff wouldn't work right. Now it's someone's hobby project.
[1] https://github.com/AkshitIreddy/Interactive-LLM-Powered-NPCs
- LLM Powered NPCs: Enabling Dynamic Dialogue with LLM-Powered NPCs in Any Game
- Talk to GPT-4 Powered NPCs in your Favorite Games!
codeinterpreter-api
-
Ask HN: Tell us about your project that's not done yet but you want feedback on
This is very cool! I just downloaded the extension and tried a hello world program. Will tinker a bit more.
If you can make a library to run python code inside a JS project (like Next JS) then we could build a code interpreter in Next JS. Would be super cool. Here is a python implementation - https://github.com/shroominic/codeinterpreter-api - for your reference.
- ✨Introducing: Code Interpreter API an Open Source implementation of the ChatGPT Code Interpreter using LangChain Agents🤖
- Introducing Code Interpreter API: An Open source implementation of the ChatGPT Code Interpreter 👾
- Open source implementation of the ChatGPT Code Interpreter 👾
- (Unofficial) Code Interpreter API
- OpenAI Code Interpreter API
What are some alternatives?
GPT-HTN-Planner - A Hierarchical Task Network planner utilizing LLMs like OpenAI's GPT-4 to create complex plans from natural language that can be converted into an executable form.
RasaGPT - 💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram
agents - An Open-source Framework for Autonomous Language Agents
gpt-code-ui - An open source implementation of OpenAI's ChatGPT Code interpreter
voxelgpt - AI assistant that can query visual datasets, search the FiftyOne docs, and answer general computer vision questions
ChatPDF - Chat with any PDF. Easily upload the PDF documents you'd like to chat with. Instant answers. Ask questions, extract information, and summarize documents with AI. Sources included.
E2B - Secure cloud runtime for AI apps & AI agents. Fully open-source.
Chrome-GPT - An AutoGPT agent that controls Chrome on your desktop
ACE_Model_Implementation - A python implementation of Dave Shap's ACE Model
langchain-visualizer - Visualization and debugging tool for LangChain workflows
PyMera - an application that track your face
InternGPT - InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)