FaceFusion VS ai-town

There's no mitigation, the technology is out there for anyone to use:

https://github.com/facefusion/facefusion

Together with diffusion models we better get used to not take a video for proof that something happened. The way we already don't trust photos, because it's has been trivial to make convincing face swaps with Photoshop for a long time.

just download https://github.com/facefusion/facefusion . it very easy to use and results are amazing if face is not full screen. And with coqui_tts you can clone anyones voice form 10-20 second audio. Deepfakes got very dangerous already. Roop (Facefuiosn) also works real-time via webcam (rtx 3060 can easily handle it) Frankly it's kinda scary already. I gues in 12-20 months quality of that stuff will dramatically improve and even on 4k footage, it will be impossible to spot deepfake for 90% of population.

Oh oh one more thing I don't know if yourall familiar with the AI town paper: https://github.com/a16z-infra/ai-town My mobile game is aiming to leverage something similar, and I've also developed a framework around it .... anyone interested in using LLM to put your storyline in steroid? Essentially, you write the story, and LLM helps the characters speak and make decisions, so you don't have to write the dialogue. At least, that's what I'm going for.

If the surge of indie game popularity has shown anything, it's that games can be 8-bit hot messes but still touted as visual masterpieces as long as there's a decent global lighting engine somewhere in the mix.

I think, as you say, AI will be the next paradigm for gamers, and having specialised chips on these GPUs that can turn a scripted NPC story-based interaction into a do-what-you-want-under-these-contraints a la "AI town"[1] might keep them in business a little longer before they have to start upping the visuals again.

1: https://github.com/a16z-infra/ai-town

Emotion Queries, Player Guardrails, etc. - in a simple small API & server

We have a demo game that we made (https://github.com/game-kings/detective), and a demo video (https://www.youtube.com/watch?v=VSqIzjOk5p4).

The demo game is a murder mystery set in Gold Rush era San Francisco. It includes a somewhat novel scoring mechanism at the end where your ability as a detective is scored based on cosine similarity between the embeddings of your explanation and ours.

We showed this to some friends of ours and, despite it frankly being an extremely hacked together game, they thought it surprisingly fun. This makes us really excited for what kinds of games are possible with tools like this.

We know there’s some similar prior art in this category but we think this still has a lot to offer.

The open-source work like GPTeam (https://github.com/101dotxyz/GPTeam) or ai-town (https://github.com/a16z-infra/ai-town) is mostly geared towards recreations of the Sims, and are not as general purpose as our framework.

There are commercial offerings like InworldAI, but I think our framework exists in a different space - we support Local AI out of the box, and hope this is the direction that gaming goes in. I don’t really want to start paying a subscription for every single-player game in the future. While we wait for chips to get cheaper and open-source models to get better, using GPT-3.5 or GPT-4 produces pretty similar if not better results than commercial offerings.

Of course, our project isn't perfect, isn’t feature-complete and definitely isn’t polish-complete. After showing it to our friends, we realized we need release early to get early feedback from others. We want to make this great and empower open-source LLM gaming in the future. We would love to hear your feedback.

We know for sure that some of you are much more creative storytellers than we are, and we can’t wait to see what you come up with!

Have fun!

incredible job @ykhli! thank you for the fal.ai mention on the stack! https://github.com/a16z-infra/ai-town#stack

for anyone eager to generate their own simulation head to https://serverless.fal.ai/lora to create your own pixel art game characters