OpenSeeFace
openseeface-gd
Our great sponsors
OpenSeeFace | openseeface-gd | |
---|---|---|
7 | 13 | |
1,312 | 32 | |
- | - | |
4.2 | 0.0 | |
2 months ago | over 1 year ago | |
Python | GDScript | |
BSD 2-clause "Simplified" License | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
OpenSeeFace
-
Getting face feature pose statistics
I got something working modifying OpenSeeFace and it's an option and I might try to rewrite it in something compiled, but I'd like to look at the other options first.
-
This may be a silly question but can I hire someone to make me a customized avatar for vr chat?
Lastly, face tracking is either built in or uses a plugin device. You would also use OSC to manipulate blendshapes. I'd take a look at Opens Face.
-
Any recommendations for VTuber setup on Linux? Ideally something that's completely open source.
Th best/only options I found were basically the old standby of Wine running closed source applications. Even then the end result was rather incomplete... because may of the best tracking options are simply closed source. (Note: Vseeface does offer an open source library)
- Running OpenSeeFace on Linux with python 3.10
-
Open map with gaze tracking for someone with paralysis
There are only a few libraries that come to mind but take a bit of work to get started. MediaPipe Unity Plugin has eye tracking with a whole lot of types of tracking(head, hands, body). OpenSeeFace has models that do head and eye tracking. This repo uses Unity's neural net inference library, Barracuda, to run a MediaPipe iris landmark model (I haven't personally tested this library). Not sure how to translate eye landmarks to the position a player is looking at in a screen though. Hopefully this list of libraries gets you on the right path!
-
I'm going to try to use VSeeFace again, is there a way to change how lip syncing works?
OpenSeeFace is open source. If you are using it with VSeeFace, you can just replace the Binary folder with your own build.
-
I'm making a renderer for facetracking data
It uses OpenSeeFace for facetracking and engine patches/vrm code from the V-Sekai team.
openseeface-gd
-
Running OpenSeeFace on Linux with python 3.10
VSeeFace hasn't been made for Linux, but OpenSeeFace, the face tracker, is open-source and runs on linux using Python. And we use it to use other face tracking apps relying on OpenSeeFace, like Vtube Studio, Pupeteer / OpenSeeFace-GD
-
Error loading resources from system!
Contrary to what others are saying, you can load things from outside the res:// or user:// directories in an exported project. This project loads assets from a resources folder at runtime (and this is verifiable by the fact that assets can be modified after export).
-
What's the status on vtube tracking software on Linux?
This might be a option for me: https://github.com/you-win/openseeface-gd
-
Help with making a flatpak
It's not mine, exactly, but I got permission from the dev to package it into a flatpak. The dev themself stated that if it was easier to package it as a flatpak, they would do it themselves, so I am trying to make it so all they have to do is drag n drop the OSF-GD files in and build the flatpak. Link is https://github.com/you-win/openseeface-gd
-
mac face tracking apps?
OpenSeeFace-GD is an open source multi-platform Vtuber rendering program written in Godot. It has pre-compiled builds for Windows and Linux but is 100% compatible with Mac (you will have to build the project yourself in Godot, which is free, as you can't build for MacOS without a Mac and Youwin doesn't have a Mac).
-
I integrated Spout with Godot via custom engine module! Free and open source, details in comments
I'm personally planning on integrating this into my project openseeface-gd in order to send scene data to OBS while having the controls open.
- how to implement live face filtering in obs studio
-
A new version of my 3d model face tracking application has released! Made with Godot 3.4
You can take a look at the codebase and see how the data is received and then applied
-
A sculpted Godette model (Blender 2.93 file) by Pablo Dobarro is FREE for download (link in the comment)
How long until some geeky girl in the free software community gives her a try and hooks her to the one, the only VTuber capture tool based on Godot? https://github.com/you-win/openseeface-gd
-
Finally mapped eyes/mouth tracking data onto a 3d model, code is open source! More info in comments
I've been working on OpenSeeFace GD for a few months now, and I can finally say I'm nearing completion in terms of usability.
What are some alternatives?
kalidokit - Blendshape and kinematics calculator for Mediapipe/Tensorflow.js Face, Eyes, Pose, and Finger tracking models.
vpuppr - VTuber application made with Godot 4
UniVRM - UniVRM is a gltf-based VRM format implementation for Unity. English is here https://vrm.dev/en/ . 日本語 はこちら https://vrm.dev/
VRM-Addon-for-Blender - VRM Importer, Exporter and Utilities for Blender 2.93 to 4.1
godot-proposals - Godot Improvement Proposals (GIPs)
VTuber_Unity - Use Unity 3D character and Python deep learning algorithms to stream as a VTuber!
fastT5 - ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
godot-3-demos - Dozens of free and open source demos for the Godot game engine, version 3. Head to the link below for newer demos for Godot 4+
transformer-deploy - Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
godot-open-rpg - Learn to create turn-based combat with this Open Source RPG demo ⚔