mediapipe
AI4Animation
Our great sponsors
mediapipe | AI4Animation | |
---|---|---|
49 | 11 | |
25,405 | 7,273 | |
2.1% | - | |
9.9 | 5.3 | |
5 days ago | 6 months ago | |
C++ | C++ | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mediapipe
-
Mediapipe openpose Controlnet model for SD
mediapipe/docs/solutions/pose.md at master · google/mediapipe · GitHub
-
MEDIAPIPE on-device diffusion plugins for conditioned text-to-image generation
Today, we announce MediaPipe diffusion plugins, which enable controllable text-to-image generation to be run on-device. Expanding upon our prior work on GPU inference for on-device large generative models, we introduce new low-cost solutions for controllable text-to-image generation that can be plugged into existing diffusion models and their Low-Rank Adaptation (LoRA) variants.
-
Running a TensorFlow object detector model and drawing boxes around objects at 60 FPS - all in React Native / JavaScript!
You can just grab the TFLite version! https://github.com/google/mediapipe/blob/master/docs/solutions/models.md
-
OpenAI came after our domain because we use GPT in it
I believe Google already released transformers under an apache 2 license with a patent grant:
https://github.com/google/mediapipe/blob/master/mediapipe/mo...
-
Open source Background Remover: Remove Background from images and video using AI
I was going to say that I like the MediaPipe Selfie Segmentation model for doing this sort of thing in a web page, but I've just noticed (when getting the GitHub link[1]) that Google have marked the code as legacy[2] ... no idea if the new solution is better/easier to use[3].
For what it's worth, my CodePen using the old model is here: https://codepen.io/kaliedarik/pen/PopBxBM
[1] - https://github.com/google/mediapipe/blob/master/docs/solutio...
[2] - "Attention: Thank you for your interest in MediaPipe Solutions. As of April 4, 2023, this solution was upgraded to a new MediaPipe Solution."
[3] - https://developers.google.com/mediapipe/solutions/vision/ima...
-
[P] Pattern recognition
I have used mediapipe very successfully in multiple projects and it's very easy to get running. You can choose from many different vision tasks including hand landmarks ( https://github.com/google/mediapipe/blob/master/docs/solutions/hands.md )
-
Getting face feature pose statistics
I found MediaPipe's Face Mesh and was impressed with how simple it was to get going, but it just gives you the landmark points and I've not gone any further yet.
-
New ControlNet Face Model
We've trained ControlNet on a subset of the LAION-Face dataset using modified output from MediaPipe's face mesh annotator to provide a new level of control when generating images of faces.
-
Trained an ML model using TensorFlow.js to classify American Sign Language (ASL) alphabets on browser. We are creating an open-source platform and would love to receive your feedback on our project.
Medipaipe library link: https://mediapipe.dev/
-
mediapipe VS daisykit - a user suggested alternative
2 projects | 24 Mar 2023
AI4Animation
-
[Request] Implementation of DeepPhase: Periodic Autoencoders for Learning Motion Phase Manifolds
Hi all, I've been around this scene since 2014 and we've seen some incredible mods over the years. If anyone is familiar with the AI scene recently, you may have came across a paper called DeepPhase which allows for fully procedural, unique animations in realtime. It's a long shot, but is anyone here familiar with the animation pipeline for Skyrim - and whether it would be even feasible to implement this paper into the game? This is just theorycrafting or spitballing an idea, but I'd love to have a discussion here!
- AI4Animation: Deep Learning for Character Control
- IDEA/Suggestion: Module for 3D agnostic movement? Seems like something interesting to be incorporated into the 3D modules available
-
Nvidia PhysX 5.0 is now open source
character motion being the same old animations, just done/interpolated better
the only advancement I know of which got close to be implemented in games is https://github.com/sebastianstarke/AI4Animation (I think Sebastian worked with EA or some other big company at some point) - still haven't played anything using this though
- Ubisoft inspired "Motion matching"
- Ai animation in UE5?
- I'm Addicted to Assets
-
Motion Matching help
Here's the paper for one of them: Phase Function Neural Networks. In the paper you can also find names of other algorithms and look up their associated papers. The reason I single out this one is because the author also uploaded their original Unity implementation.
-
I know it ain't much compared to the rest of the work on this page, but I'm honestly proud of the little bit I've gotten done. I learned how to use Unity's animation system in about 30 mins last night. I love how easy it is to use! Just working on finding some survival/rpg animations now :)
(bonus: here's an excellent and comprehensive gdc talk from ubisoft going over their tech and how it helped them address the insane complexity in their assassin's creed games. second bonus: the guys that did that basketball demo in the 2 minute papers video have their work in a github repo, if you're feeling spry)
- AI4Animation: Deep Learning, Character Animation, Control
What are some alternatives?
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
deep-motion-editing - An end-to-end library for editing and rendering motion of 3D characters with deep learning [SIGGRAPH 2020]
ue4-mediapipe-plugin - UE4 MediaPipe plugin
Unity-Robotics-Hub - Central repository for tools, tutorials, resources, and documentation for robotics simulation in Unity.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
unity-atoms - ⚛️ Tiny modular pieces utilizing the power of Scriptable Objects
AlphaPose - Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System
SplineMesh - A Unity plugin to create curved content in real-time with bézier curves
BlazePose-tensorflow - A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".
awesome-ai - Awesome list for all things AI, ML and deep learning
jeelizFaceFilter - Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).
PhysX - NVIDIA PhysX SDK