RobustVideoMatting VS rembg

Robust Video Matting/Background Remover (Remove Background from images and videos, useful for compositing) https://github.com/PeterL1n/RobustVideoMatting (RVM - Remove backgrounds from videos) https://github.com/nadermx/backgroundremover (BackgroundRemover - works well on single images) -------VOICE GENERATION--------

Looks like runway is packaging a bunch of AI tools like stable diffusion and other opensource tools into a paid package. The matting tools it is using looks like this tool https://github.com/PeterL1n/RobustVideoMatting which can be run off your computer for free if you can figure out the geeky side of installing this stuff. I've tried it out and it sometimes works well but most of the time the results aren't as good as the examples on their github. Still a good tool to have in the toolbox though.

OR this separate application looks promising, if you can work out Google Collab (I couldn't unfortunately): https://github.com/PeterL1n/BackgroundMattingV2 https://github.com/PeterL1n/RobustVideoMatting

I have done a bit of coding and I will use pretrained models only. Looking at things like depth and segmentation. Like this as an example. I am using it on a collab now but its so cumbersome. https://github.com/PeterL1n/RobustVideoMatting

I do not know much about Machine learning, and I am not sure if I can ask question here. But if yes, I need help with either choosing best libraries to do Video Editing like Background Removal and similar. Some of the ones that I found is RVM: https://github.com/PeterL1n/RobustVideoMatting (which currently seems like the best choice)

First of all I would ask if somebody retrained Robust Video Matting model on own data? I am trying to, but with all the models I end up getting bad quality result as the ones attached to the post. So my data is some objects rotating on 360 and with white backgrounds, The task seems to be pretty simple as the model just has to remove white bgr and keep colorized object. I have masks on every 10th frame of my videos. The masks are 0 - bgr, 255 - fgr. I have tried Robust Video Matting model, MODNet, PaddleSeg and several segmentation models and every of them failed to show consistent results on that data. What should I do in the case?

I have found a github with a project like this but it is tedious to use: https://github.com/PeterL1n/RobustVideoMatting

A bit conflicted as the linked video is also linked from the actual rembg repo but it seems way faster and more detailed to just read the readme at that repo first, and maybe use a video if something doesn’t make sense.

There are open source tools like rembg (https://github.com/danielgatis/rembg) which call into pre-trained models.

You can use Rembg extension to remove background automatically: https://github.com/danielgatis/rembg

Hi guys 📷 I am new to ml deployment. Can anyone help about production deployment ? I made fastapi docker app which removes background from image (https://github.com/danielgatis/rembg). It uses u2net segmentation. I tried aws ec2, lambda, googld cloudrun and so far ec2(t2-large) is the fastest but still too slow. Also, it costs way more than I expected. Are there any other solution that I can deploy ml app with as low as possible? Where do you guys mostly deploy ml app?

I am currently using rembg https://github.com/danielgatis/rembg

rembg

A python script with rembg could work

4.) rembg -- backgrounds be gone. If there isn't an extension in Automatic1111 for this yet, there should be (I haven't checked recently). Same deal as midas, you can point it at a folder and zap the backgrounds off of all your images. Useful in combo with midas and imagemagick if, for instance, you want images of an object on a white background (Stable Diffusion training via LoRAs/Dreambooth may not benefit, but other things like GANs prefer that sort of training image). Useful if you want to "compose" a scene and you have images of dispirate objects/people you want in that scene.

Ran into another issue with " LoadLibrary failed with error 126 Here's the solution: https://github.com/danielgatis/rembg/issues/312