instant-ngp VS stable-dreamfusion

This is really cool! Could you now use something like this to turn the new images in a 3d model? Or even use open pose (controlnet) to generate a bunch of images from different angles and use InstantNeRF to make a 3d model for free!

It is at this point that you should have Instant-NGP setup. The script for the COLMAP processing is in the repo, as well as the steps to perform it. My exact parameters were 3 fps and 16 aabb. It is pretty helpful to add the scripts directory into path for exact access system-wide.

[Project Page] https://nvlabs.github.io/instant-ngp/

instant-ngp ([1]) from NVIDIA can render NeRF in VR in real-time, assuming a very good desktop video card. Note that instant-ngp is not as photo-realistic as Zip-NeRF. But it's still very good!

1. https://github.com/NVlabs/instant-ngp

Playing around with neRF AI (https://github.com/NVlabs/instant-ngp) to create some 3d gear reveals. I think this a fun way to show off a kit, what do you think?

3 not sure if it's the one you want but the -aabb_scale is a crop. This page recommends trying a large value of 128 for some outdoor scenes: https://github.com/NVlabs/instant-ngp/blob/master/docs/nerf_dataset_tips.md

I don't know about lumalabs, but basically all NeRF projects these days are based on NVIDIAs Instant neural graphics primitives ( GitHub: instant-ngp). It utilizes COLMAP for SfM (preprocessing step for the neural network) and runs on average Geforce cards pretty good. The fox example (50 photos) on their page literally takes 5 seconds to complete.

Who is working on it? I've seen a few other models that do this, like Stable-Dreamfusion.

I haven't tried Stable-DreamFusion, but it might be able to take an input image along with a prompt?

similar to Magic3D and Dreamfusion / Stable-Dreamfusion, but this one looks a lot more vivid and detailed!

I've seen a few "text-to-3D" models that use Stable Diffusion. Zero-1-to-3 and Stable-DreamFusion appear to be capable of generating 3D models from text prompts.

Ever heard of Stable Dreamfusion ? Open source text to 3D mesh model

I followed the steps in this repo. They added my turtle as an example to the repo after their latest improvements. https://github.com/ashawkey/stable-dreamfusion

There is an (independent?) implementation here, released last week to 0.1, but it already has a 100 issues.

But there's stable-dreamfusion, still not good but you could try it.

Dreamfusion -- text-to-3d seems like it could be useful here: https://dreamfusion3d.github.io/ (once successfully opensourced, see https://github.com/ashawkey/stable-dreamfusion)

Rigging also looks like it could have a decent AI/DNN solution: https://arxiv.org/pdf/2005.00559.pdf