instant-ngp VS instant-meshes

This is really cool! Could you now use something like this to turn the new images in a 3d model? Or even use open pose (controlnet) to generate a bunch of images from different angles and use InstantNeRF to make a 3d model for free!

It is at this point that you should have Instant-NGP setup. The script for the COLMAP processing is in the repo, as well as the steps to perform it. My exact parameters were 3 fps and 16 aabb. It is pretty helpful to add the scripts directory into path for exact access system-wide.

[Project Page] https://nvlabs.github.io/instant-ngp/

instant-ngp ([1]) from NVIDIA can render NeRF in VR in real-time, assuming a very good desktop video card. Note that instant-ngp is not as photo-realistic as Zip-NeRF. But it's still very good!

1. https://github.com/NVlabs/instant-ngp

Playing around with neRF AI (https://github.com/NVlabs/instant-ngp) to create some 3d gear reveals. I think this a fun way to show off a kit, what do you think?

3 not sure if it's the one you want but the -aabb_scale is a crop. This page recommends trying a large value of 128 for some outdoor scenes: https://github.com/NVlabs/instant-ngp/blob/master/docs/nerf_dataset_tips.md

I don't know about lumalabs, but basically all NeRF projects these days are based on NVIDIAs Instant neural graphics primitives ( GitHub: instant-ngp). It utilizes COLMAP for SfM (preprocessing step for the neural network) and runs on average Geforce cards pretty good. The fox example (50 photos) on their page literally takes 5 seconds to complete.

there’s a free Windows program called instant meshes that’ll do it.

It sounds like you want better automatic retopology methods. There's Instant Meshes, which is decent, and Retopoflow, which is very good, but not automatic and not free. There's nothing that's fully automatic that's completely satisfactory, though.

Maybe checkout Instant Meshes for retopo?

There are other useful things available on Linux too— I use Substance 3D Painter from Steam for texturing, Krita for concept art and retouching, and this neat little tool for retopology. Again, nothing you can't get on Windows too, but it's so you know what you count with. You get a stable and reliable OS, full desktop customization to make it fit your own workflow, and a cool community in exchange. Whether that much is worth the tradeoffs depends on you.

Exactly. Run it through https://github.com/wjakob/instant-meshes then extract a normal map.

To be quite frank, you haven't really given quite enough context at all, but going out on a limb here the most common culprit of 3d files being too big is that they have an unreasonable amount of polygons. you can fix this by using the remesh tool/modifier (which will likely require some smoothing in the sculpt tab afterward) or using the decimate modifier. additionally if you're willing to use a secondary program, you could try a re-topology program such as instant mesh which is free, small, and the most clean & efficient at what it does, but if you aren't going to be doing 3d work often, its not necessary. After your poly count is low enough, export it as an OBJ or FBX file, and you should be good to go.

I’d switch to zbrush for this and project this mesh onto an already topology-correct one. If you don’t want/can’t use zbrush, and you’re out of options you might as well just give instant-meshes a try as it’s a free tool. I had somewhat successful results https://github.com/wjakob/instant-meshes

Instant meshes (https://github.com/wjakob/instant-meshes) is a free software that is very good at remeshing while preserving details