instant-ngp
awesome-NeRF
Our great sponsors
instant-ngp | awesome-NeRF | |
---|---|---|
147 | 18 | |
15,260 | 6,205 | |
1.8% | 2.2% | |
6.7 | 7.2 | |
14 days ago | 9 days ago | |
Cuda | TeX | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
instant-ngp
-
Mind-blowing results (LORA/Checkpoint mix)
This is really cool! Could you now use something like this to turn the new images in a 3d model? Or even use open pose (controlnet) to generate a bunch of images from different angles and use InstantNeRF to make a 3d model for free!
-
[D] NeRF, LeRF, Prolific Dreamer, Neuralangelo, and a lot of other cool NeRF research
[Code] https://github.com/NVlabs/instant-ngp
[Project Page] https://nvlabs.github.io/instant-ngp/
-
Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields
instant-ngp ([1]) from NVIDIA can render NeRF in VR in real-time, assuming a very good desktop video card. Note that instant-ngp is not as photo-realistic as Zip-NeRF. But it's still very good!
-
Do you think neural rendering ready in production?
We know that a lot of project with NERF, include (instant-ngp) https://github.com/NVlabs/instant-ngp or kaolin-wisp (https://github.com/NVIDIAGameWorks/kaolin-wisp)
-
I know reflective surfaces are a no go, but how can this be done? 2 pics are from Metashape and 2 are from RC. Zero are good enough.
https://developer.nvidia.com/blog/getting-started-with-nvidia-instant-nerfs/ https://github.com/NVlabs/instant-ngp
Try using NeRFs like: - Lumalabs AI: https://lumalabs.ai/ - Nerfstudio (google colab or download it) - Nvidia instant NeRFs: https://github.com/NVlabs/instant-ngp
- NVIDIA NeRF installation?
-
How to create virtual view/360 type view from known cameras?
I'd recommend starting with NVIDIA's "Instant Neural Graphics Primitives": https://github.com/NVlabs/instant-ngp because it trains the NeRF in seconds (it sped up the state of the art by like 10,000x. It's insane fast)
-
Game development is about to go wild with AI
There is https://github.com/NVlabs/instant-ngp that can do it.
awesome-NeRF
-
Nvidia NeRF
https://github.com/yenchenlin/awesome-NeRF watch and learn from this page!
-
Nvidia Research Turns 2D Photos into 3D Scenes in the Blink of an AI
There is an explosion of NeRF papers:
https://github.com/yenchenlin/awesome-NeRF
It's possible to capture video / movement to into NeRFs, possible to animate, relight, compose multiple NeRF scenes, and a lot of papers are about making faster more efficient and higher quality NeRF. Looks very promising.
-
Real-Time Coherent 3D Reconstruction from Monocular Video
Neural Radiance Fields are getting more impressive:
First one was this but it was slow: https://www.matthewtancik.com/nerf
Then it's got faster: https://www.youtube.com/watch?v=fvXOjV7EHbk
Lot of interesting papers:
-
The future of photogrammetry. NeRF : Neural Radiance Fields
Yes. NERF estimates both volume and color for a point in space so by stepping through the volume at a certain resolution you can extract the mesh. The crazy thing is that although the NERF paper was only published in 2020 it's already old hat as it inspired a flood of papers which came after it. See https://github.com/yenchenlin/awesome-NeRF. One of the most interesting papers I think is https://alexyu.net/plenoxels/?s=09 which talks about building radiance fields with just classical optimization, i.e. no neural nets and which claims to be much faster to converge i.e. minutes vs days. Not used in any photogrammetry software yet as far as I know but potentially exciting for the future.
- HyperNeRF
- Nvidia Canvas
What are some alternatives?
tiny-cuda-nn - Lightning fast C++/CUDA neural network framework
nerf-pytorch - A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.
TensoRF - [ECCV 2022] Tensorial Radiance Fields, a novel approach to model and reconstruct radiance fields
colmap - COLMAP - Structure-from-Motion and Multi-View Stereo
instant-meshes - Interactive field-aligned mesh generator
instant-ngp-Windows - Instant neural graphics primitives: lightning fast NeRF and more
nerf - Code release for NeRF (Neural Radiance Fields)
svox2 - Plenoxels: Radiance Fields without Neural Networks
Meshroom - 3D Reconstruction Software
agi2nerf - Simple tool for converting Agisoft XML files to NERF JSON files for https://github.com/NVlabs/instant-ngp
stable-diffusion-webui - Stable Diffusion web UI
frigate - NVR with realtime local object detection for IP cameras