Our great sponsors
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
https://github.com/bluestyle97/awesome-3d-reconstruction-papers#single-view https://github.com/justimyhxu/awesome-3D-generation
You're looking into a problem called photogrammetry, and a well-studied one at that. I'd recommend looking into "shape from motion" (sfm); specifically techniques that do "dense reconstruction." I'd recommend COLMAP to start with. It does pose estimation from images (e.g. you point it at a bunch of images and it will figure out the relative poses of the cameras that took them), as well as sparse and dense reconstcution.
Another way to reconstruct the surfaces would be to use a NeRF system and rasterize the latent representation. Specifically, I'd recommend Instant Neural Graphics Primitives. It doesn't provide the best surface reconstructions (something like IDR or UniSurf is better suited) but it is extremely fast; up to 10,000x faster than those other projects I just mentioned. INGP also comes with a script to run COLMAP to generate the data it needs, so you don't need to provide anything more than images.
Related posts
- 3D reconstruction of an object from videos/few images
- [R] It’s wild to see an AI literally eyeballing raytracing based on 100 photos to create a 3d scene you can step inside ☀️ Low key getting addicted to NeRF-ing imagery datasets🤩
- Photogrammetry of tiny plants! Multi view reconstruction.
- Magic123: One Image to High-Quality 3D Object Generation
- Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields