Insta-DM
Depth-Anything
| Insta-DM | Depth-Anything | |
|---|---|---|
| 1 | 6 | |
| 221 | 5,701 | |
| - | - | |
| 0.0 | 8.0 | |
| 10 months ago | 22 days ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Insta-DM
-
Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistency
The official PyTorch code is available here: https://github.com/SeokjuLee/Insta-DM
Depth-Anything
-
Video generation models as world simulators
Depth estimation improved a lot as well e.g. with Depth-Anything [0]. But those are mostly relative depth instead of metric. Also when even converted to metric they still seems have a lot of pointclouds at the edges that have to be pruned - visible in this blog [1]. Looks like those models trained on Lidar or Stereo depthmaps that has this limitations. I think we don't have enough clean training data for 3d unless we maybe train on synthetic data (then we can have plenty, generate realistic scene in Unreal Engine 5 and train on rendered 2d frames)
[0] https://github.com/LiheYoung/Depth-Anything
[1] https://medium.com/@patriciogv/the-state-of-the-art-of-depth...
-
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data
Very interesting work! More details here: https://depth-anything.github.io/
It seems better overall and per parameter than current work, with relative and absolute measurement.
Is there any research people are aware of that provides sub-mm level models? For 3D modeling purposes? Or is "classic" photogrammetry still the best option there?
- FLaNK Stack 29 Jan 2024
What are some alternatives?
OpenSeeFace - Robust realtime face and facial landmark tracking on CPU with Unity integration
ZoeDepth - Metric depth estimation from a single image
MiDaS - Code for robust monocular depth estimation described in "Ranftl et. al., Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer, TPAMI 2022"
Weaviate - Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.