Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 4 radiance-field Open-Source Projects
-
gaussian-splatting
Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"
-
OpenSplat
Production-grade 3D gaussian splatting with CPU/GPU support for Windows, Mac and Linux 🚀
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
XV3DGS-UEPlugin
A Unreal Engine 5 (UE5) based plugin aiming to provide real-time visulization, management, editing, and scalable hybrid rendering of Guassian Splatting model.
-
3DGS.cpp
A cross-platform, high performance renderer for Gaussian Splatting using Vulkan Compute. Supports ✅ Windows, Linux, macOS, iOS, and visionOS
Project mention: Show HN: Gaussian Splat renderer in VR with Unity | news.ycombinator.com | 2024-01-24Chris' post doesn't really give much background info, so here's what's going on here and why it's awesome.
Real-time 3D rendering has historically been based on rasterisation of polygons. This has brought us a long way and has a lot of advantages, but making photorealistic scenes takes a lot of work from the artist. You can scan real objects like photogrammetry and then convert to high poly meshes, but photogrammetry rigs are pro-level tools, and the assets won't render at real time speeds. Unreal 5 introduced Nanite which is a very advanced LoD algorithm and that helps a lot, but again, we seem to be hitting the limits of what can be done with polygon based rendering.
3D Gaussian Splats is a new AI based technique that lets you render in real-time photorealistic 3D scenes that were captured with only a few photos taken using normal cameras. It replaces polygon based rendering with radiance fields.
https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/
3DGS uses several advanced techniques:
1. A 3D point cloud is estimated by using "structure in motion" techniques.
2. The points are turned into "3D gaussians", which are sort of floating blobs of light where each one has a position, opacity and a covariance matrix defined using "spherical harmonics" (no me neither). They're ellipsoids so can be thought of as spheres that are stretched and rotated.
3. Rendering is done via a form of ray-tracing in which the 3D Gaussians are projected to the 2D screen (into "splats"), sorted so transparency works and then rasterized on the fly using custom shaders.
The neural network isn't actually used at rendering time, so GPUs can render the scene nice and fast.
In terms of what it can do the technique might be similar to Unreal's Nanite. Both are designed for static scenes. Whilst 3D Gaussians can be moved around on the fly, so the scene can be changed in principle, none of the existing animation, game engines or artwork packages know what to do without polygons. But this sort of thing could be used to rapidly create VR worlds based on only videos taken from different angles, which seems useful.
Project mention: Level of Gaussians: Real-Time View Synthesis for Square Meters | news.ycombinator.com | 2024-04-30[2] opensplat: https://github.com/pierotofy/opensplat
Project mention: Show HN: 3DGS.cpp – performant, cross platform Gaussian Splatting with Vulkan | news.ycombinator.com | 2024-03-17
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
radiance-field related posts
-
Level of Gaussians: Real-Time View Synthesis for Square Meters
-
CityGaussian: Real-Time High-Quality Large-Scale Scene Rendering with Gaussians
-
Show HN: Gaussian Splat renderer in VR with Unity
-
Bad accuracy after model training, Can someone help me ?
-
The initial work to get the gaussian-splatting training code working on AMD/ROCm has been done
-
Future Tech SD VR, 3D modeling, Movies, and Video Game Creation (Paper / Videos included)
-
Show HN: Real-Time 3D Gaussian Splatting in WebGL
-
A note from our sponsor - InfluxDB
www.influxdata.com | 10 Jun 2024
Index
What are some of the best open-source radiance-field projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | gaussian-splatting | 11,975 |
| 2 | OpenSplat | 663 |
| 3 | XV3DGS-UEPlugin | 415 |
| 4 | 3DGS.cpp | 356 |
Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com