Top 23 Python computer-graphic Projects

• pytorch-CycleGAN-and-pix2pix

  10 21,952 2.8 Python

  Image-to-Image Translation in PyTorch

Project mention: List of AI-Models | /r/GPT_do_dah | 2023-05-16

Click to Learn more...

• gaussian-splatting

  7 11,129 8.9 Python

  Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

  

Project mention: Show HN: Gaussian Splat renderer in VR with Unity | news.ycombinator.com | 2024-01-24

Chris' post doesn't really give much background info, so here's what's going on here and why it's awesome.

Real-time 3D rendering has historically been based on rasterisation of polygons. This has brought us a long way and has a lot of advantages, but making photorealistic scenes takes a lot of work from the artist. You can scan real objects like photogrammetry and then convert to high poly meshes, but photogrammetry rigs are pro-level tools, and the assets won't render at real time speeds. Unreal 5 introduced Nanite which is a very advanced LoD algorithm and that helps a lot, but again, we seem to be hitting the limits of what can be done with polygon based rendering.

3D Gaussian Splats is a new AI based technique that lets you render in real-time photorealistic 3D scenes that were captured with only a few photos taken using normal cameras. It replaces polygon based rendering with radiance fields.

https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/

3DGS uses several advanced techniques:

1. A 3D point cloud is estimated by using "structure in motion" techniques.

2. The points are turned into "3D gaussians", which are sort of floating blobs of light where each one has a position, opacity and a covariance matrix defined using "spherical harmonics" (no me neither). They're ellipsoids so can be thought of as spheres that are stretched and rotated.

3. Rendering is done via a form of ray-tracing in which the 3D Gaussians are projected to the 2D screen (into "splats"), sorted so transparency works and then rasterized on the fly using custom shaders.

The neural network isn't actually used at rendering time, so GPUs can render the scene nice and fast.

In terms of what it can do the technique might be similar to Unreal's Nanite. Both are designed for static scenes. Whilst 3D Gaussians can be moved around on the fly, so the scene can be changed in principle, none of the existing animation, game engines or artwork packages know what to do without polygons. But this sort of thing could be used to rapidly create VR worlds based on only videos taken from different angles, which seems useful.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• pix2pixHD

  6 6,515 0.0 Python

  Synthesizing and manipulating 2048x1024 images with conditional GANs

  

• BlenderProc

  15 2,536 8.5 Python

  A procedural Blender pipeline for photorealistic training image generation

  

• contrastive-unpaired-translation

  6 2,096 2.1 Python

  Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

• PIFu

  3 1,732 0.0 Python

  This repository contains the code for the paper "PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization"

• ICON

  6 1,540 4.1 Python

  [CVPR'22] ICON: Implicit Clothed humans Obtained from Normals

Project mention: ControlNet fully integrated with Blender using nodes! | /r/StableDiffusion | 2023-04-23

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• deep-motion-editing

  2 1,477 0.0 Python

  An end-to-end library for editing and rendering motion of 3D characters with deep learning [SIGGRAPH 2020]

• voca

  1 1,097 0.7 Python

  This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh. (by TimoBolkart)

• ECON

  2 1,020 5.2 Python

  [CVPR'23, Highlight] ECON: Explicit Clothed humans Optimized via Normal integration

Project mention: ECON: Explicit Clothed humans Optimized via Normal integration | /r/StableDiffusion | 2023-06-09

I think you forgot the content https://github.com/YuliangXiu/ECON

• talking-head-anime-3-demo

  4 854 0.0 Python

  Demo Programs for the "Talking Head(?) Anime from a Single Image 3: Now the Body Too" Project

Project mention: What would I use to create a chatbot but with an animated face of a man i created with Stable Diffusion - and also do it from my local pc, not any other websites etc. Anyone have any ideas on this? | /r/StableDiffusion | 2023-06-05

Talking Head. This is the visual of converting the image into an animated character. This is honestly the hard part. There's vmagicmirror for 3d model vrm/vroid characters. And for anime characters there's talking head anime 3 if you modify it a bit. But other than that there's basically nothing. Some online services can do it for you but not local/offline.

• clean-fid

  3 851 2.6 Python

  PyTorch - FID calculation with proper image resizing and quantization steps [CVPR 2022]

• tree-gen

  2 792 0.0 Python

  Procedural generation of tree models in blender

• anycost-gan

  1 767 2.5 Python

  [CVPR 2021] Anycost GANs for Interactive Image Synthesis and Editing

  

• APDrawingGAN

  1 756 0.0 Python

  Code for APDrawingGAN: Generating Artistic Portrait Drawings from Face Photos with Hierarchical GANs (CVPR 2019 Oral)

• Awesome-Game-Analysis

  1 715 9.3 Python

  a comprehensive collection of video game tech analysis resources

  

Project mention: A GitHub repo for collecting the tech analysis of video game | news.ycombinator.com | 2023-07-29

• GANSketching

  3 709 0.0 Python

  Sketch Your Own GAN: Customizing a GAN model with hand-drawn sketches.

• taichi-nerfs

  2 697 7.0 Python

  Implementations of NeRF variants based on Taichi + PyTorch

  

• BlenderNeRF

  3 663 5.0 Python

  Easy NeRF synthetic dataset creation within Blender

Project mention: Camera Track to NERF | /r/photogrammetry | 2023-04-20

Blender (use the SOF method on imported cameras, can be from anywhere that generates camera tracks): https://github.com/maximeraafat/BlenderNeRF

• DeepSIM

  3 418 1.8 Python

  Official PyTorch implementation of the paper: "DeepSIM: Image Shape Manipulation from a Single Augmented Training Sample" (ICCV 2021 Oral)

• vision-aided-gan

  3 365 0.0 Python

  Ensembling Off-the-shelf Models for GAN Training (CVPR 2022 Oral)

• 2dimageto3dmodel

  1 265 3.7 Python

  We evaluate our method on different datasets (including ShapeNet, CUB-200-2011, and Pascal3D+) and achieve state-of-the-art results, outperforming all the other supervised and unsupervised methods and 3D representations, all in terms of performance, accuracy, and training time.

• neural-deferred-shading

  1 239 4.6 Python

  Multi-View Mesh Reconstruction with Neural Deferred Shading (CVPR 2022)

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python computer-graphics related posts

• Show HN: Gaussian Splat renderer in VR with Unity
  2 projects | news.ycombinator.com | 24 Jan 2024
• Bad accuracy after model training, Can someone help me ?
  1 project | /r/GaussianSplatting | 7 Dec 2023
• The initial work to get the gaussian-splatting training code working on AMD/ROCm has been done
  1 project | /r/GaussianSplatting | 19 Oct 2023
• Future Tech SD VR, 3D modeling, Movies, and Video Game Creation (Paper / Videos included)
  1 project | /r/StableDiffusion | 10 Oct 2023
• ECON: Explicit Clothed humans Optimized via Normal integration
  1 project | /r/StableDiffusion | 9 Jun 2023
• What would I use to create a chatbot but with an animated face of a man i created with Stable Diffusion - and also do it from my local pc, not any other websites etc. Anyone have any ideas on this?
  1 project | /r/StableDiffusion | 5 Jun 2023
• 100% AI including verse, photo, outpainting, animation, voice, and lip syncing
  2 projects | /r/artificial | 5 Jun 2023
• A note from our sponsor - WorkOS
  workos.com | 19 Apr 2024

  The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!