Python computer-graphics

Open-source Python projects categorized as computer-graphics

Top 23 Python computer-graphic Projects

  • pytorch-CycleGAN-and-pix2pix

    Image-to-Image Translation in PyTorch

  • gaussian-splatting

    Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

  • Project mention: Show HN: Gaussian Splat renderer in VR with Unity | news.ycombinator.com | 2024-01-24

    Chris' post doesn't really give much background info, so here's what's going on here and why it's awesome.

    Real-time 3D rendering has historically been based on rasterisation of polygons. This has brought us a long way and has a lot of advantages, but making photorealistic scenes takes a lot of work from the artist. You can scan real objects like photogrammetry and then convert to high poly meshes, but photogrammetry rigs are pro-level tools, and the assets won't render at real time speeds. Unreal 5 introduced Nanite which is a very advanced LoD algorithm and that helps a lot, but again, we seem to be hitting the limits of what can be done with polygon based rendering.

    3D Gaussian Splats is a new AI based technique that lets you render in real-time photorealistic 3D scenes that were captured with only a few photos taken using normal cameras. It replaces polygon based rendering with radiance fields.

    https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/

    3DGS uses several advanced techniques:

    1. A 3D point cloud is estimated by using "structure in motion" techniques.

    2. The points are turned into "3D gaussians", which are sort of floating blobs of light where each one has a position, opacity and a covariance matrix defined using "spherical harmonics" (no me neither). They're ellipsoids so can be thought of as spheres that are stretched and rotated.

    3. Rendering is done via a form of ray-tracing in which the 3D Gaussians are projected to the 2D screen (into "splats"), sorted so transparency works and then rasterized on the fly using custom shaders.

    The neural network isn't actually used at rendering time, so GPUs can render the scene nice and fast.

    In terms of what it can do the technique might be similar to Unreal's Nanite. Both are designed for static scenes. Whilst 3D Gaussians can be moved around on the fly, so the scene can be changed in principle, none of the existing animation, game engines or artwork packages know what to do without polygons. But this sort of thing could be used to rapidly create VR worlds based on only videos taken from different angles, which seems useful.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • pix2pixHD

    Synthesizing and manipulating 2048x1024 images with conditional GANs

  • BlenderProc

    A procedural Blender pipeline for photorealistic training image generation

  • contrastive-unpaired-translation

    Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

  • PIFu

    This repository contains the code for the paper "PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization"

  • ICON

    [CVPR'22] ICON: Implicit Clothed humans Obtained from Normals

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • deep-motion-editing

    An end-to-end library for editing and rendering motion of 3D characters with deep learning [SIGGRAPH 2020]

  • voca

    This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh. (by TimoBolkart)

  • ECON

    [CVPR'23, Highlight] ECON: Explicit Clothed humans Optimized via Normal integration

  • Project mention: ECON: Explicit Clothed humans Optimized via Normal integration | /r/StableDiffusion | 2023-06-09

    I think you forgot the content https://github.com/YuliangXiu/ECON

  • talking-head-anime-3-demo

    Demo Programs for the "Talking Head(?) Anime from a Single Image 3: Now the Body Too" Project

  • Project mention: What would I use to create a chatbot but with an animated face of a man i created with Stable Diffusion - and also do it from my local pc, not any other websites etc. Anyone have any ideas on this? | /r/StableDiffusion | 2023-06-05

    Talking Head. This is the visual of converting the image into an animated character. This is honestly the hard part. There's vmagicmirror for 3d model vrm/vroid characters. And for anime characters there's talking head anime 3 if you modify it a bit. But other than that there's basically nothing. Some online services can do it for you but not local/offline.

  • clean-fid

    PyTorch - FID calculation with proper image resizing and quantization steps [CVPR 2022]

  • tree-gen

    Procedural generation of tree models in blender

  • APDrawingGAN

    Code for APDrawingGAN: Generating Artistic Portrait Drawings from Face Photos with Hierarchical GANs (CVPR 2019 Oral)

  • anycost-gan

    [CVPR 2021] Anycost GANs for Interactive Image Synthesis and Editing

  • Awesome-Game-Analysis

    a comprehensive collection of video game tech analysis resources

  • Project mention: A GitHub repo for collecting the tech analysis of video game | news.ycombinator.com | 2023-07-29
  • GANSketching

    Sketch Your Own GAN: Customizing a GAN model with hand-drawn sketches.

  • taichi-nerfs

    Implementations of NeRF variants based on Taichi + PyTorch

  • BlenderNeRF

    Easy NeRF synthetic dataset creation within Blender

  • DeepSIM

    Official PyTorch implementation of the paper: "DeepSIM: Image Shape Manipulation from a Single Augmented Training Sample" (ICCV 2021 Oral)

  • vision-aided-gan

    Ensembling Off-the-shelf Models for GAN Training (CVPR 2022 Oral)

  • 2dimageto3dmodel

    We evaluate our method on different datasets (including ShapeNet, CUB-200-2011, and Pascal3D+) and achieve state-of-the-art results, outperforming all the other supervised and unsupervised methods and 3D representations, all in terms of performance, accuracy, and training time.

  • neural-deferred-shading

    Multi-View Mesh Reconstruction with Neural Deferred Shading (CVPR 2022)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python computer-graphics related posts

  • Show HN: Gaussian Splat renderer in VR with Unity

    2 projects | news.ycombinator.com | 24 Jan 2024
  • Bad accuracy after model training, Can someone help me ?

    1 project | /r/GaussianSplatting | 7 Dec 2023
  • The initial work to get the gaussian-splatting training code working on AMD/ROCm has been done

    1 project | /r/GaussianSplatting | 19 Oct 2023
  • Future Tech SD VR, 3D modeling, Movies, and Video Game Creation (Paper / Videos included)

    1 project | /r/StableDiffusion | 10 Oct 2023
  • ECON: Explicit Clothed humans Optimized via Normal integration

    1 project | /r/StableDiffusion | 9 Jun 2023
  • What would I use to create a chatbot but with an animated face of a man i created with Stable Diffusion - and also do it from my local pc, not any other websites etc. Anyone have any ideas on this?

    1 project | /r/StableDiffusion | 5 Jun 2023
  • 100% AI including verse, photo, outpainting, animation, voice, and lip syncing

    2 projects | /r/artificial | 5 Jun 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 21 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source computer-graphic projects in Python? This list will help you:

Project Stars
1 pytorch-CycleGAN-and-pix2pix 22,112
2 gaussian-splatting 11,738
3 pix2pixHD 6,545
4 BlenderProc 2,568
5 contrastive-unpaired-translation 2,114
6 PIFu 1,737
7 ICON 1,552
8 deep-motion-editing 1,487
9 voca 1,106
10 ECON 1,029
11 talking-head-anime-3-demo 879
12 clean-fid 876
13 tree-gen 792
14 APDrawingGAN 773
15 anycost-gan 770
16 Awesome-Game-Analysis 744
17 GANSketching 712
18 taichi-nerfs 704
19 BlenderNeRF 698
20 DeepSIM 421
21 vision-aided-gan 365
22 2dimageto3dmodel 266
23 neural-deferred-shading 241

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com