RAVE
WaveFunctionCollapse
RAVE | WaveFunctionCollapse | |
---|---|---|
9 | 99 | |
1,201 | 22,745 | |
- | - | |
7.7 | 4.8 | |
13 days ago | 5 days ago | |
Python | C# | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
RAVE
-
How could you use AI for music inspiration/ideas?
Also, theres new tools like https://github.com/acids-ircam/RAVE which can be used to create new sounds, i feel like the more granular you work with AI on art, the better can help you out. Magentajs is pretty cool! Im still just playing with it but is easy to use so far.
-
Sonification of particles coordinates
https://github.com/acids-ircam/RAVE hope this wasn't too much off topic, i'm just super enthusiastic about RAVE and have been trying to squeeze a sonification in with it with no good applications so far. this feels kinda awesome tho. maybe it fits?
- Zero coding experience, trying to setup a training environment and running into an error
- I train some models, but GPU usage is too low is that normal for learning a model in local?
-
Ask HN: What weird technical scene are you fond/part of?
I'm in the deep learning music scene, which is due for its stable diffusion moment in the next year or two. The (primarily) timbre transfer system called RAVE is where I'm starting, and my contribution is to optimize the system to improve training time.
[] https://github.com/acids-ircam/RAVE/tree/master/rave
-
Hello
I'm obsessed with generative audio models, particularly RAVE[0].
Music is set to have its GPT-3 / Stable Diffusion moment within a couple years.
I believe in 10 years the venn diagram of music made with computers and music made with neural nets will be a circle, and that now is a great time to jump in.
Would LOVE to swap notes with anyone else here into this. Email in bio.
[0] https://github.com/acids-ircam/RAVE
- Rave: Realtime Audio Variational AutoEncoder
-
[D] What is state of the art for audio generation?
Source code is here: https://github.com/caillonantoine/RAVE
WaveFunctionCollapse
- I use Wave Function Collapse to create levels for my game (2022) [video]
-
It's Okay to Make Something Nobody Wants
Thank you! And yes, I agree. I was looking at uh https://github.com/mxgmn/WaveFunctionCollapse and wondering if that were applicable here :)
Have a good day!
- The Wavefunction Collapse Algorithm
-
Kullback–Leibler Divergence
Intuitively, it measures the difference between two probability distributions. It's not symmetric, so it's not quite that, but in my opinion, it's good intuition.
As motivation, say you're an internet provider, providing internet service to a business. You naturally want to save money, so you perhaps want to compress packets before they go over the wire. Let's say the business you're providing service to also compresses their data, but they've made a mistake and do it inefficiently.
Let's say the business has, incorrectly, determined the probability distribution for their data to be $q(x)$. That is, they assign probability of seeing symbol $x$ to be $q(x)$. Let's say you've determined the "true" distribution to be $p(x)$. The entropy, or number of bits, they expect to transmit per packet/symbol will be $-\sum p(x) lg(q(x))$. Meaning, they'll compress their stream under the assumption that the distribution is $q(x)$ but the actually probability of seeing a packet, $x$, is $p(x)$, which is why the term $p(x) lg(q(x))$ shows up.
The number of bits you're transmitting is just $-\sum p(x) lg(p(x))$. Now we ask, how many bits, per packet, is the savings of your method over the businesses? This is $-\sum p(x) lg(q(x)/p(x))$, which is exactly the Kullback-Leibler divergence (maybe up to a sign difference).
In other words, given a "guess" at a distribution and the "true" distribution, how bad is it between them? This is the Kullback-Leibler distribution and why it shows up (I believe) in machine learning and fitness functions.
As a more concrete example, I just ran across a paper talking [0] about using WFC [1] to asses how well it, and other algorithms, do when trying to create generative "super mario brothers" like levels. Take a 2x2 or 3x3 grid, make a library of tiles, use that to generate a random level, then use the K-L divergence to determine how well your generative algorithm has done compared to the observed distribution from an example image.
[0] https://arxiv.org/pdf/1905.05077.pdf
[1] https://github.com/mxgmn/WaveFunctionCollapse
-
All of it under the most poorly designed and maintained village
Reminds me of wave function collapse - a programmatic way to generate mazes.
-
How to detect and fix isolated terrain (islands or lakes) in a tile-based terrain?
I am using WFC to generate the terrain, with pretty much a copy-paste implementation of the original WFC implemented into Unity.
-
How to make wfc or post-gen script in blender?
If you still want to go the WFC route, the original WFC repository is a great place to start. There's also a (relatively barebones looking) Godot plugin you could take a look at.
- Wave Function Collapse
-
collapsed
wave function collapse studies - this is done with the https://github.com/mxgmn/WaveFunctionCollapse algorithm after I saw https://github.com/CodingTrain/Wave-Function-Collapse mention it. done in P5! IG https://www.instagram.com/ronivonu/
-
Room Generation Using Constraint Satisfaction
There’s an interesting approach similar to this called [Wave Function Collapse](https://github.com/mxgmn/WaveFunctionCollapse) (no relation to wfc in physics idea besides inspiration). It can infer the probabilistic constraints from one input example, and it seems to generalize quite well. Here’s a [little demo](https://oskarstalberg.com/game/wave/wave.html)
What are some alternatives?
denoising-diffusion-pytorch - Implementation of Denoising Diffusion Probabilistic Model in Pytorch
Raylib-cs - C# bindings for raylib, a simple and easy-to-use library to learn videogames programming
Spectrum - Spectrum is an AI that uses machine learning to generate Rap song lyrics
eShopOnContainers - Cross-platform .NET sample microservices and container based application that runs on Linux Windows and macOS. Powered by .NET 7, Docker Containers and Azure Kubernetes Services. Supports Visual Studio, VS for Mac and CLI based environments with Docker CLI, dotnet CLI, VS Code or any other code editor. Moved to https://github.com/dotnet/eShop.
LibreQoS - A Quality of Experience and Smart Queue Management system for ISPs. Leverage CAKE to improve network responsiveness, enforce bandwidth plans, and reduce bufferbloat.
OpenFK - An open source replacement for the U.B. Funkeys executable.
rvc - A 32-bit RISC-V emulator in a shader (and C)
DeBroglie - DeBroglie is a C# library implementing the Wave Function Collapse algorithm with support for additional non-local constraints, and other useful features.
Speed-Run-Sidebar - A Display + Controller to integrate with OBS
dnSpy-Unity-mono - Fork of Unity mono that's used to compile mono.dll with debugging support enabled
SVM-Face-and-Object-Detection-Shader - SVM using HOG descriptors implemented in fragment shaders
texture-synthesis - 🎨 Example-based texture synthesis written in Rust 🦀