model-synthesis
RAVE
model-synthesis | RAVE | |
---|---|---|
4 | 9 | |
143 | 1,201 | |
- | - | |
3.1 | 7.7 | |
2 months ago | 12 days ago | |
C++ | Python | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
model-synthesis
-
City Generation with WFC
WFC is based on my work on Model Synthesis. I consider how to create fully connected (navigable) road networks in my 2011 TVCG paper. Here is an example of a generated road network from that paper.
-
Ask HN: What weird technical scene are you fond/part of?
https://www.youtube.com/watch?v=Dfc-DQorohc
Craig Reynolds said the name "Boids" was inspired by The Producers Concierge scene, so that's how you should pronounce it:
Boids. Dirty, disgusting, filthy, lice ridden Boids. Boids. You get my drift?
https://www.youtube.com/watch?v=aL6mTMShVyk
The other really cool rabbit hole to explore for generating tiles and even arbitrary graph based content (I'm sold: hexagons are the bestagons!) is "Wave Function Collapse", which doesn't actually have anything to do with quantum mechanics (it just sounds cool), but is actually a kind of constraint solver related to sudoku solvers.
https://escholarship.org/content/qt3rm1w0mn/qt3rm1w0mn_noSpl...
Maxim Gumin's work: https://github.com/mxgmn/WaveFunctionCollapse
Paul Merrell's work:
https://paulmerrell.org/model-synthesis/
https://paulmerrell.org/research/
Oskar Stålberg's work:
https://twitter.com/OskSta/status/784847588893814785
https://oskarstalberg.com/game/wave/wave.html
There's a way to define cellular automata rules by giving examples of the before and after patterns, and WFC is kind of like a statistical constraint solving version of that.
So it's really easy for artists to define rules just by drawing! Not even requiring any visual programming, but you can layer visual programming on top of it.
That's something that Alexander Repenning's "AgentSheets" supported (among other stuff): you could define cellular automata rules by before-and-after examples, wildcards and variables, and attach additional conditions and actions with a visual programming language.
AgentSheets and other cool systems are described in this classic paper: “A Taxonomy of Simulation Software: A work in progress” from Learning Technology Review by Kurt Schmucker at Apple. It covered many of my favorite systems.
http://donhopkins.com/home/documents/taxonomy.pdf
Chaim Gingold wrote a comprehensive "Gadget Background Survey" at HARC, which includes AgentSheets, Alan Kay's favorites: Rockey’s Boots and Robot Odyssey, and Chaim's amazing SimCity Reverse Diagrams and lots of great stuff I’d never seen before:
http://chaim.io/download/Gingold%20(2017)%20Gadget%20(1)%20S...
Chaim Gingold has analyzed the SimCity (classic) code and visually documented how it works, in his beautiful "SimCity Reverse Diagrams":
>SimCity reverse diagrams: Chaim Gingold (2016).
>These reverse diagrams map and translate the rules of a complex simulation program into a form that is more easily digested, embedded, disseminated, and and discussed (Latour 1986).
>The technique is inspired by the game designer Stone Librande’s one page game design documents (Librande 2010). If we merge the reverse diagram with an interactive approach—e.g. Bret Victor’s Nile Visualization (Victor 2013), such diagrams could be used generatively, to describe programs, and interactively, to allow rich introspection and manipulation of software.
>Latour, Bruno (1986). “Visualization and cognition”. In: Knowledge and Society 6 (1986), pp. 1– 40. Librande, Stone (2010). “One-Page Designs”. Game Developers Conference. 2010. Victor, Bret (2013). “Media for Thinking the Unthinkable”. MIT Media Lab, Apr. 4, 2013.
https://lively-web.org/users/Dan/uploads/SimCityReverseDiagr...
Agentsheets: Alexander Repenning (1993–)
Interacting agents are embedded and interact within
-
Wave Function Collapse
If we called it Model Synthesis it'd get fewer clicks…
- Wave Function Collapse library in pure C
RAVE
-
How could you use AI for music inspiration/ideas?
Also, theres new tools like https://github.com/acids-ircam/RAVE which can be used to create new sounds, i feel like the more granular you work with AI on art, the better can help you out. Magentajs is pretty cool! Im still just playing with it but is easy to use so far.
-
Sonification of particles coordinates
https://github.com/acids-ircam/RAVE hope this wasn't too much off topic, i'm just super enthusiastic about RAVE and have been trying to squeeze a sonification in with it with no good applications so far. this feels kinda awesome tho. maybe it fits?
- Zero coding experience, trying to setup a training environment and running into an error
- I train some models, but GPU usage is too low is that normal for learning a model in local?
-
Ask HN: What weird technical scene are you fond/part of?
I'm in the deep learning music scene, which is due for its stable diffusion moment in the next year or two. The (primarily) timbre transfer system called RAVE is where I'm starting, and my contribution is to optimize the system to improve training time.
[] https://github.com/acids-ircam/RAVE/tree/master/rave
-
Hello
I'm obsessed with generative audio models, particularly RAVE[0].
Music is set to have its GPT-3 / Stable Diffusion moment within a couple years.
I believe in 10 years the venn diagram of music made with computers and music made with neural nets will be a circle, and that now is a great time to jump in.
Would LOVE to swap notes with anyone else here into this. Email in bio.
[0] https://github.com/acids-ircam/RAVE
- Rave: Realtime Audio Variational AutoEncoder
-
[D] What is state of the art for audio generation?
Source code is here: https://github.com/caillonantoine/RAVE