hamilton
glicol
hamilton | glicol | |
---|---|---|
26 | 132 | |
878 | 1,996 | |
- | - | |
8.1 | 8.0 | |
about 1 year ago | 9 days ago | |
Python | Rust | |
BSD 3-clause Clear License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
hamilton
-
Write production grade pandas (and other libraries!) with Hamilton
And find the repository here: https://github.com/dagworks-inc/hamilton/
-
Useful libraries for data engineering in various programming languages
Python - https://github.com/stitchfix/hamilton (author here). It's great if you want your code to be always unit testable and documentation friendly, and you want to be able to visualize execution. Blog post on using it with Pandas https://link.medium.com/XhyYD9BAntb.
-
Cognitive Loads in Programming
Yes! As one of the creators of https://github.com/stitchfix/hamilton this was one of the aims. Simplifying the cognitive burden for those developing and managing data transforms over the course of years, and in particular for ones they didn't write!
For example in Hamilton -- we force people to write "declarative functions" which then are stitched together to create a dataflow.
E.g. example function -- my guess is that you can read and understand/guess what it does very easily.
-
Prefect vs other things question
For (1) there are quite a few options - prefect is one, metaflow is another, airflow, dagster, even https://github.com/stitchfix/hamilton (core contributor here), etc.
-
Field Lineage
If you're want to do more python https://github.com/stitchfix/hamilton allows you to model dependencies at a columnar (field) level.
- Show HN
-
[D] Is anyone working on interesting ML libraries and looking for contributors?
Take a look at https://github.com/stitchfix/hamilton - we're after contributors who can help us grow the project, e.g. make documentation great, dog fooding features and suggesting/contributing usability improvements.
-
Useful Python decorators for Data Scientists
For a real world example of their power, we built an entire framework (https://github.com/stitchfix/hamilton) at Stitch Fix, where a lot of cool magic is provide via decorators - see https://hamilton-docs.gitbook.io/docs/reference/api-reference/available-decorators and these two source files (https://github.com/stitchfix/hamilton/blob/main/hamilton/function_modifiers_base.py, https://github.com/stitchfix/hamilton/blob/main/hamilton/function_modifiers.py ). Note we do some non-trivial stuff via them.
-
unit tests
For data processing/transform code, I would recommend looking at https://github.com/stitchfix/hamilton, especially if you're trying to test pandas code. Short getting started here - https://towardsdatascience.com/how-to-use-hamilton-with-pandas-in-5-minutes-89f63e5af8f5 (disclaimer: I'm one of the authors).
-
Dealing with hundreds of customer/computed columns
The python package, hamilton, from Stitch Fix (https://hamilton-docs.gitbook.io/docs/) can help manage transformations on pandas dataframes. This DAG of transformations is managed separately in a file - so it can be versioned, in case the transformations change. The memory required is reduced, because only the API call tables and mapping parameter table have to be in memory. The calculated columns can be produced as needed. Just like dbt, transformations are separate from the source tables - but hamilton can be used on any python object - not just dataframes. dbt is SQL based.
glicol
-
3 years of fulltime Rust game development, and why we're leaving Rust behind
I've worked on Ambient Engine and now on the Bevy engine. I totally agree with these points, very valuable. I only make some comments from my professional (audio) perspective:
We need the highlight author's affirmation of cli. Rust's tui (ratatui) is great. I used it to make Glicol-cli [1]. If you are a Linux user, you are welcome to test the music production of the code.
Speaking of game audio, I actually think rust is perfect for audio. I have also continued to develop Glicol recently, and my recent goal (starting tomorrow) is the bevy_glicol plug-in. I want to solve bevy's audio problem on the browser.
All in all, even though I've had my share of pain with ecs, I still think rust is very valuable for game and app development, maybe not multiplayer AAA, maybe practical apps.
[1] https://github.com/glicol/glicol-cli
[2] https://github.com/chaosprint/glicol
-
Show HN: Render audio to HTML canvas using WebGPU
Nice! Great project website styling and demo.
I had a WebGPU scope demo using vanila JS here, but it's not connected to AudioContext at all.
https://stackblitz.com/edit/vitejs-vite-cuc9vs
Still, I had to use the old WebGL solution for https://glicol.org since the WebGPU support seems to be pretty slow at the moment.
-
AI-generated sad girl with piano performs the text of the MIT License
Suno is great and I already shared its potential back in v2. I have always believed that the essence of digital music is "organized numbers". I think what needs to be thought about is how to use AI in this process. If you look at the results (numbers) generated, then we are indeed very close. But there is another future I believe: I hope AI can compose music with me, like copilot. This is why I keep working on
https://glicol.org/
and the destination is:
https://github.com/chaosprint/RaveForce
Also want to hear your feedback.
- Strudel: A live coding platform to write dynamic music pieces in the browser
-
Velato: A programming language where source code must be a valid MIDI music file
Interesting!
Similar note-based expression can be found on TidalCycles/Strudel. although it's not valid MIDI format anymore, you can use notation like c4, f3, and make them as "pattern". Samples are also supported in the same manner:
https://strudel.cc/
And in my project Glicol, I use only numbers in the seq node. So 60 means middle C. Underscore means rest.
https://glicol.org/
-
We were not accepted into Google Summer of Code. So, we started our own
I also applied with Glicol (https://glicol.org/) and got rejected, which is totally understandable. I am basically working this project on my own with almost zero extra funding.
I am currently working on a new website. The old stack is Vite, Svelte and Windi CSS (discontinued unfortunately). So this time maybe Astro + Solid + Tailwind.
And I am also trying to rewrite the whole Rust backend if possible, so there is quite some work to be done.
Let me know on GH or Discord if you are interested.
It's a good chance to try Rust, WASM, DSP, etc.
-
My Sixth Year as a Bootstrapped Founder
This is a really informative and inspiring article.
It hasn’t been 6 months (not 6 years) since I quit my full-time job as a Rust developer to start my own business.
As time goes by, I can feel the pressure of mortgage and car loans, and I can also feel the care and pressure of my family.
My original plan was to make an interface for Glicol (https://glicol.org), and to develop relevant hardware with firmware written in rust for school education.
I sent some cold emails to VCs, but most of them got no reply.
I also sent an email to the Norwegian Museum of Science and Technology, offering to perform for children for free, but they didn’t reply for two months. I shamelessly sent it again, and someone finally replied with a rejection.
Only one VC talked to me and thought that I should convince and validate a partner first, and he suggested that I go to an incubator.
Very good advice.
Later I learned that even Norwegian education startups skipped Norway and focused directly on the US market.
People from the incubator also told me that it is impossible for Norwegian schools to accept new things independently.
This is very enlightening to me because most of Glicol's visitors are indeed from the US. And it took me so long to discover this fact.
But if I don’t start, I’ll never get past those six months.
- How Programming Languages Got Their Names
-
Ask HN: Yo wants to build a game, I'm lost. What can I do?
I picked up LOGO when I was 6 and leant Pascal and C later.
I didn't program for a few years because I wasn't interested in competitions. So I think interest is the most important, otherwise it will be easy to get lost and give up.
Later, I became very interested in programming, mainly because I came into contact with music technology.
I think since your child is interested in game development, it is a good choice to start step by step. For example, starting with threejs. I also recommend learning Rust and Bevy so you learn the underlying layers and ECS.
Last but not least, although it's not related to games dev but I sincerely invite you and your son to try Glicol (https://glicol.org), the project that I am developing.
-
I quit my job to work full time on my open source project [Atuin]
I quite my job as well to work on
https://glicol.org
I have a lot of feelings, but I don't have a blog so far. But one of my feelings is that universities should alloc some of their funding to many of these open source projects and open source community should be better managed rather than donation. My plan is to start my own company and work on hardware .
What are some alternatives?
prosto - Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
Sonic Pi - Code. Music. Live.
versatile-data-kit - One framework to develop, deploy and operate data workflows with Python and SQL.
supercollider - An audio server, programming language, and IDE for sound synthesis and algorithmic composition.
plumbing - Prismatic's Clojure(Script) utility belt
kaleidosync - A WebGL Spotify visualizer made with Vue, D3, and Three.js.
OpenLineage - An Open Standard for lineage metadata collection
soundboard - Simple soundboard app with MIDI control
composer - Supercharge Your Model Training
vst-rs - VST 2.4 API implementation in rust. Create plugins or hosts. Previously rust-vst on the RustDSP group.
polars - Dataframes powered by a multithreaded, vectorized query engine, written in Rust
typebeat - Keyboard-controlled music sequencer, sampler, and synth