arquero
WebGL-Fluid-Simulation
arquero | WebGL-Fluid-Simulation | |
---|---|---|
8 | 109 | |
1,191 | 14,242 | |
1.5% | - | |
4.6 | 0.0 | |
about 1 month ago | 5 months ago | |
JavaScript | JavaScript | |
BSD 3-clause "New" or "Revised" License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
arquero
-
Show HN: Matrices – explore, visualize, and share large datasets
Hey HN, I'm excited to share a new side project I've been working on.
The product is called Matrices. You can check it out here: https://matrices.com/.
With Matrices, you can *explore*, *visualize*, and *share* large (100k rows) datasets–all without code. Filter data down to just what you want, visualize it with built-in charts, and share your results with one click.
You can use it today (no login or waitlist or anything). Just copy and paste your data from a google sheet or CSV file.
It's hard to describe the feeling of "gliding over data" you get with Matrices, so I'd rather *show* you how it works instead. This 75s video will give you a sense of how it works: https://www.youtube.com/watch?v=Rrh9_I3Ux8E.
Data is stored locally in your browser until you publish it, though small sample does go to the OpenAI APIs for AI-assisted features.
I started building Matrices because I wanted a tool that made it easy to explore new datasets. When I'm first trying to dig into data, I'll have one question... that leads to another... that will invariably lead to five more questions. It's sort of a fractal process, and I couldn't find many good options that were fast, responsive, and visual.
I figured this crowd would be interested in tech stack as well, it's using arquero [1] bindings over apache arrow for in-memory analytics, and visx [2] for visualizations. I'd like to add duckdb-wasm support at some point to open up a wider set of databases. Data is serialized as parquet to save a bit on bandwidth + storage.
Give it a spin, and let me know what you think. This is my first 'serious frontend project' so I appreciate any and all feedback and bug reports. Feel free to comment here (I'll be around most of the day), or shoot me a note: [email protected]
[1]: https://uwdata.github.io/arquero/
-
Goodbye, Node.js Buffer
https://github.com/uwdata/arquero
- Arquero is a JavaScript library for query processing and transformation of array-backed data tables
- Arquero – data tables wrangling in JavaScript
-
Hal9: Data Science with JavaScript
Transformations: We found out that JavaScript in combination with D3.js has a pretty decent set of data transformation functions; however, it comes nowhere near to Pandas or dplyr. We found out about Tidy.js quite early, loved it, and adopted it. The combination of Tidy.js and D3.js and Plot.js is absolutely amazing for visualizations and data wrangling with small datasets, say 10-100K rows. We were very happy with this for a while; however, once you move away from visualizations into real-world data analysis, we found out 100K rows restrictive, which gets worse when having 100 or 1K columns. So we switched gears and started using Arquero.js, which happens to be columnar and enabled us to process +1M rows in the browser, descent size for real-world data analysis.
- Arquero – Query processing and transformation of array-backed data tables
-
Apache Arrow 3.0.0 Release
Take a look at the arquero library from a research group at University of Washington (the same group that D3 came out of). https://github.com/uwdata/arquero
WebGL-Fluid-Simulation
-
That is some extremely impressive water physics, especialy for a place you only visit once. How did they do it? (MAJOR SPOILERS FOR 4.2 WORLD QUEST)
It kinda reminds me of this fluid simulation website. The site is about a computer graphics technique that simulates the motion and appearance of fluids such as water, smoke or fire. You can use your mouse to move around the screen to see the simulation, also can change how the fluid simulation works by adjusting the sliders in the control panel next to it.
-
Goodbye, Node.js Buffer
Typed arrays are essential for web apps that use WebGL and WebGPU. Being able to send this typed data to run computations on the GPU in parallel can give you 1000x speed up.
You can see it in action on this WebGL fluid simulator[0] by PavelDoGreat.
[0] https://github.com/PavelDoGreat/WebGL-Fluid-Simulation
- WebGL Fluid Simulation
-
Water – Oimo.io
this one is much smoother: https://paveldogreat.github.io/WebGL-Fluid-Simulation/
previously: https://news.ycombinator.com/item?id=34422948
-
This thing is wild!
Not a video. WebGL Fluid is the website.
- The website has been found!
-
A lost website
Sure here it is
-
Saw this ad that made me have major feelings from childhood
Off the top of my head I'm thinking of WebGL Fluid Simulation
- Webgl Fluid Simulation
-
Here you go: Golden Beryl on a magnetic stirrer ... in slow mo!
Here is poor man's stirrer: https://paveldogreat.github.io/WebGL-Fluid-Simulation/
What are some alternatives?
perspective - A data visualization and analytics component, especially well-suited for large and/or streaming datasets.
react-fluid-animation - Fluid media animation for React powered by WebGL.
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Phaser - Phaser is a fun, free and fast 2D game framework for making HTML5 games for desktop and mobile web browsers, supporting Canvas and WebGL rendering. [Moved to: https://github.com/phaserjs/phaser]
hal9ai - Hal9 — Data apps powered by code and LLMs [Moved to: https://github.com/hal9ai/hal9]
lively - Free and open-source software that allows users to set animated desktop wallpapers and screensavers powered by WinUI 3.
regression-js - Curve Fitting in JavaScript.
portfolio-site
arrow-julia - Official Julia implementation of Apache Arrow
react-native-gcanvas - react native canvas based on gpu opengl glsl GCanvas -- A lightweight cross-platform graphics rendering engine. (超轻量的跨平台图形引擎)
cylon - Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
BestBuy-GPU-Bot - BestBuy Bot is an Add to cart and Auto Checkout Bot. This auto buying bot can search the item repeatedly on the ITEM page using one keyword. Once the desired item is available it can add to cart and checkout very fast. This auto purchasing BestBuy Bot can work on Firefox Browser so it can run in all Operating Systems. It can run for multiple items simultaneously.