perspective VS arquero

Try this project I work on, https://perspective.finos.org/ . It comes with a Python library (that runs the exact same engine/code as in the wasm version), and even a JupyterLab plugin. You can run the engine fully in-python, in-Javascript (via wasm), or replicated between the two.

Standalone Python virtual server example https://github.com/finos/perspective/tree/master/examples/to...

JupyterLab demo on Binder https://mybinder.org/v2/gh/finos/perspective/master?urlpath=...

The best example of WASM being used to render to canvas (it's also visualizations) I've seen is "Perspective":

https://perspective.finos.org/

  "Perspective is an interactive analytics and data visualization component, which is especially well-suited for large and/or streaming datasets. Originally developed at J.P. Morgan and open-sourced through the Fintech Open Source Foundation (FINOS), Perspective makes it simple to build user-configurable analytics entirely in the browser, or in concert with Python and/or Jupyterlab. Use it to create reports, dashboards, notebooks and applications, with static data or streaming updates via Apache Arrow."

Man the a16z marketing machine is working hard unfortunately at cost of quality.

For those interested in FS and open source today, especially with a capital markets lens check out:

https://www.finos.org

Lots of great projects, one I used recently and a favourite was this:

https://github.com/finos/perspective

As far as customizing the Perspective datagrid, the story on this is evolving :) . With the 1.0 release, we've released an NFT demo with a more current version of the plugin API, as well as new plugin API docs. Replacing innerHTML is only costly if you trigger a relayout before the replacement, which you'd want to avoid - check the pudgy-penguins demo source for examples which replaces these with without the intermediate DOM tree being rendered (though this is brower-dependent). If you can't, e.g. the replacement is async or whatever, the underlying regular-table component has an API that allows you to return the DOM elements themselves per cell, but you'd need to write a simple plugin to integrate this as Perspective's version provides its own dataListener.

By the way, the link to the blog on the project website results in a 404.

Transformations: We found out that JavaScript in combination with D3.js has a pretty decent set of data transformation functions; however, it comes nowhere near to Pandas or dplyr. We found out about Tidy.js quite early, loved it, and adopted it. The combination of Tidy.js and D3.js and Plot.js is absolutely amazing for visualizations and data wrangling with small datasets, say 10-100K rows. We were very happy with this for a while; however, once you move away from visualizations into real-world data analysis, we found out 100K rows restrictive, which gets worse when having 100 or 1K columns. So we switched gears and started using Arquero.js, which happens to be columnar and enabled us to process +1M rows in the browser, descent size for real-world data analysis.

(https://github.com/uwdata/arquero).

Take a look at the arquero library from a research group at University of Washington (the same group that D3 came out of). https://github.com/uwdata/arquero