clerk VS Metabase

Something I really like in the Clojure data science stack that isn't mentioned is Clerk* — an interesting take on notebooks. I think it's a good gateway into Clojure for those coming from a Python or R background.

*https://clerk.vision/

Clojure's lazy sequences by default are wonderful ergonomically, but it provides many ways to use strict evaluation if you want to. They aren't really a hassle either. I've been doing Clojure for the last few years and have a few grievances, but overall it's the most coherent, well thought out language I've used and I can't recommend it enough.

There is the issue of startup time with the JVM, but you can also do AOT compilation now so that really isn't a problem. Here are some other cool projects to look at if you're interested:

Malli: https://github.com/metosin/malli

Babashka: https://github.com/babashka/babashka

Clerk: https://github.com/nextjournal/clerk

I'm really enjoying using Clojure with Clerk: https://github.com/nextjournal/clerk

It's a bit like a Jupyter notebook, but you get to use your own editor, you still have a normal Clojure REPL, it's stored in git like "normal" code, etc.

Hey all, I'm new to Clojure and would appreciate your help with a few questions I had getting started. I'm using Leiningen to setup my projects and manage my packages as recommended in Brave & True. So far I've been able to add any dependencies I've needed without much issue, Neanderthal, tech.v3.dataset, etc. I'm interested in data science, and was hoping to set up a notebook environment to be able to quickly produce data visualizations on the fly since I'm used to working with Jupyter. I came across Clerk, but I'm having some trouble adding it to my project. Here's what I tried:

Clojure also has Clerk, which is like Jupyter, but more befitting Clojure's overall philosophy: https://clerk.vision/

If I were working long enough with gnarly enough equations I'd look into using Clerk to visualize the equations with MathJax or similar, probably following Sam Ritchie's footsteps with SICMUtils. To me this is the true readability answer: lisp notation for precise implementations, compiling to a rich & familiar visual representation.

Remote Code Execution via H2

We've used it for about a year - Blazer is okay if you need a quick SQL query console, but we found it lacking as an actual business intelligence tool. The support for graphs and dashboards is limited, for graphs it requires you to structure the query in an exact way as you can see in the Blazer readme.

After some research on available alternatives that don't break the bank, we decided to deploy a self-hosted instance of Metabase[0]. This took only a few minutes to set up using their Docker image[1] and it has much better graphing capabilities and you can easily put a custom layout together for dashboards. Upgrading is similarly easy (just redeploy). Also easy to configure: data sources, hiding or changing the data type of a column, G Suite sign-in for our domain. Highly recommend it if you need anything more than Blazer's table output.

[0]: https://github.com/metabase/metabase

I've never used Tableau, but heard a lot of hate about it. However, in my previous role, we were big fans of Metabase (https://metabase.com). You can also self-host it, which was a huge win for us.

It seems folks want a working example. Here's one in prod:

Metabase is a BI tool, backend written mostly in Clojure. Like basically all BI tools they have this intermediate representation language thing so you write the same thing in "MBQL (metabase query language)" and it theoretically becomes same query in like, Postgres and Mongo and whatever. End user does not usually write MBQL, it's a service for the frontend querybuilding UI thing and lots of other frontend UI stuff mainly in usage.

Whole processing from MBQL -> your SQL or whatever is done via a buncha big-ass transducers. Metabase is not materially faster than other BI tools (because all the other BI tools do something vaguely similar in their langs) but it's pretty comparable speed and the whole thing was materially written by like 5 peeps

https://github.com/metabase/metabase/blob/master/src/metabas...

(nb: I used to work for Metabase but currently do not. but open core is open core)

They haven't released the source, and the compiled versions are non-trivial to diff (e.g. there are nondeterministic numbers from the clojure compiler that seem to have changed from one to the other, and .clj files have been removed from the jar).

The old version has `hash=1bb88f5`, which is a public commit: https://github.com/metabase/metabase/commit/1bb88f5

We are unsure about the right license to use, so this is a great feedback. We had a MIT license one week ago that we know that we cannot hold on long term and we felt we were lying to the community by keeping an MIT license and changing it in one year.

By using AGPL, we feel it's the right level of restriction. It's the license used by Metabase for example (https://github.com/metabase/metabase) that many companies use internally.

The solution really depends on what sort of problems you are trying to solve and who your customers are.

There are a fair few low-code solutions out there for reporting and data visualisation that are great for finance and marketing teams for example. e.g. https://metabase.com/ , https://evidence.dev/

For multipurpose SMB workflows and organisational processes, I have used n8n in the recent past and found it was quite good and incredibly easy to maintain. https://n8n.io/engineering-resources/

For enterprise processes I'd go with Camunda (solely based on recommendations and not first hand experience). Although only parts of their platform are OSS https://github.com/camunda

Bear in mind that some of these are not suitable if you want to build something that competes with them while taking their OSS code. But are perfectly fine otherwise.

Anyway, I have a collection of scripts that merge ActivityWatch data from all my machines and WakaTime exports to a PostgreSQL database which I then query with a project called Metabase. If you're curious, the scripts are in a repository called sqrt-data. I've been playing with this for ~4-5 years already I think.

Metabase | https://metabase.com | REMOTE | Full-time | Backend, Frontend, Full Stack, and DevOps engineers

Metabase is open source analytics software that lets anyone in your company rummage around in the databases you have. It connects to a number of databases / data warehouses (BigQuery, Redshift, Snowflake, Postgres, MySQL, etc).