Squants VS Zeppelin

Scala's squants library is a nice implementation of units-of-measure/dimensional-analysis http://www.squants.com

In particular it uses types for dimensions; whilst units are just constructors. Hence `Meters(2)` and `Microns(7)` have the same type (`Length`).

squants for the “Market” package to use in financial calculations.

take a peek at https://www.squants.com looks like not in your language, but maybe you can apply some same concepts

You might find the Squants library for Scala interesting; it even seems like an apt usage of some oft-questioned language features.

https://github.com/typelevel/squants

Now we can proceed with the definition of Apache Zeppelin. It is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with Python, Scala, SQL, Spark, and more. You can execute code and even schedule a job (via cron) to run at regular intervals.

Have you tried Apache Zepellin I remember that you can pretty print spark dataframes directly on it with z.show(df)

I used to use Zeppelin, some kind of Jupyter Notebook for Spark (that supports Parquet). But it may be better alternatives.

https://zeppelin.apache.org/

Another more widely used notebooks for scala and spark: https://zeppelin.apache.org/

[1] Apache Zeppelin http://zeppelin.apache.org/ [2] Zeppelin notebooks website http://zeppelin-notebook.com/. [3] Zeppelin notebooks git repo https://github.com/zjffdu/zeppelin-notebook

Apache Zeppelin

For all who think: What the heck is Apache Zeppelin? Here are some details what the project site says:

Check out Zeppelin. It's similar to Jupyter and allows real-time editing by multiple users. https://zeppelin.apache.org/