Jupyter Scala
evilplot
Our great sponsors
| Jupyter Scala | evilplot | |
|---|---|---|
| 6 | 1 | |
| 1,561 | 240 | |
| 0.2% | -0.4% | |
| 9.0 | 7.2 | |
| 1 day ago | 5 months ago | |
| Scala | Scala | |
| BSD 3-clause "New" or "Revised" License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Jupyter Scala
-
💐 Making VSCode itself a Java REPL 🔁
Checkout almond
- A Python-compatible statically typed language erg-lang/erg
-
EDA libraries for Scala and Spark?
What about https://github.com/alexarchambault/plotly-scala and https://almond.sh/
-
Is there any editor or IDE that supports Ammonite with inline dependencies?
I use Almond in JupyterLab, which has pretty solid code completion. In IntelliJ, you can create a scratch sc file and run lines of it in the Scala REPL. That's really convenient for code completion and I normally will use that when I'm testing something from a specific project.
-
Recommended option for "Java with different syntax"?
The UI part. There's only the scala REPL. I think the closest is a scala kernel for Jupyter notebooks, check this out: https://almond.sh/
-
An SQL Solution for Jupyter
We have used https://almond.sh/ to create a Spark SQL interpreter using Jupyter Notebooks - plus a whole lot more which you can see here: https://arc.tripl.ai/tutorial
After seeing many companies writing ETL using code we decided it was too hard to manage at scale so provided this abstraction layer - which is heavily centered around expressing business logic in SQL - to standardise development (JupyterLab) and allow rapid deployments.
evilplot
-
EDA libraries for Scala and Spark?
Polynote from Netflix comes to mind. There's also https://github.com/cibotech/evilplot, but doesn't look to be maintained anymore. Though I've yet to find a visualization/plotting/graphing experience where you can iterate as quickly (and recklessly) as you do in Python.
What are some alternatives?
sparkmagic - Jupyter magics and kernels for working with remote Spark clusters
plotly-scala - Scala bindings for plotly.js
Metals - Scala language server with rich IDE features 🚀
Apache Flink - Apache Flink
Vegas - The missing MatPlotLib for Scala + Spark
Deeplearning4j - Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
Scio - A Scala API for Apache Beam and Google Cloud Dataflow.
Hail - Cloud-native genomic dataframes and batch computing
delta - An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Sparkta - Real Time Analytics and Data Pipelines based on Spark Streaming
BIDMach - CPU and GPU-accelerated Machine Learning Library