Sparkplug
Jupyter Scala
| Sparkplug | Jupyter Scala | |
|---|---|---|
| - | 6 | |
| 28 | 1,564 | |
| - | 0.1% | |
| 0.0 | 9.0 | |
| almost 4 years ago | 17 days ago | |
| Scala | Scala | |
| Apache License 2.0 | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Sparkplug
We haven't tracked posts mentioning Sparkplug yet.
Tracking mentions began in Dec 2020.
Jupyter Scala
-
💐 Making VSCode itself a Java REPL 🔁
Checkout almond
- A Python-compatible statically typed language erg-lang/erg
-
EDA libraries for Scala and Spark?
What about https://github.com/alexarchambault/plotly-scala and https://almond.sh/
-
Is there any editor or IDE that supports Ammonite with inline dependencies?
I use Almond in JupyterLab, which has pretty solid code completion. In IntelliJ, you can create a scratch sc file and run lines of it in the Scala REPL. That's really convenient for code completion and I normally will use that when I'm testing something from a specific project.
-
Recommended option for "Java with different syntax"?
The UI part. There's only the scala REPL. I think the closest is a scala kernel for Jupyter notebooks, check this out: https://almond.sh/
-
An SQL Solution for Jupyter
We have used https://almond.sh/ to create a Spark SQL interpreter using Jupyter Notebooks - plus a whole lot more which you can see here: https://arc.tripl.ai/tutorial
After seeing many companies writing ETL using code we decided it was too hard to manage at scale so provided this abstraction layer - which is heavily centered around expressing business logic in SQL - to standardise development (JupyterLab) and allow rapid deployments.
What are some alternatives?
Apache Kafka - Mirror of Apache Kafka
sparkmagic - Jupyter magics and kernels for working with remote Spark clusters
Hail - Cloud-native genomic dataframes and batch computing
Metals - Scala language server with rich IDE features 🚀
Scoozie - Scala DSL on top of Oozie XML
Vegas - The missing MatPlotLib for Scala + Spark
Apache Flink - Apache Flink
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
Deeplearning4j - Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
Scio - A Scala API for Apache Beam and Google Cloud Dataflow.