incubator-uniffle
Zeppelin
| incubator-uniffle | Zeppelin | |
|---|---|---|
| 3 | 8 | |
| 357 | 6,266 | |
| 2.0% | 0.2% | |
| 9.5 | 8.7 | |
| about 12 hours ago | 4 days ago | |
| Java | Java | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
incubator-uniffle
- Apache Uniffle: high performance, general purpose remote shuffle service
- Apache Uniffle: a high performance remote shuffle service for Spark
-
Apache Uniffle (incubating): Uniffle is a high performance, general purpose Remote Shuffle Service.
Our project enter the Apache incubator in the June. https://github.com/apache/incubator-uniffle
Zeppelin
-
Serverless Apache Zeppelin on AWS
Now we can proceed with the definition of Apache Zeppelin. It is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with Python, Scala, SQL, Spark, and more. You can execute code and even schedule a job (via cron) to run at regular intervals.
-
Visualization using Pyspark Dataframe
Have you tried Apache Zepellin I remember that you can pretty print spark dataframes directly on it with z.show(df)
-
Fast CSV Processing with SIMD
I used to use Zeppelin, some kind of Jupyter Notebook for Spark (that supports Parquet). But it may be better alternatives.
https://zeppelin.apache.org/
-
What libraries do you use for machine learning and data visualizing in scala?
Another more widely used notebooks for scala and spark: https://zeppelin.apache.org/
-
How to use IPython in Apache Zeppelin Notebook
[1] Apache Zeppelin http://zeppelin.apache.org/ [2] Zeppelin notebooks website http://zeppelin-notebook.com/. [3] Zeppelin notebooks git repo https://github.com/zjffdu/zeppelin-notebook
-
BI Application in Golang.
Apache Zeppelin
-
Using InterSystems Caché and Apache Zeppelin
For all who think: What the heck is Apache Zeppelin? Here are some details what the project site says:
-
Is there a way to collaborate in real-time for Jupyter Notebooks?
Check out Zeppelin. It's similar to Jupyter and allows real-time editing by multiple users. https://zeppelin.apache.org/
What are some alternatives?
PowerJob - Enterprise job scheduling middleware with distributed computing ability.
Breeze - Breeze is a numerical processing library for Scala.
flink-remote-shuffle - Remote Shuffle Service for Flink
Spark Notebook - Interactive and Reactive Data Science using Scala and Spark.
Deeplearning4j - Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
Algebird - Abstract Algebra for Scala
Alluxio (formerly Tachyon) - Alluxio, data orchestration for analytics and machine learning in the cloud
Figaro - Figaro Programming Language and Core Libraries
doris - Apache Doris is an easy-to-use, high performance and unified analytics database.
BigDL - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.
Smile - Statistical Machine Intelligence & Learning Engine
PredictionIO - PredictionIO, a machine learning server for developers and ML engineers.