incubator-uniffle
PowerJob
incubator-uniffle | PowerJob | |
---|---|---|
3 | 9 | |
357 | 6,503 | |
2.0% | 1.4% | |
9.5 | 8.3 | |
about 15 hours ago | 26 days ago | |
Java | Java | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
incubator-uniffle
- Apache Uniffle: high performance, general purpose remote shuffle service
- Apache Uniffle: a high performance remote shuffle service for Spark
-
Apache Uniffle (incubating): Uniffle is a high performance, general purpose Remote Shuffle Service.
Our project enter the Apache incubator in the June. https://github.com/apache/incubator-uniffle
PowerJob
- Distributed job-scheduling framework of the next generation - PowerJob
-
JobRunr VS PowerJob - a user suggested alternative
2 projects | 21 Dec 2021
-
PowerJob V3.4.3 has been released. Check to see the work. Suggestions are welcomed.
Oh yes! You can see the registered users in Known users. They are companies in China as we didn't promote to foreign friends. Cisco, Jd.com, OPPO are all big companies there in China.
-
My experience of hunting for job-scheduling framework
And frankly the readme on https://github.com/PowerJob/PowerJob should be rewritten. Texts in the line of "PowerJob is the best thing since sliced bread" has no place in open source. Explain what it does well, what it doesn't do well, where it can be used, where it should not be used, and how it works.
- PowerJob - Distributed job-scheduling framework of the next generation for Java Applications.
- Next generation of job-scheduling framework - PowerJob
- Distributed job-scheduling framework of the next generation - PowerJob!
What are some alternatives?
flink-remote-shuffle - Remote Shuffle Service for Flink
db-scheduler - Persistent cluster-friendly scheduler for Java
Deeplearning4j - Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
JobRunr - An extremely easy way to perform background processing in Java. Backed by persistent storage. Open and free for commercial use.
Alluxio (formerly Tachyon) - Alluxio, data orchestration for analytics and machine learning in the cloud
kestra - Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Zeppelin - Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
openjob - Distributed high performance task scheduling framework
doris - Apache Doris is an easy-to-use, high performance and unified analytics database.
Sundial - A Light-weight Job Scheduling Framework
Wisp - A simple Java Scheduler library with a minimal footprint and a straightforward API
jolikit - Java APIs to abstract away time (clocks, schedulers), simple 2D UIs (BWD), and a bit more, with default implementations