arena
PaddlePaddle
arena | PaddlePaddle | |
---|---|---|
1 | 6 | |
709 | 21,642 | |
1.8% | 0.6% | |
8.3 | 10.0 | |
4 days ago | 4 days ago | |
Go | C++ | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
arena
-
Volcano vs Yunikorn vs Knative
tldr; you should start with KubeFlow 99% of the time. The respective job scheduling workflows (including volano) can be managed with Kubeflow Arena. Vulcano is ok, but I personally prefer Nvidia's Merlin + Triton inference on top of ONNX and MS ONNX Runtime. I do like to train with GPU's on Merlin in GKE (TabularNV and HugeCTR's tbe), and run TFKeras ReLu models on CPU's with OpenVino on AWS EKS, to optimize costs a bit. I do use Kubeflow on top of TektonCD for OpenShift, while some folks do prefer Argo Workflows and Apache Airflow, in the end - it's all DAG pipelines, so doesn't really matter.
PaddlePaddle
-
List of AI-Models
Click to Learn more...
-
Ask HN: Are there any notable Chinese FLOSS projects?
PaddlePaddle?
https://github.com/PaddlePaddle/Paddle
Also, Baidu have quite a few OSS projects out there in general.
https://github.com/baidu
-
Volcano vs Yunikorn vs Knative
Volcano is a batch scheduler on top of Kube-batch targetting spark-operator, plain old MPI, chinesium paddlepaddle, and Kromwell HPC.
-
Baidu AI Researchers Introduce SE-MoE That Proposes Elastic MoE Training With 2D Prefetch And Fusion Communication Over Hierarchical Storage
Continue reading | Check out the paper, and Github
- I have issue with only __habs for half datatype? Please help!
- Alternatives to google collab?
What are some alternatives?
determined - Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
tensorflow - An Open Source Machine Learning Framework for Everyone
ML-Workspace - 🛠 All-in-one web-based IDE specialized for machine learning and data science.
PyTorch-NLP - Basic Utilities for PyTorch Natural Language Processing (NLP)
kube-batch - A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
Keras - Deep Learning for humans
cromwell - Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
MLflow - Open source platform for the machine learning lifecycle
xgboost - Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
gym - A toolkit for developing and comparing reinforcement learning algorithms.
python-recsys - A python library for implementing a recommender system
scikit-learn - scikit-learn: machine learning in Python