mlops-v2
SynapseML
mlops-v2 | SynapseML | |
---|---|---|
3 | 18 | |
451 | 4,970 | |
3.5% | 0.2% | |
3.7 | 9.0 | |
16 days ago | 4 days ago | |
Shell | Scala | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mlops-v2
- MLOps: Machine learning model management - Azure Machine Learning | Microsoft Learn
- Need help with Execute Python Script module in Azure ML Designer
-
Create a Managed ML Inference Endpoint and deployment using Terraform
I would create a second step or stage for deploying the endpoint. There is no benefit to try and force terraform to do something it wasn't designed for. You can run AZ CLI commands from terraform, but I don't have experience doing so. Check out this mlops accelerator - https://github.com/Azure/mlops-v2 You can see how they use multiple pipeline for setting up the infrastructure then training and deploying the model.
SynapseML
- FLaNK Stack Weekly for 12 September 2023
-
Microsoft announces new tool for applying ChatGPT and GPT-4 at massive scales
Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.11.0
-
Data science in Scala
b) There are libraries around e.g. Microsoft SynapseML, LinkedIn Photon ML
- [N] Microsoft Announces New Integrations with OpenAI and MLFlow
- [N] Microsoft Releases new Integrations with OpenAI and MLflow as part of SynapseML
-
[P] Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on large-scale data
Link to Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.9.5
- Microsoft releases SynapseML v0.9.5 for distributed geospatial analytics, speech synthesis, and anomaly detection in PySpark.
- [P] SynapseML v0.9.5 announces support for geospatial analytics, speech synthesis, and anomaly detection on large-scale datasets
- Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on Apache Spark
What are some alternatives?
Time-Series-Library - A Library for Advanced Deep Time Series Models.
mmlspark - Simple and Distributed Machine Learning [Moved to: https://github.com/microsoft/SynapseML]
Data-Engineering-Roadmap - Roadmap for Data Engineering
isolation-forest - A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.
MachineLearningNotebooks - Python notebooks with ML and deep learning examples with Azure Machine Learning Python SDK | Microsoft
Tensorflow_scala - TensorFlow API for the Scala Programming Language
azure - Azure-related repository
deequ - Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
clearml - ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
Breeze - Breeze is a numerical processing library for Scala.
computervision-recipes - Best Practices, code samples, and documentation for Computer Vision.
azure-kusto-spark - Apache Spark Connector for Azure Kusto