SynapseML
dive
| SynapseML | dive | |
|---|---|---|
| 18 | 91 | |
| 4,980 | 43,873 | |
| 0.4% | - | |
| 9.0 | 6.6 | |
| 7 days ago | 6 days ago | |
| Scala | Go | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SynapseML
- FLaNK Stack Weekly for 12 September 2023
-
Microsoft announces new tool for applying ChatGPT and GPT-4 at massive scales
Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.11.0
-
Data science in Scala
b) There are libraries around e.g. Microsoft SynapseML, LinkedIn Photon ML
- [N] Microsoft Announces New Integrations with OpenAI and MLFlow
- [N] Microsoft Releases new Integrations with OpenAI and MLflow as part of SynapseML
-
[P] Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on large-scale data
Link to Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.9.5
- Microsoft releases SynapseML v0.9.5 for distributed geospatial analytics, speech synthesis, and anomaly detection in PySpark.
- [P] SynapseML v0.9.5 announces support for geospatial analytics, speech synthesis, and anomaly detection on large-scale datasets
- Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on Apache Spark
dive
-
Show HN: Docker-phobia: Analyze Docker image size with a treemap
Cool, gonna try this soon. Would be great to use in combination with Dive (https://github.com/wagoodman/dive)
-
Mastering Docker Image Optimization: 6 Key Strategies for building Lighter, Faster, and Safer images
Dive is an open-source tool that allows you to explore the various layers of a Docker image. It shows you the content of each layer and helps you identify voluminous or unnecessary parts.
- Optimisation des images Docker: 6 Stratégies clés pour des images plus légeres et plus performantes
-
I reduced the size of my Docker image by 40% – Dockerizing shell scripts
Dive is a great tool for debugging this. I like image reduction work just because it gives me a chance to play with Dive: https://github.com/wagoodman/dive
One easy low hanging fruit I see a LOT for ballooning image sizes is people including the kitchen sink SDK/CLI for their cloud provider (like AWS or GCP), when they really only need 1/100 of that. The full versions of both of these tools are several hundred mb each
- Dive: A tool for exploring a Docker image, layer contents and more
- Dive – A tool for exploring each layer in a Docker image
- FLaNK Stack Weekly for 12 September 2023
-
Dive Into Docker part 4: Inspecting Docker Image
This post is going to be shorter. I'd like to highlight a tool that I really enjoy working with called "Dive" It is an essential tool when working to build and optimize docker containers.
-
Top 10 CLI Tools for DevOps Teams
Whether you work with Docker regularly or even create your own Docker containers, Dive is a great tool for streamlining image sizes, potentially helping you save storage costs and speed up deployments.
- Dive – exploring a Docker image, layer contents, and shrinking a image size
What are some alternatives?
mmlspark - Simple and Distributed Machine Learning [Moved to: https://github.com/microsoft/SynapseML]
skopeo - Work with remote images registries - retrieving information, images, signing content
isolation-forest - A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.
Lean and Mean Docker containers - Slim(toolkit): Don't change anything in your container image and minify it by up to 30x (and for compiled languages even more) making it secure too! (free and open source)
Tensorflow_scala - TensorFlow API for the Scala Programming Language
buildkit - concurrent, cache-efficient, and Dockerfile-agnostic builder toolkit
deequ - Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
lnav - Log file navigator
Breeze - Breeze is a numerical processing library for Scala.
Whaler - Program to reverse Docker images into Dockerfiles
azure-kusto-spark - Apache Spark Connector for Azure Kusto
distroless - 🥑 Language focused docker images, minus the operating system.