Breeze
SynapseML
Our great sponsors
Breeze | SynapseML | |
---|---|---|
3 | 18 | |
3,433 | 4,964 | |
0.2% | 0.5% | |
5.1 | 8.9 | |
2 months ago | 7 days ago | |
Scala | Scala | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Breeze
-
Arbitrary functions of n dimensions in Scala
Also, you can look at breeze.generic.UFunc for an inspiration.
-
Data science in Scala
You can use https://github.com/scalanlp/breeze. A Scala library that's sorta a numpy/plotting equivalent. Unlike Spark which covers more use cases than just the classic Data Science workflow, Breeze is built specifically for "Data Science in Scala". The drawback is a classic one in Scala land where some major libraries abruptly get abandoned. Breeze's commits seem to have slowed down significantly and their website on their github page www.scalanlp.org is broken.
-
Machine learning on JVM
I haven't checked in on this project in a long time, but Breeze is something akin to NumPy/SciPy.
SynapseML
- FLaNK Stack Weekly for 12 September 2023
-
Microsoft announces new tool for applying ChatGPT and GPT-4 at massive scales
Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.11.0
-
Data science in Scala
b) There are libraries around e.g. Microsoft SynapseML, LinkedIn Photon ML
- [N] Microsoft Announces New Integrations with OpenAI and MLFlow
- [N] Microsoft Releases new Integrations with OpenAI and MLflow as part of SynapseML
-
[P] Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on large-scale data
Link to Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.9.5
- Microsoft releases SynapseML v0.9.5 for distributed geospatial analytics, speech synthesis, and anomaly detection in PySpark.
- [P] SynapseML v0.9.5 announces support for geospatial analytics, speech synthesis, and anomaly detection on large-scale datasets
- Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on Apache Spark
What are some alternatives?
ND4S - ND4S: N-Dimensional Arrays for Scala. Scientific Computing a la Numpy. Based on ND4J.
mmlspark - Simple and Distributed Machine Learning [Moved to: https://github.com/microsoft/SynapseML]
Spire - Powerful new number types and numeric abstractions for Scala.
isolation-forest - A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
Tensorflow_scala - TensorFlow API for the Scala Programming Language
Smile - Statistical Machine Intelligence & Learning Engine
deequ - Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Saddle
azure-kusto-spark - Apache Spark Connector for Azure Kusto
Numsca - numsca is numpy for scala
cobrix - A COBOL parser and Mainframe/EBCDIC data source for Apache Spark