dblink
mmlspark
| dblink | mmlspark | |
|---|---|---|
| 1 | 2 | |
| 54 | 2,489 | |
| - | - | |
| 0.0 | 9.3 | |
| almost 3 years ago | over 2 years ago | |
| Scala | Scala | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dblink
-
[D] Machine Learning and "Record Linkage"
Felligi-Sunter is the baseline model in record linkage research. It is implemented in R in fastLink and RecordLinkage, but you will need training data. There are some other options, e.g. dblink, that use Bayesian methods and a latent variable set up so you don’t need training data.
mmlspark
What are some alternatives?
entity-embed - PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.
SynapseML - Simple and Distributed Machine Learning
splink - Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
isolation-forest - A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.
sparkMeasure - This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.
polyaxon - MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
delight - A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
Activeloop Hub - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets. Stream data real-time to PyTorch/TensorFlow. https://activeloop.ai [Moved to: https://github.com/activeloopai/deeplake]
Spark Utils - Basic framework utilities to quickly start writing production ready Apache Spark applications
metarank - A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine
Spark Tools - Executable Apache Spark Tools: Format Converter & SQL Processor
qbeast-spark - Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!