Match over 1 GB of data with inconsistent names

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
fuzzy-matching Spark Deduplication entity-resolution fuzzymatch

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • zingg

    Scalable identity resolution, entity resolution, data mastering and deduplication using ML

    • I am working on an open source tool that uses ml for fuzzy matching - https://github.com/zinggAI/zingg . Hope you find it useful. Happy to help.

  • splink

    Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

    • here you go: https://github.com/moj-analytical-services/splink

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts