Top 7 sensitive-data Open-Source Projects

DataProfiler

61 1,362 6.3 Python

What's in your data? Extract schema, statistics and entities from datasets

Project mention: LongRoPE: Extending LLM Context Window Beyond 2M Tokens | news.ycombinator.com | 2024-02-22

It's been possible to skip tokenization for a long time, my team and I did it here - https://github.com/capitalone/DataProfiler
For what it's worth, we actually were working with LSTMs with nearly a billion params back in 2016-2017 area. Transformers made it far more effective to train and execute, but ultimately LSTMs are able to achieve similar results, though slow & require more training data.

Hemmelig.app

26 641 8.9 JavaScript

Keep your sensitive information out of chat logs, emails, and more with encrypted secrets.

Project mention: Hemmelig: Paste a password, confidential message, or private data | news.ycombinator.com | 2024-04-23

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
deadshot

2 188 0.0 Python

Deadshot is a Github pull request scanner to identify sensitive data being committed to a repository
Isopoh.Cryptography.Argon2

2 179 5.2 C#

Fully managed .Net Core implementation of Argon2
json-masker

1 125 8.8 Java

High-performance JSON masker library in Java with no runtime dependencies

Project mention: FLaNK Stack Weekly 06 Nov 2023 | dev.to | 2023-11-06

ssh-crypt

1 24 6.9 Python

This tool helps you to keep passwords inside your shell scripts safely

Project mention: Show HN: SSH-crypt – helps to keep passwords in your shell scripts safely | news.ycombinator.com | 2023-08-29

data-guardian

0 10 7.9 TypeScript

Tiny, zero-dependencies, package which tries to mask sensitive data in arbitrary collections (map, set), errors, objects and strings.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).