Lz4

Open-source projects categorized as Lz4
Edit details
Language: + C + JavaScript + C# + Go + Rust + Assembly + Haskell
Topics: Compression Brotli Zstd Gzip Lzma
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 15 Lz4 Open-Source Projects

  • LZ4

    Extremely Fast Compression algorithm

    • Project mention: Number sizes for LZ77 compression | /r/compression | 2023-04-30

    LZ4 is a bit more complicated, but seems faster: https://github.com/lz4/lz4/blob/dev/doc/lz4_Block_format.md

  • MessagePack for C# (.NET, .NET Core, Unity, Xamarin)

    Extremely Fast MessagePack Serializer for C#(.NET, .NET Core, Unity, Xamarin). / msgpack.org[C#]

    • Project mention: .NET 9 will be putting BinaryFormatter out to pasture | news.ycombinator.com | 2024-02-11

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • 7-Zip-zstd

    7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard

    • Project mention: WinRAR musste shady werden. | /r/de | 2023-12-10

  • archiver

    Easily create & extract archives, and compress & decompress files of various formats

  • pgBackRest

    Reliable PostgreSQL Backup & Restore

    • Project mention: pgBackRest: PostgreSQL S3 backups | dev.to | 2023-08-10

    This tutorial explains how to backup PostgreSQL database using pgBackRest and S3.

  • lzbench

    lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

    • Project mention: Chrome Feature: ZSTD Content-Encoding | news.ycombinator.com | 2024-04-01

    For a benchmark on a standard set: https://github.com/inikep/lzbench/blob/master/lzbench18_sort...

  • p7zip

    A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • lizard

    Lizard (formerly LZ5) is an efficient compressor with very fast decompression. It achieves compression ratio that is comparable to zip/zlib and zstd/brotli (at low and medium compression levels) at decompression speed of 1000 MB/s and faster. (by inikep)

  • node-lz4

    LZ4 fast compression algorithm for NodeJS

  • TurboBench

    Compression Benchmark

    • Project mention: Zstd Content-Encoding planned to ship with Chrome 123 | news.ycombinator.com | 2024-02-07

    I'm still unconvinced about this addition. And I don't even dislike Zstandard.

    The main motivation seems to be that while Zstandard is worse than Brotli at the highest level, it's substantially faster than Brotli when data has to be compressed on the fly with a limited computation budget. That might be true, but I'm yet to see any concrete or even anecdotal evidence even in the issue tracker [1] while there exist some benchmarks where both Zstandard and Brotli are fast enough for the web usage even at lower levels [2].

    According to their FAQ [3] Meta and Akamai have successfully used Zstandard in their internal network, but my gut feeling is that they never actually tried to optimize Brotli instead. In fact, Meta employs the main author of Zstandard so it would have been easier to tune Zstandard instead of Brotli. While Brotli has some fundamental difference from Zstandard (in particular Brotli doesn't use arithmetic-equivalent coding), no one has concretely demonstrated that difference would prevent Brotli from being fast enough for dynamic contents in my opinion.

    [1] https://issues.chromium.org/issues/40196713

    [2] https://github.com/powturbo/TurboBench/issues/43

    [3] https://docs.google.com/document/d/14dbzMpsYPfkefAJos124uPrl...

  • lz4-napi

    Fastest lz4 compression library in Node.js, powered by napi-rs and lz4-flex.

  • mozlz4-tool

    A tool to process mozlz4 files

  • lz4_rv32i_decode

    LZ4 decoder in assembly for RiscV RV32IC

  • lz4-frame-conduit

    Haskell Conduit implementing the official LZ4 frame streaming format

  • lz4-conduit

    LZ4 Compression for Haskell Conduits (Data.Conduit)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Lz4 related posts

Index

What are some of the best open-source Lz4 projects? This list will help you:

Project Stars
1 LZ4 9,192
2 MessagePack for C# (.NET, .NET Core, Unity, Xamarin) 5,245
3 7-Zip-zstd 4,662
4 archiver 4,228
5 pgBackRest 2,194
6 lzbench 841
7 p7zip 735
8 lizard 633
9 node-lz4 432
10 TurboBench 310
11 lz4-napi 47
12 mozlz4-tool 9
13 lz4_rv32i_decode 9
14 lz4-frame-conduit 5
15 lz4-conduit 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com