Technology

LZ4

LZ4 is a lossless compression algorithm optimized for extreme speed, reaching decompression rates that approach the theoretical limits of RAM bandwidth.

Yann Collet designed LZ4 to prioritize throughput over maximum density: it delivers compression speeds exceeding 500 MB/s per core and scales linearly in multi-core environments. The decompression engine is significantly faster (often hitting the physical limits of hardware memory buses). This performance profile makes it the standard choice for the Linux kernel, ZFS file systems, and high-velocity data pipelines (like Apache Spark and Hadoop) where minimizing latency is more critical than saving every byte of disk space.

https://lz4.github.io/lz4/

What builders pair with LZ4

Projects using both technologies. Select a pairing to see a project.

Built with LZ4

ARM NEON 1 shared project EmergentDB 1 shared project Flat (brute-force) 1 shared project frontend 1 shared project HNSW 1 shared project IVF 1 shared project

7 more pairings

MAP-Elites 1 shared project Next 1 shared project Product Quantization 1 shared project RocksDB 1 shared project Rust 1 shared project SIMD 1 shared project x86_64 1 shared project

Pairing: ARM NEON

EmergentDB: How Evolutionary Algorithms Made My Vector Database 82x Faster

Singapore · February 11, 2026

view project | view ARM NEON

Recent Talks & Demos

Showing 1-1 of 1

Members-Only

Sign in to see who built these projects

Sign in View FAQ

EmergentDB: Evolutionary Vector Databases

Singapore Feb 11