block-independent-compression · shipping · also Independent compressed blocks

Block-independent compression

Block-independent compression encodes each block without requiring decoded history from preceding blocks.

Related Observatory article: Block-independent compression on hesela.com

LZ4 independent blocks can still share an external dictionary. Independence removes preceding-block history, not dictionary, boundary or size requirements. A raw block interface needs surrounding metadata to supply decoding bounds. [1] [2]

Random access also requires locating the requested block and deciding what integrity checks cover a partial read. A whole-frame content check cannot be completed from only one selected block. Reordering independently decodable blocks can change the restored object while each block checksum still passes. [3]

Relations

related
LZ4 frame, Compression dictionary, Read amplification, Checksum

Citations

  1. LZ4 Frame Format 1.6.4, pinned to v1.10.0: block independence, checksums and dictionaries (accessed 2026-10-18)
  2. LZ4 v1.9.4 block format: out-of-band metadata and decoding bounds (accessed 2026-10-18)
  3. Hesela: LZ4 frame checks, block order and completion (accessed 2026-10-18)

JSON: /data/terms/block-independent-compression.json

Published by Hesela team · Updated

Report a correction · Editorial standards · Reuse guidance

Cite this page
Hesela team. Block-independent compression. Hesela. 2026-10-18. https://hesela.dev/terms/block-independent-compression/