zstandard · shipping · also zstd

Zstandard

Zstandard is a lossless compression format and codec that stores data in frames with optional external dictionaries and content checksums.

Related Observatory article: Zstandard on hesela.com

Concatenated frames decode to concatenated output. A valid remaining frame does not prove that an intended later frame is still present. [1] [3]

Seekable Zstandard adds a seek table in a final skippable frame, allowing a range to be located without decoding the entire preceding stream. Ordinary Zstandard framing does not itself provide that index. [2]

The measured CLI experiment distinguishes a checksum stored in a frame from read-time verification: explicitly ignoring the checksum accepted wrong dictionary-derived bytes. Its payload oracle also accepted changed skippable metadata because those bytes were not part of decoded output. [3]

A frame dictionary ID can reject a differently labeled dictionary without a content checksum. Conversely, matching IDs did not detect a controlled dictionary-content mutation in Hesela's formatted-dictionary experiment; the verified content checksum caught that particular mismatch. [3]

Relations

related

compression-dictionary, checksum, backup-verification, transparent-compression, skippable-frame, zstandard-dictionary-id

Citations

1. RFC 8878: Zstandard Compression, sections 3.1, 3.1.1.1.3 and 5 (accessed 2026-10-17)
2. Zstandard seekable format 0.1.0, pinned to v1.5.7 (accessed 2026-10-17)
3. Hesela: Compressed archives, dictionary dependencies and validation coverage (accessed 2026-10-17)

JSON: /data/terms/zstandard.json