Delta encoding
Delta encoding represents a numeric sequence using an initial value and differences between successive values.
Transform: Subtract each preceding value and retain the first value for reconstruction. Small differences can suit compact integer codes; differencing alone does not establish a byte saving. [1]
Parquet: DELTA_BINARY_PACKED subtracts a block minimum from adjacent differences, then bit-packs residuals. This is not delta-of-delta encoding. Its INT32/INT64 arithmetic requires two's-complement wrapping on overflow. [1]
Scope: Numeric differencing is distinct from file-level delta synchronization, differential backups and Elias delta codes.
Relations
- related
- Delta compression, Gorilla compression, Delta-of-delta encoding, Apache Parquet, Lossless compression
Citations
Sources & caveats
- Primary-source synthesis. The linked exact-integer illustration is not a Parquet encoder or a compression benchmark.