frame-of-reference · shipping · also FOR encoding, Frame of reference

Frame-of-reference encoding

Frame-of-reference encoding represents integer values as offsets from a shared reference value, commonly a block minimum, so the offsets can use a reduced bit width.

Related Observatory article: Read on hesela.com

Base: For 1000, 1001, 1003 and 1007, a base of 1000 leaves offsets 0, 1, 3 and 7. Three bits per offset give 12 payload bits; base, count, width and padding still need accounting. A constant block can use zero offset bits when its base and count are retained. [1] [3]

Composition: Parquet DELTA_BINARY_PACKED first computes adjacent differences, then subtracts the minimum difference in each block and packs residuals per miniblock. Its reference is a minimum delta, not a minimum original value. Counts, first value, block geometry and widths remain necessary decoding context. [2]

Access: Recovering a plain FOR value is base plus offset once its block and metadata are located; this does not establish file-level constant-time access. Changing a base can change every reconstructed value without breaking the arithmetic. Terminology varies, and some FOR implementations use an implicit zero base. [1] [3]

Arithmetic: Parquet requires two's-complement wraparound at the physical integer width for differences and reconstruction. The 64-bit transition from 2^63-1 to -2^63 therefore has wrapped delta 1, not the unbounded difference 1-2^64. [2]

Relations

related
Bit packing, Patched frame-of-reference, Lossless compression, Apache Parquet

Citations

  1. Lemire and Boytsov: Decoding billions of integers per second through vectorization, sections 2.6-2.8 and 5 (accessed 2026-11-17)
  2. Apache Parquet: DELTA_BINARY_PACKED encoding (accessed 2026-11-17)
  3. Hesela: frame-of-reference arithmetic and exception example (accessed 2026-11-17)
Sources & caveats
  • Primary-source synthesis plus a bounded signed-64-bit integer illustration; no native codec benchmark, format-compatibility claim or new empirical result.

JSON: /data/terms/frame-of-reference.json

Published by Hesela team · Updated

Report a correction · Editorial standards · Reuse guidance

Cite this page
Hesela team. Frame-of-reference encoding. Hesela. 2026-11-17. https://hesela.dev/terms/frame-of-reference/