rolling-hash · shipping · also rolling fingerprint

Rolling hash

A rolling hash updates a fingerprint incrementally as the input window or stream advances, instead of recomputing it over the entire input each time.

Restic's chunker uses Rabin fingerprints for boundary selection. Such a boundary fingerprint is not a cryptographic identifier of the complete chunk; content identity needs a separate check. [restic-chunker]

Relations

related

content-defined-chunking, fastcdc, deduplication

Citations

1. Restic project. Chunker: Rabin-based content-defined chunking implementation and explanation. (accessed 2026-10-12)
2. Content-defined chunking: boundaries are not identity (accessed 2026-10-12)

JSON: /data/terms/rolling-hash.json