fastcdc · shipping · also Fast Content-Defined Chunking

FastCDC

FastCDC is a content-defined chunking approach that combines Gear-based boundary selection, sub-minimum skipping and chunk-size normalization.

The 2016 design changes boundary-test strictness before and after a target length. Normalization narrows the size distribution rather than making chunks fixed-sized; reported speedups apply to the paper's implementations and workloads, not every backup system. [fastcdc]

Relations

related

content-defined-chunking, rolling-hash, deduplication

Citations

1. Wen Xia, Yukun Zhou, Hong Jiang, Dan Feng, Yu Hua, Yuchong Hu, Yucheng Zhang and Qing Liu. FastCDC: A Fast and Efficient Content-Defined Chunking Approach for Data Deduplication. USENIX ATC 2016, pp. 101-114, sections 4-5. (accessed 2026-10-12)
2. Content-defined chunking: boundaries are not identity (accessed 2026-10-12)

JSON: /data/terms/fastcdc.json