parquet · shipping

Apache Parquet

Apache Parquet is a column-oriented file format that organizes data into row groups, column chunks and encoded pages.

Related Observatory article: Apache Parquet on hesela.com

Structure: file metadata describes row groups and column chunks; page headers describe individual pages. A reader can select a subset without decoding all data in the file. [6] [2]

Integrity: optional page checksums and their verification are separate from schema readability or correct row counts. A successful projected read is not evidence about the unselected payload. [1] [2]

Relations

related
parquet-page-checksum, checksum, file-storage, zone-map, parquet-row-group, parquet-column-chunk

Citations

  1. Apache Parquet: page checksumming (accessed 2026-10-17)
  2. Apache Arrow 21.0: read_table checksum verification and column selection (accessed 2026-10-17)
  3. Apache Parquet: file, column and page metadata (accessed 2026-10-17)

Further reading

  1. Apache Arrow 21.0: write_table page checksum option (accessed 2026-10-17)
  2. Apache Arrow 21.0.0: SerializedPageReader checksum presence guard (accessed 2026-10-17)
  3. Apache Parquet: PLAIN INT64 encoding (accessed 2026-10-17)

JSON: /data/terms/parquet.json

Published by Hesela team · Updated

Report a correction · Editorial standards · Reuse guidance

Cite this page
Hesela team. Apache Parquet. Hesela. 2026-10-17. https://hesela.dev/terms/parquet/