design-effect · shipping · also DEFF

Design effect

A design effect compares an estimator's variance under a sampling design with its variance under a specified simple-random-sampling reference.

Related Observatory article: Read on hesela.com

A design effect belongs to an estimator, outcome and reference design, not to a dataset alone. Variance inflation by D corresponds to a standard-error multiplier sqrt(D), not D. [1]

For the equally weighted mean of N observations in fixed independent groups of sizes m_g, assume a common marginal variance and common within-group pair correlation rho. Summing covariances gives D = 1 + rho * (sum(m_g^2)/N - 1) relative to N independent observations with that variance. Equal sizes m reduce this to 1 + (m - 1) * rho. The unequal-size expression weights large groups more heavily. [2] [3]

Here N/D is a variance-equivalent sample size for this mean. It is not a count of independent groups, a degree of freedom or permission to substitute N/D into an exact binomial interval. Other weights, unequal risks, censoring or dependence across groups need a different model. Rack membership alone does not establish independence. [3]

Relations

related
Pairs cluster bootstrap, Sampling design

Citations

  1. Survey Methodology (2020): Considering interviewer and design effects when planning sample sizes, section 1 (accessed 2026-11-19)
  2. Cameron and Miller (2015): A Practitioner's Guide to Cluster-Robust Inference, sections II.B and VI (accessed 2026-11-19)
  3. Hesela: fixed-group covariance calculation, estimator scope and unequal group sizes (accessed 2026-11-19)
Sources & caveats
  • The storage example is an exact calculation under specified covariance assumptions, not a measured intraclass correlation or a survey-design estimate for a real fleet.

JSON: /data/terms/design-effect.json

Published by Hesela team · Updated

Report a correction · Editorial standards · Reuse guidance

Cite this page
Hesela team. Design effect. Hesela. 2026-11-19. https://hesela.dev/terms/design-effect/