{
  "slug": "design-effect",
  "term": "Design effect",
  "aliases": [
    "DEFF"
  ],
  "definition": "A design effect compares an estimator's variance under a sampling design with its variance under a specified simple-random-sampling reference.",
  "note": "A design effect belongs to an estimator, outcome and reference design, not to a dataset alone. Variance inflation by D corresponds to a standard-error multiplier sqrt(D), not D. [statcan-design]\n\nFor the equally weighted mean of N observations in fixed independent groups of sizes m_g, assume a common marginal variance and common within-group pair correlation rho. Summing covariances gives D = 1 + rho * (sum(m_g^2)/N - 1) relative to N independent observations with that variance. Equal sizes m reduce this to 1 + (m - 1) * rho. The unequal-size expression weights large groups more heavily. [cameron-miller-2015] [hesela-design-effect]\n\nHere N/D is a variance-equivalent sample size for this mean. It is not a count of independent groups, a degree of freedom or permission to substitute N/D into an exact binomial interval. Other weights, unequal risks, censoring or dependence across groups need a different model. Rack membership alone does not establish independence. [hesela-design-effect]",
  "related": [
    "cluster-bootstrap",
    "sampling-design"
  ],
  "citations": [
    {
      "id": "statcan-design",
      "title": "Survey Methodology (2020): Considering interviewer and design effects when planning sample sizes, section 1",
      "url": "https://www150.statcan.gc.ca/n1/pub/12-001-x/2020001/article/00005/01-eng.htm",
      "accessed": "2026-11-19"
    },
    {
      "id": "cameron-miller-2015",
      "title": "Cameron and Miller (2015): A Practitioner's Guide to Cluster-Robust Inference, sections II.B and VI",
      "url": "https://www.econ.ucdavis.edu/faculty/cameron/research/Cameron_Miller_JHR_2015_February.pdf",
      "accessed": "2026-11-19"
    },
    {
      "id": "hesela-design-effect",
      "title": "Hesela: fixed-group covariance calculation, estimator scope and unequal group sizes",
      "url": "https://hesela.com/analyses/afr-rate-not-probability/#design-effect",
      "accessed": "2026-11-19"
    }
  ],
  "provenance": [
    "The storage example is an exact calculation under specified covariance assumptions, not a measured intraclass correlation or a survey-design estimate for a real fleet."
  ],
  "status": "shipping",
  "advantages": [],
  "limitations": [],
  "supersedes": [],
  "supersededBy": [],
  "firstSeen": null,
  "lastSeen": null,
  "updated": "2026-11-19"
}
