{
  "slug": "p-value",
  "term": "P-value",
  "aliases": [
    "p value",
    "statistical p-value"
  ],
  "definition": "A p-value is the probability, under a specified null model, of a test result at least as extreme as the observed one according to the chosen test.",
  "note": "A p-value does not assign a probability to the null hypothesis or measure the size or practical importance of an effect. Report the test, assumptions and analysis choices alongside an effect estimate and appropriate uncertainty. [asa-2016]\n\nFor two independent Poisson counts at fixed equal exposures, conditioning on their total under an equal-rate null gives a binomial count with probability 1/2. The same observed rates can yield very different p-values at different exposures. This comparison is distinct from a survival-distribution test. [r-poisson] [rate-example]\n\nA small p-value can also reflect failure of the model assumptions; it cannot identify which assumption failed or establish a causal hardware difference. [asa-full]",
  "related": [
    "log-rank-test",
    "poisson-rate-model",
    "confidence-interval",
    "confidence-sequence"
  ],
  "citations": [
    {
      "id": "asa-2016",
      "title": "ASA (2016): Statement on Statistical Significance and P-Values, six principles",
      "url": "https://www.amstat.org/asa/files/pdfs/P-ValueStatement.pdf",
      "accessed": "2026-11-19"
    },
    {
      "id": "r-poisson",
      "title": "R stats: Exact Poisson tests, conditioning on the total event count",
      "url": "https://stat.ethz.ch/R-manual/R-patched/library/stats/html/poisson.test.html",
      "accessed": "2026-11-19"
    },
    {
      "id": "rate-example",
      "title": "Hesela: Equal-exposure rate comparison, exact synthetic example and method limits",
      "url": "https://hesela.com/analyses/afr-rate-not-probability/#p-values",
      "accessed": "2026-11-19"
    },
    {
      "id": "asa-full",
      "title": "Wasserstein and Lazar (2016): The ASA's Statement on p-Values: Context, Process, and Purpose; principles 1 and 6",
      "url": "https://doi.org/10.1080/00031305.2016.1154108",
      "accessed": "2026-11-19"
    }
  ],
  "status": "research",
  "advantages": [],
  "limitations": [
    "Selecting comparisons after seeing results or stopping at a favorable value changes the inferential problem. A test threshold alone is not a scientific or engineering decision rule. [asa-2016]"
  ],
  "supersedes": [],
  "supersededBy": [],
  "firstSeen": null,
  "lastSeen": null,
  "updated": "2026-11-19"
}
