Statistical Expert Witnesses in Litigation: Evaluating Sampling, Data Analysis, and Extrapolation

The Role of Statistical Expert Witnesses in Litigation

Statistical expert witnesses help attorneys assess whether data and statistical methods support conclusions presented in disputes involving employment records, insurance claims, financial transactions, product defects, and other evidence-intensive matters.

These experts examine how data were collected and whether samples represent the populations studied. They may also identify weaknesses in the data or statistical methods and explain uncertainty and limitations.

This guide explains how statistical experts evaluate sampling reliability, data analysis, and extrapolated findings in litigation.

What Statistical Expert Witnesses Examine

Statistical expert witnesses review the records and methods behind statistical findings. The scope of their work depends on the questions in dispute and the available evidence.

Common areas of review include:

• Source data: Original records, databases, surveys, and other materials used in the analysis.

• Data quality: Missing information, duplicate records, inconsistent classifications, and measurement errors.

• Sampling procedures: Population definitions, sample selection, exclusions, and representativeness.

• Statistical models: Analytical assumptions, variable selection, calculations, and methodological suitability.

• Uncertainty: Sampling error, confidence intervals, sensitivity analyses, and other relevant measures.

• Reproducibility: Whether sufficient data, documentation, and analytical procedures are available to reproduce the reported results.

An expert may conduct an independent statistical analysis or review methods and conclusions presented by another expert.

The Reference Manual on Scientific Evidence, Fourth Edition, prepared by the National Academies of Sciences, Engineering, and Medicine in collaboration with the Federal Judicial Center, provides guidance on evaluating statistical evidence and research methods.

How Statistical Experts Evaluate Sampling Reliability

Statistical experts assess whether a sample supports reasonable conclusions about the population it is intended to represent. They review how the population was defined, how observations were selected, and whether the sampling process introduced systematic bias.

Sample Selection and Representativeness

In simple random sampling without replacement, each possible sample of a given size has an equal chance of selection, giving every member of the defined population an equal probability of inclusion. Stratified probability sampling divides the population into distinct groups, called strata, and uses probability-based methods to select observations within each group. Nonprobability sampling uses selection procedures without known selection probabilities. This limits conventional estimates of sampling error and makes conclusions about the broader population depend on assumptions about representativeness.

For example, a statistical expert examining alleged errors in insurance claim processing may assess whether a sample of disputed claims can support conclusions about all claims processed during the relevant period.

If that sample includes only high-value claims, its findings could differ from those of a sample drawn from the broader population.

Selection Bias and Sample Size

Selection bias arises when the way observations enter a sample systematically distorts estimates of the population being studied.

Increasing the sample size may reduce sampling variability under appropriate conditions, but it does not necessarily correct selection bias or inaccurate source records.

The National Institute of Standards and Technology identifies representativeness, sample size, population variability, and desired precision as considerations when assessing whether a sample is adequate.

How Statistical Experts Assess Data Analysis and Extrapolation

Statistical experts assess whether methods such as regression analysis, hypothesis testing, or statistical estimation fit the available data and support the conclusions presented.

Statistical Models and Analytical Assumptions

In an employment dispute, a statistical expert may use regression analysis to examine compensation differences while accounting for relevant variables such as experience, job responsibilities, or location.

The expert may also examine whether important variables were omitted, whether the assumptions are appropriate, and whether alternative model specifications materially change the results.

An observed statistical association does not independently establish causation. The interpretation depends on the study design, available evidence, and consideration of alternative explanations.

Statistical Extrapolation and Uncertainty

In litigation, statistical extrapolation may involve using findings from a sample to estimate characteristics of the broader population being studied.

An expert may evaluate whether the sampling design permits that inference and whether the calculations appropriately reflect uncertainty.

Confidence intervals can describe statistical uncertainty around an estimate under specified assumptions, but they do not, by themselves, account for selection bias or errors in the underlying data.

The American Statistical Association describes a p-value as the probability, under a specified statistical model, that a statistical summary of the data, such as the difference between two group averages, would be at least as extreme as the one observed. In simpler terms, a smaller p-value indicates that the observed data are less compatible with the statistical model used for the test, provided the assumptions behind the calculation hold. Statistical significance generally indicates that a result meets a chosen threshold, not that a hypothesis is true.

The American Statistical Association also cautions that statistical significance alone does not establish the practical importance of a finding.

A statistical expert should explain what the results measure, what assumptions they depend on, and whether the conclusions extend beyond the evidence.

When Attorneys May Need a Statistical Expert Witness

Attorneys may consult statistical experts when disputed evidence involves large datasets, competing quantitative analyses, or conclusions drawn from sampled observations.

Examples include:

• Employment litigation: Evaluating statistical differences in compensation, employment decisions, or recorded work hours.

• Insurance disputes: Reviewing claim datasets, sampling methods, and estimates of payment or processing errors.

• Commercial litigation: Examining transaction records, financial patterns, or statistical assumptions used in quantitative estimates.

• Product defect disputes: Assessing defect-rate estimates, sampled inspection results, and the representativeness of examined products.

Depending on the issue, the expert may have training in statistics, biostatistics, econometrics, mathematics, or another field involving quantitative analysis.

Statistical findings may inform disputed factual questions, but they do not independently resolve legal requirements concerning liability, causation, or damages.

Admissibility of Statistical Expert Testimony Under Rule 702

In federal proceedings governed by the Federal Rules of Evidence, statistical expert testimony is subject to Rule 702. The proponent must demonstrate to the court that it is more likely than not that the proposed testimony meets the rule's admissibility requirements.

The expert must be qualified by knowledge, skill, experience, training, or education. The expert's scientific, technical, or other specialized knowledge must help the trier of fact understand the evidence or determine a fact in issue. The testimony must be based on sufficient facts or data and be the product of reliable principles and methods. The expert's opinion must also reflect a reliable application of those principles and methods to the facts of the case.

The December 1, 2023 amendment made the existing "more likely than not" standard explicit in Rule 702. It also emphasized that each expert opinion must remain within what the expert's factual basis and methodology can reliably support.

For statistical testimony, the court may need to evaluate sampling procedures, data sufficiency, model assumptions, and the reliability of extrapolated findings.

When challenged, the sufficiency of an expert's factual basis and the reliable application of the methodology are questions the court must assess under Rule 702. Once the court finds the applicable admissibility requirements satisfied, remaining criticisms may concern the weight assigned to the testimony. In state-court proceedings, attorneys should check the jurisdiction's applicable expert-testimony rules.