## ::Statistical hypothesis testing

### ::concepts

Journal::testing    First::title    Neyman::pearson    Fisher::volume    Pages::which    Sample::theory

{{#invoke:redirect hatnote|redirect}} A statistical hypothesis is a hypothesis that is testable on the basis of observing a process that is modeled via a set of random variables.<ref>Stuart A., Ord K., Arnold S. (1999), Kendall's Advanced Theory of Statistics: Volume 2A—Classical Inference & the Linear Model (Arnold) §20.2.</ref> A statistical hypothesis test is a method of statistical inference. Commonly, two statistical data sets are compared, or a data set obtained by sampling is compared against a synthetic data set from an idealized model. A hypothesis is proposed for the statistical relationship between the two data sets, and this is compared as an alternative to an idealized null hypothesis that proposes no relationship between two data sets. The comparison is deemed statistically significant if the relationship between the data sets would be an unlikely realization of the null hypothesis according to a threshold probability—the significance level. Hypothesis tests are used in determining what outcomes of a study would lead to a rejection of the null hypothesis for a pre-specified level of significance. The process of distinguishing between the null hypothesis and the alternative hypothesis is aided by identifying two conceptual types of errors (type 1 & type 2), and by specifying parametric limits on e.g. how much type 1 error will be permitted.

An alternative framework for statistical hypothesis testing is to specify a set of statistical models, one for each candidate hypothesis, and then use model selection techniques to choose the most appropriate model.<ref>{{#invoke:citation/CS1|citation |CitationClass=citation }}.</ref> The most common selection techniques are based on either Akaike information criterion or Bayes factor.

Statistical hypothesis testing is sometimes called confirmatory data analysis. It can be contrasted with exploratory data analysis, which may not have pre-specified hypotheses.

Statistical hypothesis testing sections
Intro   Variations and sub-classes   The testing process  Examples  Definition of terms  Common test statistics  Origins and early controversy  Null hypothesis statistical significance testing vs. hypothesis testing  Criticism  Alternatives  Philosophy  Education  See also  References  Further reading  External links

 PREVIOUS: Intro NEXT: Variations and sub-classes << >>