## ::Statistical hypothesis testing

### ::concepts

{{#invoke:redirect hatnote|redirect}}
A **statistical hypothesis** is a hypothesis that is testable on the basis of observing a process that is modeled via a set of random variables.<ref>Stuart A., Ord K., Arnold S. (1999), *Kendall's Advanced Theory of Statistics: Volume 2A—Classical Inference & the Linear Model* (Arnold) §20.2.</ref> A **statistical hypothesis test** is a method of statistical inference. Commonly, two statistical data sets are compared, or a data set obtained by sampling is compared against a synthetic data set from an idealized model. A hypothesis is proposed for the statistical relationship between the two data sets, and this is compared as an alternative to an idealized null hypothesis that proposes no relationship between two data sets. The comparison is deemed *statistically significant* if the relationship between the data sets would be an unlikely realization of the null hypothesis according to a threshold probability—the significance level. Hypothesis tests are used in determining what outcomes of a study would lead to a rejection of the null hypothesis for a pre-specified level of significance. The process of distinguishing between the null hypothesis and the alternative hypothesis is aided by identifying two conceptual types of errors (type 1 & type 2), and by specifying parametric limits on e.g. how much type 1 error will be permitted.

An alternative framework for statistical hypothesis testing is to specify a set of statistical models, one for each candidate hypothesis, and then use model selection techniques to choose the most appropriate model.<ref>{{#invoke:citation/CS1|citation |CitationClass=citation }}.</ref> The most common selection techniques are based on either Akaike information criterion or Bayes factor.

Statistical hypothesis testing is sometimes called **confirmatory data analysis**. It can be contrasted with exploratory data analysis, which may not have pre-specified hypotheses.

**Statistical hypothesis testing sections**

Intro Variations and sub-classes The testing process Examples Definition of terms Common test statistics Origins and early controversy Null hypothesis statistical significance testing vs. hypothesis testing Criticism Alternatives Philosophy Education See also References Further reading External links

PREVIOUS: Intro | NEXT: Variations and sub-classes |

<< | >> |

Journal::testing First::title Neyman::pearson Fisher::volume Pages::which Sample::theory

{{#invoke:redirect hatnote|redirect}}
A **statistical hypothesis** is a hypothesis that is testable on the basis of observing a process that is modeled via a set of random variables.<ref>Stuart A., Ord K., Arnold S. (1999), *Kendall's Advanced Theory of Statistics: Volume 2A—Classical Inference & the Linear Model* (Arnold) §20.2.</ref> A **statistical hypothesis test** is a method of statistical inference. Commonly, two statistical data sets are compared, or a data set obtained by sampling is compared against a synthetic data set from an idealized model. A hypothesis is proposed for the statistical relationship between the two data sets, and this is compared as an alternative to an idealized null hypothesis that proposes no relationship between two data sets. The comparison is deemed *statistically significant* if the relationship between the data sets would be an unlikely realization of the null hypothesis according to a threshold probability—the significance level. Hypothesis tests are used in determining what outcomes of a study would lead to a rejection of the null hypothesis for a pre-specified level of significance. The process of distinguishing between the null hypothesis and the alternative hypothesis is aided by identifying two conceptual types of errors (type 1 & type 2), and by specifying parametric limits on e.g. how much type 1 error will be permitted.

An alternative framework for statistical hypothesis testing is to specify a set of statistical models, one for each candidate hypothesis, and then use model selection techniques to choose the most appropriate model.<ref>{{#invoke:citation/CS1|citation |CitationClass=citation }}.</ref> The most common selection techniques are based on either Akaike information criterion or Bayes factor.

Statistical hypothesis testing is sometimes called **confirmatory data analysis**. It can be contrasted with exploratory data analysis, which may not have pre-specified hypotheses.

**Statistical hypothesis testing sections**

Intro Variations and sub-classes The testing process Examples Definition of terms Common test statistics Origins and early controversy Null hypothesis statistical significance testing vs. hypothesis testing Criticism Alternatives Philosophy Education See also References Further reading External links

PREVIOUS: Intro | NEXT: Variations and sub-classes |

<< | >> |