Statistical Inference
What is Statistical Inference?
The entire group of individuals or items that is of interest in a study.
Key formula / rule: Confidence Interval for Population Mean (known variance)
Key points
- Understand the purpose and methods of statistical inference.
- Differentiate between estimation and hypothesis testing.
- Interpret confidence intervals and p-values correctly.
- Apply basic inferential techniques to sample data.
Common exam trap
Confusing sample statistics with population parameters.
Definitions
- Term
Population
- Meaning
The entire group of individuals or items that is of interest in a study.
- Term
Sample
- Meaning
A subset of the population from which data is collected.
- Term
Parameter
- Meaning
A numerical characteristic of a population (e.g., population mean μ).
- Term
Statistic
- Meaning
A numerical characteristic of a sample (e.g., sample mean x̄).
- Term
Confidence Interval (CI)
- Meaning
A range of values, derived from sample statistics, that is likely to contain the value of an unknown population parameter.
- Term
Hypothesis Testing
- Meaning
A statistical method used to make decisions about a population based on sample data, by testing a specific claim (null hypothesis).
- Term
Null Hypothesis (H0)
- Meaning
A statement of no effect or no difference, which is assumed to be true until evidence suggests otherwise.
- Term
Alternative Hypothesis (H1)
- Caution
Also known as the research hypothesis, it is a statement that contradicts the null hypothesis.
- Term
P-value
- Meaning
The probability of obtaining test results at least as extreme as the results actually observed, assuming that the null hypothesis is correct.
- Term
Significance Level (α)
- Meaning
The probability of rejecting the null hypothesis when it is actually true (Type I error rate).
Learning objectives
Understand the purpose and methods of statistical inference.
Differentiate between estimation and hypothesis testing.
Interpret confidence intervals and p-values correctly.
Apply basic inferential techniques to sample data.
Formulae
- Name
Confidence Interval for Population Mean (known variance)
- Note
Where x̄ is sample mean, σ is population standard deviation, n is sample size, and Zα/2 is the critical Z-value for the desired confidence level.
- Expression
x̄ ± Zα/2 * (σ/√n)
- Name
Confidence Interval for Population Mean (unknown variance)
- Note
Where s is sample standard deviation and tα/2,n-1 is the critical t-value with n-1 degrees of freedom.
- Expression
x̄ ± tα/2,n-1 * (s/√n)
- Name
Z-test for Population Mean
- Note
Used when population standard deviation (σ) is known or sample size is large (n>30). μ0 is the hypothesized population mean.
- Expression
Z = (x̄ - μ0) / (σ/√n)
- Name
t-test for Population Mean
- Note
Used when population standard deviation is unknown and sample size is small (n<30).
- Expression
t = (x̄ - μ0) / (s/√n)
Prerequisites
Basic Probability Theory
Descriptive Statistics (mean, median, variance)
Understanding of Population vs. Sample
Sampling Distributions
Common mistakes
Confusing sample statistics with population parameters.
Misinterpreting confidence intervals (e.g., thinking a 95% CI means there's a 95% chance the true parameter is within that specific interval).
Incorrectly applying hypothesis testing procedures (e.g., confusing Type I and Type II errors).
Using small sample sizes without considering the implications for inference.
Keywords
Inference
Estimation
Hypothesis Testing
Confidence Interval
P-value
Sampling Distribution
Central Limit Theorem
Z-test
t-test
Population
Sample
Practice preview
Which of the following is a primary goal of statistical inference?…
easy
Which of the following statements about hypothesis testing is INCORRECT?…
medium
A sample statistic is used to estimate a:…
easy