Probability and Statistics
What is Probability and Statistics?
The set of all possible outcomes of a random experiment.
Key formula / rule: Addition Rule
Key points
- Understand the basic principles of probability and its applications.
- Differentiate between discrete and continuous random variables.
- Identify and apply common probability distributions.
- Calculate and interpret measures of central tendency and dispersion.
Common exam trap
Confusing independent and dependent events.
Definitions
- Term
Sample Space
- Meaning
The set of all possible outcomes of a random experiment.
- Term
Event
- Meaning
A subset of the sample space, representing a specific outcome or set of outcomes.
- Term
Random Variable
- Meaning
A variable whose value is a numerical outcome of a random phenomenon.
- Term
Probability Distribution
- Meaning
A function that describes the likelihood of obtaining the possible values that a random variable can assume.
- Term
Mean (Expected Value)
- Meaning
The average value of a random variable, weighted by its probabilities.
- Term
Variance
- Meaning
A measure of the spread or dispersion of a random variable's values around its mean.
- Term
Standard Deviation
- Meaning
The square root of the variance, providing a measure of spread in the same units as the data.
- Term
Central Limit Theorem (CLT)
- Meaning
A theorem stating that the distribution of sample means approximates a normal distribution as the sample size becomes large.
- Term
Hypothesis Testing
- Meaning
A statistical method used to make decisions or draw conclusions about a population based on sample data.
- Term
Null Hypothesis (H0)
- Meaning
A statement about a population parameter that is assumed to be true until evidence suggests otherwise.
- Term
Alternative Hypothesis (H1)
- Meaning
A statement that contradicts the null hypothesis, representing what we are trying to find evidence for.
Learning objectives
Understand the basic principles of probability and its applications.
Differentiate between discrete and continuous random variables.
Identify and apply common probability distributions.
Calculate and interpret measures of central tendency and dispersion.
Understand the concepts of statistical estimation and hypothesis testing.
Apply the Central Limit Theorem to approximate distributions.
Analyze engineering problems using probabilistic and statistical methods.
Formulae
- Name
Addition Rule
- Note
Probability of A or B occurring.
- Expression
P(A ∪ B) = P(A) + P(B) - P(A ∩ B)
- Name
Multiplication Rule (Dependent Events)
- Note
Probability of both A and B occurring.
- Expression
P(A ∩ B) = P(A|B)P(B) = P(B|A)P(A)
- Name
Multiplication Rule (Independent Events)
- Note
Probability of both A and B occurring when they are independent.
- Expression
P(A ∩ B) = P(A)P(B)
- Name
Conditional Probability
- Note
Probability of A given that B has occurred.
- Expression
P(A|B) = P(A ∩ B) / P(B)
- Name
Binomial Distribution (PMF)
- Note
For n independent Bernoulli trials with success probability p.
- Expression
P(X=k) = C(n, k) * pk * (1-p)^(n-k) for k = 0, 1, ..., n
- Name
Binomial Distribution (Mean)
- Note
Mean of a binomial distribution.
- Expression
E[X] = np
- Name
Binomial Distribution (Variance)
- Note
Variance of a binomial distribution.
- Expression
Var(X) = np(1-p)
- Name
Poisson Distribution (PMF)
- Note
For events occurring at a constant average rate λ in a fixed interval.
- Expression
P(X=k) = (e^(-λ) * λk) / k! for k = 0, 1, 2, ...
- Name
Poisson Distribution (Mean)
- Note
Mean of a Poisson distribution.
- Expression
E[X] = λ
- Name
Poisson Distribution (Variance)
- Note
Variance of a Poisson distribution.
- Expression
Var(X) = λ
- Name
Normal Distribution (PDF)
- Note
Probability density function for a normal distribution with mean μ and standard deviation σ.
- Expression
f(x) = (1 / (σ√(2π))) * exp(-(x-μ)² / (2σ²))
- Name
Normal Distribution (Mean)
- Note
Mean of a normal distribution.
- Expression
E[X] = μ
- Name
Normal Distribution (Variance)
- Note
Variance of a normal distribution.
- Expression
Var(X) = σ²
- Name
Central Limit Theorem
- Note
Applies to the distribution of sample means.
- Expression
For a large sample size n, the distribution of the sample mean (X̄) is approximately Normal with mean μ and variance σ²/n, regardless of the population distribution.
- Name
Sample Mean
- Note
The average of n sample observations.
- Expression
X̄ = (Σ Xi) / n
- Name
Sample Variance
- Note
An unbiased estimator of population variance.
- Expression
s² = (Σ (Xi - X̄)²) / (n-1)
Prerequisites
Basic Set Theory
Algebra
Functions
Common mistakes
Confusing independent and dependent events.
Incorrectly applying probability formulas, especially for conditional probabilities.
Misinterpreting the parameters of probability distributions.
Errors in calculating mean, variance, or standard deviation.
Overlooking the assumptions required for statistical tests (e.g., normality).
Practice preview
The mean of a discrete random variable X is given by E[X] = Σ [x * P(X=x)]. If X is a random variable representing the number of heads in two tosses of a fair coin, what is the expected value of X?…
medium
The mean of a discrete random variable X is given by E[X] = Σ [x * P(X=x)]. If X is a random variable representing the number of defective items in a sample of 4 items, and the probability of an item being defective is 0…
medium
A random variable X follows a Poisson distribution with parameter lambda = 3. What is the probability P(X=2)?…
medium