Probability and Statistics
What is Probability and Statistics?
The set of all possible outcomes of a random experiment.
Key formula / rule: Addition Rule (General)
Key points
- Understand the fundamental concepts of probability and statistics.
- Calculate probabilities for various events.
- Identify and apply common probability distributions.
- Compute and interpret measures of central tendency and dispersion.
Common exam trap
Confusing independent and dependent events.
Definitions
- Term
Sample Space
- Meaning
The set of all possible outcomes of a random experiment.
- Term
Event
- Meaning
A subset of the sample space; a collection of outcomes.
- Term
Random Variable
- Meaning
A variable whose value is a numerical outcome of a random phenomenon.
- Term
Probability Distribution
- Meaning
A function that describes the likelihood of obtaining the possible values that a random variable can assume.
- Term
Mean (Expected Value)
- Meaning
The average value of a random variable over many trials.
- Term
Variance
- Meaning
A measure of how spread out the data is from its mean.
- Term
Standard Deviation
- Meaning
The square root of the variance, providing a measure of dispersion in the same units as the data.
- Term
Hypothesis Testing
- Meaning
A statistical method used to make decisions or draw conclusions about a population based on sample data.
Learning objectives
Understand the fundamental concepts of probability and statistics.
Calculate probabilities for various events.
Identify and apply common probability distributions.
Compute and interpret measures of central tendency and dispersion.
Understand the principles of statistical inference (hypothesis testing, confidence intervals).
Apply statistical methods to analyze data and solve engineering problems.
Formulae
- Name
Addition Rule (General)
- Note
For any two events A and B.
- Expression
P(A ∪ B) = P(A) + P(B) - P(A ∩ B)
- Name
Addition Rule (Mutually Exclusive)
- Note
If A and B cannot occur together (P(A ∩ B) = 0).
- Expression
P(A ∪ B) = P(A) + P(B)
- Name
Multiplication Rule (General)
- Note
Relates joint probability to conditional probability.
- Expression
P(A ∩ B) = P(A) * P(B|A) = P(B) * P(A|B)
- Name
Multiplication Rule (Independent Events)
- Note
If the occurrence of A does not affect the probability of B.
- Expression
P(A ∩ B) = P(A) * P(B)
- Name
Conditional Probability
- Note
Probability of A given that B has occurred.
- Expression
P(A|B) = P(A ∩ B) / P(B)
- Name
Bayes' Theorem
- Note
Used to update probability based on new evidence.
- Expression
P(A|B) = [P(B|A) * P(A)] / P(B)
- Name
Binomial Distribution (Probability Mass Function)
- Note
For k successes in n independent Bernoulli trials, with success probability p.
- Expression
P(X=k) = C(n, k) * pk * (1-p)^(n-k)
- Name
Binomial Distribution (Mean and Variance)
- Note
For a binomial random variable X.
- Expression
E[X] = np, Var(X) = np(1-p)
- Name
Poisson Distribution (Probability Mass Function)
- Note
For the number of events in a fixed interval of time or space, with average rate λ.
- Expression
P(X=k) = (λk * e-λ) / k!
- Name
Poisson Distribution (Mean and Variance)
- Note
For a Poisson random variable X.
- Expression
E[X] = λ, Var(X) = λ
- Name
Normal Distribution (Probability Density Function)
- Note
μ is mean, σ is standard deviation.
- Expression
f(x) = [1 / (σ√(2π))] * exp[-(x-μ)² / (2σ²)]
- Name
Z-score
- Note
Standardizes a normal random variable.
- Expression
Z = (X - μ) / σ
- Name
Sample Mean
- Note
Average of sample data points.
- Expression
x̄ = (Σxᵢ) / n
- Name
Sample Variance
- Note
Measure of data spread in a sample.
- Expression
s² = [Σ(xᵢ - x̄)²] / (n-1)
Prerequisites
Basic Algebra
Set Theory Concepts
Basic Calculus (differentiation and integration for continuous distributions)
Common mistakes
Confusing independent and dependent events.
Incorrectly applying formulas for mutually exclusive vs. non-mutually exclusive events.
Misinterpreting conditional probability.
Assuming normality for small sample sizes without justification.
Calculation errors in variance and standard deviation.
Confusing population parameters with sample statistics.
Keywords
Probability
Statistics
Random Variable
Probability Distribution
Binomial
Poisson
Normal
Mean
Variance
Standard Deviation
Conditional Probability
Bayes' Theorem
Hypothesis Testing
Confidence Interval
Sample Space
Event
Practice preview
A bag contains 5 red balls and 3 blue balls. If two balls are drawn at random without replacement, what is the probability that both are red?…
medium
Two dice are rolled simultaneously. What is the probability that the sum of the numbers shown is 7?…
medium
If X is a random variable with probability density function f(x) = 2e^(-2x) for x >= 0 and f(x) = 0 for x < 0, what is the mean of X?…
hard