Linear Algebra
What is Linear Algebra?
A set of vectors for which addition and scalar multiplication are defined and satisfy certain axioms.
Key formula / rule: Matrix Multiplication
Key points
- Understand the fundamental concepts of vector spaces and linear transformations.
- Be able to perform matrix operations and calculate determinants.
- Solve systems of linear equations using various methods.
- Compute eigenvalues and eigenvectors of matrices.
Common exam trap
Confusing row operations with column operations in Gaussian elimination.
Definitions
- Term
Vector Space
- Meaning
A set of vectors for which addition and scalar multiplication are defined and satisfy certain axioms.
- Term
Linear Independence
- Meaning
A set of vectors is linearly independent if the only linear combination that equals the zero vector is the trivial one (all coefficients are zero).
- Term
Basis
- Meaning
A linearly independent set of vectors that spans a vector space.
- Term
Dimension
- Meaning
The number of vectors in a basis for a vector space.
- Term
Eigenvalue
- Meaning
A scalar λ such that there exists a non-zero vector v for which Av = λv.
- Term
Eigenvector
- Meaning
A non-zero vector v such that Av = λv for some scalar λ (the eigenvalue).
- Term
Singular Matrix
- Meaning
A square matrix with a determinant of zero; it does not have an inverse.
Learning objectives
Understand the fundamental concepts of vector spaces and linear transformations.
Be able to perform matrix operations and calculate determinants.
Solve systems of linear equations using various methods.
Compute eigenvalues and eigenvectors of matrices.
Apply linear algebra concepts to solve engineering problems.
Formulae
- Name
Matrix Multiplication
- Note
Order matters: AB is not necessarily equal to BA.
- Expression
If C = AB, then Cij = sum(Aik * Bkj) for k=1 to p, where A is m x p and B is p x n.
- Name
Determinant of a 2x2 Matrix
- Note
- Expression
For A = [[a, b], [c, d]], det(A) = ad - bc.
- Name
Characteristic Equation
- Note
The roots of this polynomial are the eigenvalues.
- Expression
det(A - λI) = 0, where A is the matrix, λ is the eigenvalue, and I is the identity matrix.
- Name
Eigenvector Equation
- Note
Solving this for a given λ gives the corresponding eigenvector(s).
- Expression
(A - λI)v = 0, where v is the eigenvector.
- Name
Rank-Nullity Theorem
- Note
Nullity is the dimension of the null space (kernel).
- Expression
rank(A) + nullity(A) = n, where n is the number of columns in A.
Prerequisites
Basic Algebra
Complex Numbers
Basic Calculus (differentiation and integration concepts)
Common mistakes
Confusing row operations with column operations in Gaussian elimination.
Incorrectly calculating determinants, especially for larger matrices.
Assuming that a matrix always has n distinct eigenvalues or n linearly independent eigenvectors.
Errors in matrix multiplication order or dimension compatibility.
Misinterpreting the geometric meaning of eigenvalues and eigenvectors.
Keywords
Vector
Matrix
Determinant
Eigenvalue
Eigenvector
Linear Transformation
System of Equations
Rank
Basis
Dimension
Gaussian Elimination
Vector Space
Practice preview
Find the eigenvalues of the matrix A = [[2, 1], [1, 2]].…
medium
Consider the matrix A = [[1, 2], [3, 4]]. What is the determinant of A?…
easy
Let A be an n x n matrix. Which of the following statements is NOT equivalent to 'A is invertible'?…
medium