Mathwords logoMathwords

Linear Algebra — Definition, Formula & Examples

Linear algebra is the branch of mathematics that studies vectors, matrices, systems of linear equations, and linear transformations. It provides the tools for solving equations involving multiple unknowns and for understanding geometric transformations in any number of dimensions.

Linear algebra is the study of vector spaces (or linear spaces) over fields, together with the structure-preserving maps between them (linear maps). Its central objects include systems of linear equations, matrices as representations of linear transformations, determinants, eigenvalues, and eigenvectors.

Key Formula

Ax=bA\mathbf{x} = \mathbf{b}
Where:
  • AA = Coefficient matrix (m × n) containing the coefficients of the system
  • x\mathbf{x} = Column vector of n unknowns
  • b\mathbf{b} = Column vector of m constants on the right-hand side

How It Works

At its core, linear algebra converts geometric and algebraic problems into matrix operations. You represent a system of linear equations as a matrix equation Ax=bA\mathbf{x} = \mathbf{b}, where AA is the coefficient matrix, x\mathbf{x} is the vector of unknowns, and b\mathbf{b} is the constants vector. Solving this system means finding x\mathbf{x} using techniques like row reduction, matrix inversion, or Cramer's Rule. Beyond solving equations, linear algebra lets you analyze transformations—rotations, reflections, scalings—by studying the properties of matrices such as rank, determinant, and eigenvalues.

Worked Example

Problem: Solve the system: 2x + y = 5 and x − y = 1 using matrix methods.
Write as a matrix equation: Express the system as Ax = b.
[211−1][xy]=[51]\begin{bmatrix} 2 & 1 \\ 1 & -1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 5 \\ 1 \end{bmatrix}
Find the inverse of A: The determinant is det(A) = 2(−1) − 1(1) = −3. Using the 2×2 inverse formula:
A−1=1−3[−1−1−12]=[131313−23]A^{-1} = \frac{1}{-3}\begin{bmatrix} -1 & -1 \\ -1 & 2 \end{bmatrix} = \begin{bmatrix} \frac{1}{3} & \frac{1}{3} \\ \frac{1}{3} & -\frac{2}{3} \end{bmatrix}
Multiply to solve: Compute x = A⁻¹b.
[xy]=[131313−23][51]=[21]\begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} \frac{1}{3} & \frac{1}{3} \\ \frac{1}{3} & -\frac{2}{3} \end{bmatrix}\begin{bmatrix} 5 \\ 1 \end{bmatrix} = \begin{bmatrix} 2 \\ 1 \end{bmatrix}
Answer: x = 2 and y = 1.

Why It Matters

Linear algebra is foundational in nearly every STEM field. Computer graphics engines use matrix transformations to render 3D scenes, machine learning algorithms rely on matrix operations for training neural networks, and engineers use eigenvalue analysis to study vibrations in structures. Mastering it is essential for courses in differential equations, statistics, data science, and quantum mechanics.

Common Mistakes

Mistake: Assuming matrix multiplication is commutative (that AB = BA).
Correction: Matrix multiplication is generally not commutative. Always multiply in the correct order: the number of columns in the left matrix must equal the number of rows in the right matrix.