Positive Definite Matrix — Definition, Formula & Examples
A positive definite matrix is a symmetric matrix where every eigenvalue is positive, or equivalently, where for every nonzero vector . This property guarantees the matrix behaves like a "positive" quantity in higher dimensions.
A real symmetric matrix is positive definite if and only if the quadratic form for all with . Equivalent conditions include: (1) all eigenvalues of are strictly positive, (2) all leading principal minors (upper-left determinants) of are strictly positive, and (3) can be factored as for some invertible matrix .
Key Formula
Where:
- = A real $n \times n$ symmetric matrix
- = Any nonzero column vector in $\mathbb{R}^n$
How It Works
To test whether a symmetric matrix is positive definite, you can use any of three practical methods. The **eigenvalue test** checks that every eigenvalue is positive. The **leading principal minor test** (Sylvester's criterion) checks that the determinants of the , , ..., upper-left submatrices are all positive. For small matrices, you can also directly verify by expanding the quadratic form and confirming it is always positive for nonzero . The leading principal minor test is often the fastest approach for and matrices.
Worked Example
Problem: Determine whether the matrix is positive definite using the leading principal minor test.
Step 1: Confirm the matrix is symmetric. Since , it is symmetric and the test applies.
Step 2: Compute the first leading principal minor, which is just the top-left entry.
Step 3: Compute the second leading principal minor, which is the determinant of the full matrix.
Step 4: Since both leading principal minors are strictly positive, the matrix is positive definite.
Answer: The matrix is positive definite because and .
Another Example
Problem: Show that the matrix is NOT positive definite.
Step 1: Check symmetry: , so the matrix is symmetric.
Step 2: Compute the first leading principal minor.
Step 3: Compute the second leading principal minor.
Step 4: Since is negative, the matrix fails the test and is not positive definite.
Answer: is not positive definite because .
Why It Matters
Positive definite matrices appear throughout college-level linear algebra and multivariable calculus. In optimization, the Hessian matrix being positive definite confirms that a critical point is a local minimum — a key result in Calculus III and machine learning. In statistics, every valid covariance matrix must be positive semi-definite, so understanding this property is essential in courses on probability, data science, and econometrics.
Common Mistakes
Mistake: Checking that all entries of the matrix are positive and concluding it is positive definite.
Correction: Positive definiteness is about eigenvalues or the quadratic form, not individual entries. A matrix with all positive entries can fail to be positive definite, and a positive definite matrix can have negative off-diagonal entries.
Mistake: Applying the leading principal minor test to a non-symmetric matrix.
Correction: Sylvester's criterion only works for symmetric matrices. If , first symmetrize it as or use eigenvalue methods.
