Saddle Point — Definition, Formula & Examples
A saddle point is a critical point of a function of two or more variables where the surface curves upward in one direction and downward in another, making it neither a local maximum nor a local minimum.
A point is a saddle point of if and , but for every open disk centered at , there exist points where and points where . Equivalently, when the second-derivative test applies, the discriminant is negative at that point.
Key Formula
Where:
- = Discriminant (also called the Hessian determinant) at the critical point
- = Second partial derivative of f with respect to x twice
- = Second partial derivative of f with respect to y twice
- = Mixed second partial derivative of f with respect to x then y
How It Works
To find saddle points, first locate all critical points by setting and simultaneously. Then apply the second-derivative test: compute at each critical point. If , the critical point is a saddle point. The name comes from the shape of a horse saddle, which curves up along the horse's spine and curves down on the sides.
Worked Example
Problem: Classify the critical point of f(x, y) = x² − y² at the origin.
Find critical points: Compute the first partial derivatives and set them to zero.
Compute second partial derivatives: Find all three second-order partials needed for the discriminant.
Evaluate the discriminant: Plug into the formula for D.
Answer: Since D = −4 < 0, the origin is a saddle point. Along the x-axis the function curves upward (like x²), while along the y-axis it curves downward (like −y²).
Why It Matters
Saddle points appear throughout optimization, machine learning, and economics. In neural network training, the loss landscape is high-dimensional and saddle points vastly outnumber local minima, which directly affects how gradient descent algorithms behave. Recognizing saddle points also matters when using Lagrange multipliers to solve constrained optimization problems.
Common Mistakes
Mistake: Assuming every critical point that is not a local max must be a local min.
Correction: A critical point can be a saddle point — always check the sign of the discriminant D before classifying.
