Level set

In mathematics, a level set of a real-valued function f of n variables is a set of the form

where c is a constant. That is, it is the set where the function takes on a given constant value. When the number of variables is two, this is a level curve (contour line), if it is three this is a level surface, and for higher values of n the level set is a level hypersurface.

A level set is also called a fiber.

Level sets versus the gradient

Consider a function f whose graph looks like a hill. The blue curves are then the level sets. The red curves follow the direction of the gradient. In other words, the cautious hiker follows the blue paths, while the bold one the red paths.

Theorem. The gradient of f at a point is perpendicular to the level set of f at that point.

This theorem is quite remarkable. To understand what it means, imagine that two hikers are at the same location on a mountain. One of them is bold, and decides to go in the direction where the slope is steepest. The other one is more cautious; he does not want to either climb or descend, choosing a path which will keep him at the same height. In our analogy, the above theorem says that the two hikers will depart in directions perpendicular to one another.

Proof. Let x₀ be the point of interest. The level set going through x₀ is . Consider a curve x(t) in the level set going through x₀, so we will assume that x(0) = x₀. We have

f(x(t)) = f(x₀) = c.

Now let us differentiate at t = 0 by using the chain rule. We find

[J_f() '(0)=0.]

Equivalently, the Jacobian of f at x₀ is the gradient at x₀

[\nabla f(_0) \cdot '(0)=0.]

Thus, the gradient of f at x₀ is perpendicular to the tangent x′(0) to the curve (and to the level set) at that point. Since the curve x(t) is arbitrary, it follows that the gradient is perpendicular to the level set. Q.E.D.

A consequence of this theorem is that if a level set crosses itself (more precisely, fails to be a smooth submanifold or hypersurface) then the gradient vector must be zero at all points of crossing. Then, every point in the crossing will be a critical point of f.

Level set

Level sets versus the gradient

See also