The optimization problem have two components that are objective function and the constraints. The objective function and constraints keep in check each other and make balance at saddle point i.e. optimal point. The dual (Lagrange) problem of the optimal problem also solve the optimization problem by making low boundary.
The dual problem can be explained as a conjugate function . The Lagrangian is where is the objective function, is inequality constraints and is equality constraints. The Lagrangian function is . The second and third term of the Lagrangian function is can be rewriten as an inner product form and constant term with and . Then the inner product term and objective term becomes a conjugate function.
The conjugate function is similar in terms of balance and saddle point.