Lagrange dual problem and conjugate function

The optimization problem have two components that are objective function f0:RnR and the constraints. The objective function and constraints keep in check each other and make balance at saddle point i.e. optimal point. The dual (Lagrange) problem of the optimal problem also solve the optimization problem by making low boundary.

The dual problem can be explained as a conjugate function f=sup(xTyf(x)). The Lagrangian is L(x,λ,ν)=f0(x)+λf1,+νf2 where f0 is the objective function, f1 is inequality constraints and f2 is equality constraints. The Lagrangian function is g(λ,nu)=infxL(x,λ,ν)=infx(f0(x)+λf1+νf2). The second and third term of the Lagrangian function is can be rewriten as an inner product form xTh(λ)+xTi(ν) and constant term with λ and ν. Then the inner product term xTh(λ)+xTi(ν) and objective term becomes a conjugate function.

The conjugate function f(x) is similar in terms of balance and saddle point.

Avatar
Jun Kang
Clinical Assistant Professor of Hospital Pathology

My research interests include pathology, oncology and statistics.

Related