考虑原始 Constrained Optimization Problem
其 Lagrangian 形式为
These four constrained optimization methods looks similarly when first seen:
Here is a comprehensive explaination towards these four methods written by Brian Borchers.
This article simply introduced strategies for finding the stationary points of the objective function subject to one or more equality or inequality constraints.
Consider a standard form of continuous optimization problem,
And are all continuous differentable.
We divided the problem into two cases: or . For the former we introduced The Method of Lagrange Multipliers as the solving strategy, and simply introduced KKT Conditions for the other one when it suits some Regularity Conditions.
Notice that it was easy to treat a maximization problem by negating the objective function, we only use the maximization problem as a general example.