Numerically solve convex Lagrange multiplier problems with conjugate gradient descent.
For some background on the method of Lagrange multipliers checkout the wikipedia page
http://en.wikipedia.org/wiki/Lagrange_multiplier
Here is an example from the Wikipedia page on Lagrange multipliers
Maximize f(x, y) = x + y, subject to the constraint x^2 + y^2 = 1
For more information look here: http://en.wikipedia.org/wiki/Lagrange_multiplier#Example_1
For example, to find the maximum entropy with the constraint that the probabilities sum
to one.
The first elements of the result pair are the arguments for the
objective function at the maximum. The second elements are the Lagrange multipliers.