Extreme Optimization™: Complexity made simple.

Math and Statistics
Libraries for .NET

  • Home
  • Features
    • Math Library
    • Vector and Matrix Library
    • Statistics Library
    • Performance
    • Usability
  • Documentation
    • Introduction
    • Math Library User's Guide
    • Vector and Matrix Library User's Guide
    • Data Analysis Library User's Guide
    • Statistics Library User's Guide
    • Reference
  • Resources
    • Downloads
    • QuickStart Samples
    • Sample Applications
    • Frequently Asked Questions
    • Technical Support
  • Blog
  • Order
  • Company
    • About us
    • Testimonials
    • Customers
    • Press Releases
    • Careers
    • Partners
    • Contact us
Introduction
Deployment Guide
Nuget packages
Configuration
Using Parallelism
Expand Mathematics Library User's GuideMathematics Library User's Guide
Expand Vector and Matrix Library User's GuideVector and Matrix Library User's Guide
Expand Data Analysis Library User's GuideData Analysis Library User's Guide
Expand Statistics Library User's GuideStatistics Library User's Guide
Expand Data Access Library User's GuideData Access Library User's Guide
Expand ReferenceReference
  • Extreme Optimization
    • Features
    • Solutions
    • Documentation
    • QuickStart Samples
    • Sample Applications
    • Downloads
    • Technical Support
    • Download trial
    • How to buy
    • Blog
    • Company
    • Resources
  • Documentation
    • Introduction
    • Deployment Guide
    • Nuget packages
    • Configuration
    • Using Parallelism
    • Mathematics Library User's Guide
    • Vector and Matrix Library User's Guide
    • Data Analysis Library User's Guide
    • Statistics Library User's Guide
    • Data Access Library User's Guide
    • Reference
  • Reference
    • Extreme
    • Extreme.Collections
    • Extreme.Data
    • Extreme.Data.Json
    • Extreme.Data.Matlab
    • Extreme.Data.R
    • Extreme.Data.Stata
    • Extreme.Data.Text
    • Extreme.DataAnalysis
    • Extreme.DataAnalysis.Linq
    • Extreme.DataAnalysis.Models
    • Extreme.Mathematics
    • Extreme.Mathematics.Algorithms
    • Extreme.Mathematics.Calculus
    • Extreme.Mathematics.Calculus.OrdinaryDifferentialEquations
    • Extreme.Mathematics.Curves
    • Extreme.Mathematics.Curves.Nonlinear
    • Extreme.Mathematics.Distributed
    • Extreme.Mathematics.EquationSolvers
    • Extreme.Mathematics.Generic
    • Extreme.Mathematics.LinearAlgebra
    • Extreme.Mathematics.LinearAlgebra.Implementation
    • Extreme.Mathematics.LinearAlgebra.IterativeSolvers
    • Extreme.Mathematics.LinearAlgebra.IterativeSolvers.Preconditioners
    • Extreme.Mathematics.Optimization
    • Extreme.Mathematics.Optimization.LineSearches
    • Extreme.Mathematics.Random
    • Extreme.Mathematics.SignalProcessing
    • Extreme.Providers
    • Extreme.Providers.InteropServices
    • Extreme.Statistics
    • Extreme.Statistics.Distributions
    • Extreme.Statistics.Multivariate
    • Extreme.Statistics.Tests
    • Extreme.Statistics.TimeSeriesAnalysis
  • Extreme.Mathematics.Optimization
    • BoundedQuasiNewtonOptimizer Class
    • BrentDerivativeOptimizer Class
    • BrentOptimizer Class
    • ConjugateGradientMethod Enumeration
    • ConjugateGradientOptimizer Class
    • Constraint Class
    • ConstraintCollection Class
    • ConstraintType Enumeration
    • DecisionVariable Class
    • DecisionVariableCollection Class
    • DirectionalOptimizer Class
    • ExtremumType Enumeration
    • GoldenSectionOptimizer Class
    • LeastSquaresOptimizer Class
    • LevenbergMarquardtOptimizer Class
    • LimitedMemoryBfgsOptimizer Class
    • LinearConstraint Class
    • LinearProgram Class
    • LinearProgramConstraint Class
    • LinearProgramSolver Class
    • LinearProgramVariable Class
    • MpsReader Class
    • MultidimensionalOptimizer Class
    • NelderMeadOptimizer Class
    • NonlinearConstraint Class
    • NonlinearProgram Class
    • OneDimensionalOptimizer Class
    • OptimizationModel Class
    • OptimizationModelEntity Class
    • OptimizationModelSolver(T) Class
    • OptimizationModelStatus Enumeration
    • OptimizationSolutionReport Class
    • PowellOptimizer Class
    • QuadraticProgram Class
    • QuasiNewtonMethod Enumeration
    • QuasiNewtonOptimizer Class
    • TrustRegionReflectiveOptimizer Class
  • QuasiNewtonOptimizer Class
    • QuasiNewtonOptimizer Constructors
    • Properties
    • QuasiNewtonOptimizer Methods

QuasiNewtonOptimizer Class

Extreme Optimization Numerical Libraries for .NET Professional
Represents a multi-dimensional optimizer that uses a quasi-Newton algorithm (DFP or BFGS).
Inheritance Hierarchy

SystemObject
  Extreme.Mathematics.AlgorithmsManagedIterativeAlgorithmVectorDouble, Double, OptimizationSolutionReport
    Extreme.Mathematics.OptimizationMultidimensionalOptimizer
      Extreme.Mathematics.OptimizationDirectionalOptimizer
        Extreme.Mathematics.OptimizationQuasiNewtonOptimizer

Namespace:  Extreme.Mathematics.Optimization
Assembly:  Extreme.Numerics (in Extreme.Numerics.dll) Version: 8.1.1
Syntax

C#
VB
C++
F#
Copy
public sealed class QuasiNewtonOptimizer : DirectionalOptimizer
Public NotInheritable Class QuasiNewtonOptimizer
	Inherits DirectionalOptimizer
public ref class QuasiNewtonOptimizer sealed : public DirectionalOptimizer
[<SealedAttribute>]
type QuasiNewtonOptimizer =  
    class
        inherit DirectionalOptimizer
    end

The QuasiNewtonOptimizer type exposes the following members.

Constructors

  NameDescription
Public methodQuasiNewtonOptimizer
Constructs a new QuasiNewtonOptimizer object.
Public methodQuasiNewtonOptimizer(QuasiNewtonMethod)
Constructs a new QuasiNewtonOptimizer object.
Top
Properties

  NameDescription
Public propertyConvergenceTests
Gets the collection of convergence tests for the algorithm.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyCurrentDirection
Gets or sets the current search direction.
(Inherited from DirectionalOptimizer.)
Public propertyDimensions
Gets or sets the number of dimensions of the optimization problem.
(Inherited from MultidimensionalOptimizer.)
Public propertyEstimatedError
Gets a value indicating the size of the absolute error of the result.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyEvaluationsNeeded
Gets the number of evaluations needed to execute the algorithm.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyExtremum
Gets or sets the current best approximation to the extremum.
(Inherited from MultidimensionalOptimizer.)
Public propertyExtremumType
Gets or sets the type of extremum.
(Inherited from MultidimensionalOptimizer.)
Public propertyFastGradientFunction
Gets or sets the function that computes the gradient of the objective funciton.
(Inherited from MultidimensionalOptimizer.)
Public propertyGradientEvaluationsNeeded
Gets the number of evaluations of the gradient of the objective function.
(Inherited from MultidimensionalOptimizer.)
Public propertyGradientFunction
Gets or sets the function that computes the gradient of the objective funciton.
(Inherited from MultidimensionalOptimizer.)
Public propertyGradientTest
Gets the VectorConvergenceTestT that uses the gradient of the objective function.
(Inherited from MultidimensionalOptimizer.)
Public propertyGradientVector
Gets or sets the current value of the gradient.
(Inherited from MultidimensionalOptimizer.)
Public propertyHasSharedDegreeOfParallelism
Indicates whether the degree of parallelism is a property that is shared across instances.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyInitialGuess
Gets or sets the initial value for the iteration.
(Inherited from MultidimensionalOptimizer.)
Public propertyIterationsNeeded
Gets the number of iterations needed by the algorithm to reach the desired accuracy.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyLineSearch
Gets or sets the algorithm used to perform a line search.
(Inherited from DirectionalOptimizer.)
Public propertyMaxDegreeOfParallelism
Gets or sets the maximum degree of parallelism enabled by this instance.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyMaxEvaluations
Gets or sets the maximum number of evaluations during the calculation.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyMaxIterations
Gets or sets the maximum number of iterations to use when approximating the roots of the target function.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyMethod
Gets or sets the method used to update the conjugate gradient direction.
Public propertyMinIterations
Gets or sets the minimum iterations that have to be performed.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyObjectiveFunction
Gets or sets the objective function.
(Inherited from MultidimensionalOptimizer.)
Public propertyObjectiveFunctionWithGradient
Gets or sets a function that evaluates the value and gradient of the objective function.
(Inherited from MultidimensionalOptimizer.)
Public propertyParallelOptions
Gets or sets the configuration for the parallel behavior of the algorithm.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyRestartIterations
Gets or sets a value that indicates when the Hessian approximation should be restarted from a diagonal matrix.
Public propertyResult
Gets the result of an algorithm after it has executed.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertySolutionReport
Gets the result of an algorithm after it has executed.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertySolutionTest
Gets the VectorConvergenceTestT that uses the approximate solution.
(Inherited from MultidimensionalOptimizer.)
Public propertyStatus
Gets the AlgorithmStatus following an execution of the algorithm.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertySymbolicObjectiveFunction
Gets or sets the objective function.
(Inherited from MultidimensionalOptimizer.)
Public propertyThrowExceptionOnFailure
Gets or sets a value indicating whether to throw an exception when the algorithm fails to converge.
(Inherited from ManagedIterativeAlgorithmT, TError, TReport.)
Public propertyValueAtExtremum
Gets or sets the current value of the objective function.
(Inherited from MultidimensionalOptimizer.)
Public propertyValueTest
Gets the SimpleConvergenceTestT that uses the value of the target functions.
(Inherited from MultidimensionalOptimizer.)
Top
Methods

  NameDescription
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Public methodFindExtremum
Searches for an extremum.
(Inherited from MultidimensionalOptimizer.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Top
Remarks

Use the QuasiNewtonOptimizer class to find an extremum of a multivariate function using a quasi-Newton method. Two variations of this method are available: the BFGS method of Broyden, Fletcher, Goldfarb and Shanno, and the DFP method of Davison, Fletcher and Powell. The default is the BFGS method.

A quasi-Newton method is the preferred method for smaller problems when the gradient of the objective function is available. For large problems, the Conjugate Gradient method is usually more efficient.

The objective function must be supplied as a multivariate function delegate to the ObjectiveFunction property. The gradient of the objective function can be supplied either as a multivariate function returning a vector delegate (by setting the GradientFunction property), or a multivariate function returning a vector in its second argument delegate (by setting the FastGradientFunction property). The latter has the advantage that the same Vector instance is reused to hold the result.

Sometimes, the gradient function is not available, or is very expensive to calculate. In such instances, a numerical approximation may work better.

Before the algorithm is run, you must set the InitialGuess property to a vector that contains an initial estimate for the extremum. The ExtremumType property specifies whether a minimum or a maximum of the objective function is desired.

The FindExtremum method performs the actual search for an extremum, and returns a Vector containing the best approximation. The Extremum property also returns the best approximation to the extremum. The ValueAtExtremum property returns the value of the objective function at the extremum.

The Status property is a AlgorithmStatus value that indicates the outcome of the algorithm. A value of Normal shows normal termination. A value of Divergent usually indicates that the objective function is not bounded.

The algorithm has three convergence tests. By default, the algorithm terminates when either of these is satisfied. You can deactivate either test by setting its Enabled property to . If both tests are deactivated, then the algorithm always terminates when the maximum number of iterations or function evaluations is reached.

The first test is based on the uncertainty in the location of the approximate extremum. The SolutionTest property returns a VectorConvergenceTestT object that allows you to specify the desired Tolerance and specific ConvergenceCriterion. See the VectorConvergenceTestT class for details on how to further customize this test.

The second test is based on the change in value of the objective function at the approximate extremum. The test is successful when the change of the value of the objective function is within the tolerance. Care should be taken with this test. When the tolerance is too large, the algorithm will terminate prematurely. The ValueTest property returns a SimpleConvergenceTestT object that can be used to customize the test.

The third test is based on the value of the gradient at the approximate extremum. The GradientTest property returns a VectorConvergenceTestT object that can be used to customize the test. By default, the error is set to the component with the largest absolute value.

See Also

Reference

Extreme.Mathematics.Optimization Namespace

Copyright (c) 2004-2021 ExoAnalytics Inc.

Send comments on this topic to support@extremeoptimization.com

Copyright © 2004-2021, Extreme Optimization. All rights reserved.
Extreme Optimization, Complexity made simple, M#, and M Sharp are trademarks of ExoAnalytics Inc.
Microsoft, Visual C#, Visual Basic, Visual Studio, Visual Studio.NET, and the Optimized for Visual Studio logo
are registered trademarks of Microsoft Corporation.