A simple linear regression algorithm using ordinary least squares. More...

Public Member Functions
	LinearRegression (const arma::mat &predictors, const arma::vec &responses, const double lambda=0, const bool intercept=true, const arma::vec &weights=arma::vec())
	Creates the model. More...

	LinearRegression (const LinearRegression &linearRegression)
	Copy constructor. More...

	LinearRegression ()
	Empty constructor. More...

double	ComputeError (const arma::mat &points, const arma::vec &responses) const
	Calculate the L2 squared error on the given predictors and responses using this linear regression model. More...

bool	Intercept () const
	Return whether or not an intercept term is used in the model. More...

double	Lambda () const
	Return the Tikhonov regularization parameter for ridge regression. More...

double &	Lambda ()
	Modify the Tikhonov regularization parameter for ridge regression. More...

const arma::vec &	Parameters () const
	Return the parameters (the b vector). More...

arma::vec &	Parameters ()
	Modify the parameters (the b vector). More...

void	Predict (const arma::mat &points, arma::vec &predictions) const
	Calculate y_i for each data point in points. More...

template<typename Archive >
void	Serialize (Archive &ar, const unsigned int)
	Serialize the model. More...

void	Train (const arma::mat &predictors, const arma::vec &responses, const bool intercept=true, const arma::vec &weights=arma::vec())
	Train the LinearRegression model on the given data. More...

Private Attributes
bool	intercept
	Indicates whether first parameter is intercept. More...

double	lambda
	The Tikhonov regularization parameter for ridge regression (0 for linear regression). More...

arma::vec	parameters
	The calculated B. More...

Detailed Description

A simple linear regression algorithm using ordinary least squares.

Optionally, this class can perform ridge regression, if the lambda parameter is set to a number greater than zero.

Definition at line 26 of file linear_regression.hpp.

Constructor & Destructor Documentation

mlpack::regression::LinearRegression::LinearRegression	(	const arma::mat &	predictors,
		const arma::vec &	responses,
		const double	lambda = `0`,
		const bool	intercept = `true`,
		const arma::vec &	weights = `arma::vec()`
	)

Creates the model.

Parameters

predictors	X, matrix of data points to create B with.
responses	y, the measured data for each point in X.
lambda	Regularization constant for ridge regression.
intercept	Whether or not to include an intercept term.
weights	Observation weights (for boosting).

mlpack::regression::LinearRegression::LinearRegression ( const LinearRegression & linearRegression )

Copy constructor.

Parameters

linearRegression the other instance to copy parameters from.

mlpack::regression::LinearRegression::LinearRegression ( )

inline

Empty constructor.

This gives a non-working model, so make sure Train() is called (or make sure the model parameters are set) before calling Predict()!

Definition at line 56 of file linear_regression.hpp.

References ComputeError(), intercept, Predict(), and Train().

Member Function Documentation

double mlpack::regression::LinearRegression::ComputeError	(	const arma::mat &	points,
		const arma::vec &	responses
	)		const

Calculate the L2 squared error on the given predictors and responses using this linear regression model.

This calculation returns

$(1 / n) * \| y - X B \|^2_2$

where $ y $ is the responses vector, $ X $ is the matrix of predictors, and $ B $ is the parameters of the trained linear regression model.

As this number decreases to 0, the linear regression fit is better.

Parameters

points	Matrix of predictors (X).
responses	Vector of responses (y).

Referenced by LinearRegression(), and mlpack::distribution::RegressionDistribution::RegressionDistribution().

bool mlpack::regression::LinearRegression::Intercept ( ) const

inline

Return whether or not an intercept term is used in the model.

Definition at line 114 of file linear_regression.hpp.

References intercept.

double mlpack::regression::LinearRegression::Lambda ( ) const

inline

Return the Tikhonov regularization parameter for ridge regression.

Definition at line 109 of file linear_regression.hpp.

References lambda.

double& mlpack::regression::LinearRegression::Lambda ( )

inline

Modify the Tikhonov regularization parameter for ridge regression.

Definition at line 111 of file linear_regression.hpp.

References lambda.

const arma::vec& mlpack::regression::LinearRegression::Parameters ( ) const

inline

Return the parameters (the b vector).

Definition at line 104 of file linear_regression.hpp.

References parameters.

Referenced by mlpack::distribution::RegressionDistribution::Dimensionality(), and mlpack::distribution::RegressionDistribution::Parameters().

arma::vec& mlpack::regression::LinearRegression::Parameters ( )

inline

Modify the parameters (the b vector).

Definition at line 106 of file linear_regression.hpp.

References parameters.

void mlpack::regression::LinearRegression::Predict	(	const arma::mat &	points,
		arma::vec &	predictions
	)		const

Calculate y_i for each data point in points.

Parameters

points	the data points to calculate with.
predictions	y, will contain calculated values on completion.

Referenced by LinearRegression().

template<typename Archive >

void mlpack::regression::LinearRegression::Serialize	(	Archive &	ar,
		const unsigned	int
	)

inline

Serialize the model.

Definition at line 120 of file linear_regression.hpp.

References mlpack::data::CreateNVP(), intercept, lambda, and parameters.

void mlpack::regression::LinearRegression::Train	(	const arma::mat &	predictors,
		const arma::vec &	responses,
		const bool	intercept = `true`,
		const arma::vec &	weights = `arma::vec()`
	)

Train the LinearRegression model on the given data.

Careful! This will completely ignore and overwrite the existing model. This particular implementation does not have an incremental training algorithm. To set the regularization parameter lambda, call Lambda() or set a different value in the constructor.

Parameters

predictors	X, the matrix of data points to train the model on.
responses	y, the vector of responses to each data point.
intercept	Whether or not to fit an intercept term.
weights	Observation weights (for boosting).

Referenced by LinearRegression().

Member Data Documentation

bool mlpack::regression::LinearRegression::intercept

private

Indicates whether first parameter is intercept.

Definition at line 141 of file linear_regression.hpp.

Referenced by Intercept(), LinearRegression(), and Serialize().

double mlpack::regression::LinearRegression::lambda

private

The Tikhonov regularization parameter for ridge regression (0 for linear regression).

Definition at line 138 of file linear_regression.hpp.

Referenced by Lambda(), and Serialize().

arma::vec mlpack::regression::LinearRegression::parameters

private

The calculated B.

Initialized and filled by constructor to hold the least squares solution.

Definition at line 132 of file linear_regression.hpp.

Referenced by Parameters(), and Serialize().

The documentation for this class was generated from the following file:

src/mlpack/methods/linear_regression/linear_regression.hpp

Public Member Functions

Private Attributes

Detailed Description

Constructor & Destructor Documentation

Member Function Documentation

Member Data Documentation