This class is used to initialize the weight matrix with the method proposed by T. More...

Public Member Functions
template<typename eT >
	KathirvalavakumarSubavathiInitialization (const arma::Mat< eT > &data, const double s)
	Initialize the random initialization rule with the given values. More...

template<typename eT >
void	Initialize (arma::Mat< eT > &W, const size_t rows, const size_t cols)
	Initialize the elements of the specified weight matrix with the Kathirvalavakumar-Subavathi method. More...

template<typename eT >
void	Initialize (arma::Cube< eT > &W, const size_t rows, const size_t cols, const size_t slices)
	Initialize the elements of the specified weight 3rd order tensor with the Kathirvalavakumar-Subavathi method. More...

Private Attributes
arma::rowvec	dataSum
	Parameter that defines the sum of elements in each column. More...

const double	s
	Parameter that defines the active region. More...

Detailed Description

This class is used to initialize the weight matrix with the method proposed by T.

Kathirvalavakumar and S. Subavathi. The method is based on sensitivity analysis using using cauchy’s inequality. The method is defined by

$\begin{eqnarray*} \overline{s} &=& f^{-1}(\overline{t}) \\ \Theta^{1}_{p} &\le& \overline{s} \sqrt{\frac{3}{I \sum_{i = 1}^{I} (x_{ip}^2)}} \\ \Theta^1 &=& min(\Theta_{p}^{1}); p=1,2,..,P \\ -\Theta^{1} \le w_{i}^{1} &\le& \Theta^{1} \end{eqnarray*}$

where I is the number of inputs including the bias, p refers the pattern considered in training, f is the transfer function and \={s} is the active region in which the derivative of the activation function is greater than 4% of the maximum derivatives.

Definition at line 56 of file kathirvalavakumar_subavathi_init.hpp.

Constructor & Destructor Documentation

template<typename eT >

mlpack::ann::KathirvalavakumarSubavathiInitialization::KathirvalavakumarSubavathiInitialization	(	const arma::Mat< eT > &	data,
		const double	s
	)

inline

Initialize the random initialization rule with the given values.

Parameters

data	The input patterns.
s	Parameter that defines the active region.

Definition at line 66 of file kathirvalavakumar_subavathi_init.hpp.

References dataSum.

Member Function Documentation

template<typename eT >

void mlpack::ann::KathirvalavakumarSubavathiInitialization::Initialize	(	arma::Mat< eT > &	W,
		const size_t	rows,
		const size_t	cols
	)

inline

Initialize the elements of the specified weight matrix with the Kathirvalavakumar-Subavathi method.

Parameters

W	Weight matrix to initialize.
rows	Number of rows.
cols	Number of columns.

Definition at line 81 of file kathirvalavakumar_subavathi_init.hpp.

References dataSum, mlpack::ann::RandomInitialization::Initialize(), and s.

Referenced by Initialize().

template<typename eT >

void mlpack::ann::KathirvalavakumarSubavathiInitialization::Initialize	(	arma::Cube< eT > &	W,
		const size_t	rows,
		const size_t	cols,
		const size_t	slices
	)