Workspace Node: SANN Regression/Classification/Time Series - Specifications - Weight Decay Tab

In the SANN Regression, SANN Classification, SANN Time Series (Regression), or SANN Time Series (Classification) node dialog box, under the Specifications heading, select the Weight Decay tab to access the following options.
Element Name Description
Weight decay Use the options in this group box to specify the use of weight decay regularization for the input-hidden layer (MLP networks only), the hidden-output layer, or both. This option encourages the development of smaller weights, which tends to reduce the problem of over-fitting, thereby potentially improving generalization performance of the network. Weight decay works by modifying the network's error function to penalize large weights - the result is an error function that compromises between performance and weight size. Consequently, too large a weight decay term may damage network performance unacceptably, and experimentation is generally needed to determine an appropriate weight decay factor for a particular problem domain. Note that when the Radial basis functions (RBF) option button is selected on the Quick Specification tab, the Use hidden weight decay check box and Decay value field will be unavailable.
Use hidden weight decay Select this check box to apply weight decay regularization to the input-hidden layer weights.
Decay value Specify the weight decay value for the hidden layer weights. The larger the decay value, the weaker the network.
Use output weight decay Select this check box to apply weight decay regularization to the hidden-output layer weights.
Decay value Specify the weight decay value for the output layer weights. The larger the decay value, the weaker the network.

Options / C / W. See Common Options.

OK Click the OK button to accept all the specifications made in the dialog box and to close it. The analysis results will be placed in the Reporting Documents node after running (updating) the project.