Multiple Regression Analysis - Advanced Tab
Principal Components and Factor Analysis
Select the Advanced tab of the Multiple Regression Analysis dialog box to access options that offer a greater variety of multiple regression techniques than those available on the Quick tab.
Tolerance. Specify the minimum tolerance that is considered acceptable by Statistica in the Tolerance box. The minimum value that can be specified here is 1.00E-25 (i.e., a number with 24 zeros past the decimal point). However, it is not recommended to enter such an extremely low value. If the tolerance of a variable entered into the regression equation is less than the default tolerance value (.01) it means that this variable is 99 percent redundant with (identical to) the variables already in the equation. Forcing very redundant variables into the regression equation is not only questionable in terms of relevance of results, but the resultant estimates (regression coefficients) will become increasingly unreliable.
The tolerance of a variable is defined as 1 minus the squared multiple correlation of this variable with all other independent variables in the regression equation. Therefore, the smaller the tolerance of a variable, the more redundant is its contribution to the regression (i.e., it is redundant with the contribution of other independent variables). If the tolerance of any of the variables in the regression equation is equal to zero (or very close to zero) then the regression equation cannot be evaluated (the matrix is said to be ill-conditioned, and it cannot be inverted, see Note).
- The beta in (standard regression coefficient for the respective variable if it were to enter into the regression equation as an independent variable);
- The partial correlation (between the respective variable and the dependent variable, after controlling for all other independent variables in the equation);
- The semi-partial (part) correlation (the correlation between the unadjusted dependent variable with the respective variable after controlling for all independent variables in the equation);
- The tolerance for the respective variable (defined as 1 minus the squared multiple correlation between the respective variable and all independent variables in the regression equation);
- The minimum tolerance (the smallest tolerance among all independent variables in the equation if the respective variable were to be entered as an additional independent variable);
- The t-value associated with these statistics for the respective variable;
- The Statistical significance of the t-value.
These statistics will first be displayed separately for variables not currently in the regression equation (if any), and for the variables in the regression equation.