Using Steepness Coefficient to Improve Artificial Neural Network Performance for Environmental Modeling
Selami Demir, Aykut Karadeniz, Neslihan Manav Demir
More details
Hide details
Yıldız Technical University, Faculty of Civil Engineering, Environmental Engineering Department,
34220, Esenler, Istanbul, Turkey
Publish date: 2016-07-22
Submission date: 2016-01-30
Final revision date: 2016-02-25
Acceptance date: 2016-02-25
Pol. J. Environ. Stud. 2016;25(4):1467–1477
This paper presents results from a research study in which the effects of steepness coefficient (S) for the activation function of a back propagation neural network (BPNN) were investigated, and optimum values of S for each activation function were suggested for environmental modeling purposes. A BPNN algorithm was implemented in Excel Visual Basic for Applications with built-in activation functions of sigmoid, hyperbolic tangent, and sinc. Various steepness coefficients were employed for modeling cyclone Euler numbers for pressure drop estimation with three different activation functions. Best results for sigmoid function were obtained for S = 1.00 with a median value of mean square errors (MSEs) of 4.33*10-4. For hyperbolic tangent function, the optimum value of S was found as 0.2 with a median MSE value of 2.02*10-4. The median value of MSEs obtained with BPNN sinc function was 1.20*10-3 for S = 0.50. Results showed, for environmental modeling problems, that any activation function can be used with satisfactory results provided that an optimized value of the steepness coefficient is used, which is considered problemspecific.