• activation function is used to determine how to activate the sum of the input signal, the sum of the activation function of the input signals into an output signal.
• output layer activation function according to the actual decision to issue general
Regression using the identity function,
Binary classification using the sigmoid function,
Softmax using multivariate classification function.