Maximum likelihood estimation and cross entropy loss

Neural network training process ： Define basic puzzle model ----> Define the loss function ---> Define optimization algorithms （ Aim to minimize the loss function , Solve the weight ）

1.SSE:

2.MSE

 

3. Cross entropy loss （ Logarithmic loss ）

Maximum likelihood estimation