Link: Supervised learning
What is regression?
Regression is a task to predict continous values instead of categorial values. E.g. predict housing prices
What is regression error metrics
Mean Absolute Error (MAE)
The mean of absolute value of errors
The problem of MAE
It wont punish large errors (the + and - will cancel out). So we introduce the Mean Squared Error.
Mean Squared Error MSE
The mean of the squared errors. More popular than MAE due to it demonstrates the large errors.
The problem of MSE
The unit will also be squared. E.g. the unit of housing price will become 2
Root Mean Square Error (RMSE)
The root of MSE It has the advantages of MSE and don’t have the unit problem.
Because it’s continous value, whether it’s good or not depends on the context. Domain knowledge plays an important role to understand the context as we need to compare the error metrics vs the average of y values.