TATECHATLAS
◎ English
Home / Topics

Mathematics, statistics and model quality

Practical explanations of mathematical models: overfitting, quality evaluation, result checks and limits on conclusions.

Compare a model's conclusions with the task conditions and evaluation method. Explanations and checks help you recognize overfitting and understand where results become unreliable.

Materials

8 materials

Choosing Between MAE and RMSE for Error Prediction

Understand the differences between Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE), how to choose the right metric for your prediction task, and the impact of large errors on each.

regression / model evaluation / MAE / RMSE / error metrics / scikit-learn / machine learning

Evaluating prediction intervals with empirical coverage and width

Prediction intervals aim to contain future individual observations, while confidence intervals target a mean or other parameter, and the two are not interchangeable. Empirical coverage is the held-out fraction inside the interval and width is the distance between quantile limits; a constructed five-value example gives 80 percent coverage and mean width 1.8.

prediction interval / confidence interval / quantile regression / empirical coverage / interval width / scikit-learn / calibration / held-out evaluation