Choose a regression metric for non-negative data by first deciding the prediction goal, then picking a consistent loss such as MAE, RMSE, or pinball loss, and finally comparing against a constant baseline with a D2-style score.
scikit-learn / regression metrics / MAE / RMSE / pinball loss / quantile regression / D2 score / non-negative targets
A practical guide to selecting a decision threshold by weighting false‑positive and false‑negative costs, using a held‑out validation set and scikit‑learn confusion matrices.
threshold‑tuning / cost‑sensitive / confusion‑matrix / scikit‑learn / model‑validation
Prediction intervals aim to contain future individual observations, while confidence intervals target a mean or other parameter, and the two are not interchangeable. Empirical coverage is the held-out fraction inside the interval and width is the distance between quantile limits; a constructed five-value example gives 80 percent coverage and mean width 1.8.
prediction interval / confidence interval / quantile regression / empirical coverage / interval width / scikit-learn / calibration / held-out evaluation
Build a previous-season reference, evaluate it on later observations and distinguish calendar alignment from leakage and missing data.
Time Series / Forecasting / Baseline / Validation
Use chronological splits and fit preprocessing only on past data.
Python / Time series / Validation