I Have Been Wrong 3,388 Times. Here Is The Breakdown.
The Sky Desk publishes its error rate every Friday. This is the annual version: the months I am worst at, the spring I was wrong nine times in ten, and the one change a reader in Binghamton made me make.
Background written by the news staff. Contains no argument or recommendation.
ITHACA, N.Y. — Since 4 September 2006 I have issued 5,214 forecasts for this newspaper. By my own scoring rule I have been wrong on 3,388 of them.
That is a 65 per cent error rate, and I publish it every Friday, and every few months somebody writes in to ask why I still have a job.
What "wrong" means here
It means the observed conditions fell outside the bounds I stated. Not outside a generous interpretation of them. Outside the numbers I printed.
Most published forecast accuracy figures are not calculated this way, and the ones that report 90 per cent are usually scoring a much easier question — did it rain at all, within a wide window, at any station in a region.
My rule is harsh on purpose. A forecast that cannot be scored strictly is not a forecast, it is a mood, and this desk has enough trouble with moods already.
| Month | Error rate | Worst year |
|---|---|---|
| January | 58% | 2014 (74%) |
| February | 61% | 2011 (77%) |
| March | 71% | 2019 (88%) |
| April | 74% | 2019 (91%) |
| May | 69% | 2019 (86%) |
| June | 66% | 2022 (79%) |
| July | 63% | 2013 (75%) |
| August | 62% | 2013 (74%) |
| September | 60% | 2016 (71%) |
| October | 64% | 2018 (76%) |
| November | 68% | 2015 (81%) |
| December | 66% | 2014 (80%) |
March and April are my worst months and always have been. The spring transition over the Finger Lakes is genuinely hard and I am genuinely bad at it.
The 2019 spike
In March and April of 2019 I was wrong on nine out of ten forecasts.
The reason is not interesting and I am going to print it anyway, because the interesting reasons are the ones people invent when you do not give them the boring one. My anemometer had been mounted, during roof repairs the previous autumn, four metres from a new plant enclosure, and it spent two months reading a wind that only existed within four metres of itself.
I did not notice for nine weeks. A reader noticed, from her garden, eleven kilometres away, and wrote to say my wind speeds had gone strange. She was right and I have sent her a Christmas card every year since.
The change I am making
The dispersal index — this desk's own nine-point measure, which I introduced in 2011 over two editors' objections — moves out of the forecast box on Monday.
A reader in Binghamton wrote to us this month with nine years of her own data showing a correlation of 0.03 between the index and anything at all in her life, and made an argument I have not been able to answer: that a number printed in the weather box becomes a weather number in the reader's head, whatever the disclaimer under it says.
She is right. Disclaiming a thing does not undo the effect of where you put it. From Monday the index has its own panel, its own heading, and her coefficient printed underneath it with her name on it.
Dr. Ferreira-Ludlow, who helped me design the verification rule, thinks I should retire the index altogether and told me so in writing. Her objection, printed at her request: "You have built a measure with no demonstrated relationship to anything and moved it four inches. Four inches is not an answer."
She may be right too. I am going to see how Monday goes.
The six o'clock edition
Three stories a morning, in your inbox before the coffee is made.
Sources & Method
A forecast is scored the day after it is issued against the observed conditions at a fixed station, using a scoring rule chosen in 2011 and unchanged since. 'Wrong' means outside the stated bounds, which is a harsh standard and is meant to be.
Who we spoke to
- The Sky Desk's own verification log, Kept daily since 2006. Published in full alongside this piece 2006–2026
- Dr. Constance Ferreira-Ludlow, Consulted on the verification method. Written correspondence June 2026 Suggested the scoring rule this desk now uses and objects to one part of it. Her objection is printed.
How was this story?
We publish the result, whatever it is. Reader verdicts appear on the front page and in our newsroom metrics.
Readers' Letters 1
Printed at once under the name you give and read by the desk afterwards; anything unfit is removed, with a note saying so, and nothing else is ever deleted — only corrected. Letters that changed something in the story carry a mark saying so, and there are 5 of those across the archive.
He moved it four inches and put my name on it. I did not expect either. The coefficient is 0.03 and I will send him the 2027 figure in January.