Setting Guidelines For an Under Performance Metric
Most fantasy owners expect drafted players to under and over perform some amount. When a player overperforms, the owner looks and feels great because they “knew” a breakout was coming. Owners hope they didn’t pick too many players on the other end of the spectrum. The underperformers are the ones who drag down a team and owners find as escape goats for a bad season. I’m going to start laying the groundwork to determine a hitter’s disappointment chances.
The first major step in finding a disappointing hitter is to define what is a disappointment. After owning too many fantasy teams over the years, I’ve had my share of disappointments (e.g. Brandon Webb in a 2009 first round) and feel they are just part of the game. This ambivalence doesn’t mean I shouldn’t know the breakout chances. Even small changes in the odds can make a major difference after rostering 20 or more players.
Two types of disappointments exist. The hitters who underperform production or those who miss a bunch of time. And many times, both happen because of injury. With my high disappointment tolerance, I took to Twitter to set the initial let down parameters.
I’ll start with playing time. For it, I asked the following:
If a hitter is projected for 600 PA, gets hurt, & misses time. Minimum PAs he can miss until his season is considered a disappointment?
— Jeff Zimmerman (@jeffwzimmerman) October 26, 2017
Weighing out the averages, my followers believe having just 378 PA (63% of total) is a disappointment. Basically, if the player misses over two months, it’s a letdown.
As for finding the playing time drop, I could have gone a couple different ways on production, so again, off to Twitter. I first asked which stat should I use and wOBA came out the big winner.
I'm still working at some breakout/breakdown metric. If given one metric to measure a player's offensive output, what would you prefer?
— Jeff Zimmerman (@jeffwzimmerman) October 25, 2017
I would have probably used an SGP like measurement but wOBA is probably the best method. The next step was to find out what is an acceptable drop. For the drop, I put out two tweets (the first one had too small of a range I thought) but with just OBP since it is on the same scale as wOBA.
If a hitter is projected for a .350 OBP, how far would it need to drop to seem like a disappointment?
— Jeff Zimmerman (@jeffwzimmerman) October 27, 2017
Try 2, first ? outcome range was too wide
If a hitter is projected for a .350 OBP, how far would it need to drop to be a disappointment?
— Jeff Zimmerman (@jeffwzimmerman) October 27, 2017
The first one ended up with a weighted average of .309 and the second one was at .317. Just for convenience, I went with a 35 point drop (.315).
With both parameters set, I used the 2017 Steamer preseason projections and queried the players meeting at least one of the two drop-off measures. Here’s the list (300 PA minimum projection).
Name | PA (pred) | PA (act) | PA (diff) | wOBA (pred) | wOBA (act) | wOBA (diff) |
---|---|---|---|---|---|---|
Both PA and wOBA | ||||||
Jorge Soler | 429 | 110 | -319 | 0.330 | 0.226 | -0.104 |
Jhonny Peralta | 450 | 58 | -392 | 0.315 | 0.214 | -0.101 |
Tyler Naquin | 419 | 40 | -379 | 0.317 | 0.228 | -0.089 |
Dan Vogelbach | 352 | 31 | -321 | 0.323 | 0.248 | -0.075 |
Jurickson Profar | 366 | 70 | -296 | 0.316 | 0.242 | -0.074 |
Michael Saunders | 483 | 234 | -249 | 0.325 | 0.256 | -0.068 |
Paulo Orlando | 348 | 90 | -258 | 0.295 | 0.228 | -0.066 |
Leonys Martin | 461 | 138 | -323 | 0.288 | 0.224 | -0.065 |
Travis Jankowski | 584 | 87 | -497 | 0.291 | 0.235 | -0.056 |
Brock Holt | 396 | 164 | -232 | 0.311 | 0.256 | -0.055 |
Gregory Bird | 474 | 170 | -304 | 0.356 | 0.303 | -0.053 |
Adrian Gonzalez | 574 | 252 | -322 | 0.326 | 0.275 | -0.051 |
Aledmys Diaz | 555 | 301 | -254 | 0.339 | 0.291 | -0.048 |
Martin Prado | 554 | 147 | -407 | 0.320 | 0.274 | -0.046 |
Troy Tulowitzki | 495 | 260 | -235 | 0.332 | 0.292 | -0.040 |
Just PA | ||||||
Starling Marte | 564 | 339 | -225 | 0.338 | 0.312 | -0.026 |
Mac Williamson | 307 | 73 | -234 | 0.314 | 0.289 | -0.025 |
Ryan Schimpf | 503 | 197 | -306 | 0.314 | 0.304 | -0.010 |
Devon Travis | 510 | 197 | -313 | 0.318 | 0.308 | -0.010 |
Yasmany Tomas | 474 | 180 | -294 | 0.324 | 0.319 | -0.004 |
Andrew Toles | 336 | 102 | -234 | 0.313 | 0.329 | 0.017 |
Yoenis Cespedes | 584 | 321 | -263 | 0.339 | 0.369 | 0.031 |
Adam Eaton | 651 | 107 | -544 | 0.334 | 0.369 | 0.035 |
Colby Rasmus | 465 | 129 | -336 | 0.300 | 0.365 | 0.065 |
Just wOBA | ||||||
Danny Espinosa | 511 | 295 | -216 | 0.279 | 0.232 | -0.047 |
Adonis Garcia | 384 | 183 | -201 | 0.305 | 0.269 | -0.036 |
Chris Carter | 407 | 208 | -199 | 0.332 | 0.284 | -0.048 |
Ian Desmond | 569 | 373 | -196 | 0.342 | 0.305 | -0.038 |
Arismendy Alcantara | 302 | 108 | -194 | 0.286 | 0.187 | -0.099 |
Trevor Plouffe | 484 | 313 | -171 | 0.314 | 0.258 | -0.056 |
Hyun Soo Kim | 408 | 239 | -169 | 0.338 | 0.268 | -0.069 |
J.J. Hardy | 430 | 268 | -162 | 0.293 | 0.251 | -0.042 |
Pablo Sandoval | 419 | 279 | -140 | 0.324 | 0.271 | -0.053 |
Miguel Cabrera | 621 | 529 | -92 | 0.391 | 0.313 | -0.079 |
Ben Zobrist | 537 | 496 | -41 | 0.343 | 0.302 | -0.041 |
Carlos Beltran | 511 | 509 | -2 | 0.328 | 0.283 | -0.045 |
Alex Gordon | 527 | 541 | 14 | 0.320 | 0.269 | -0.051 |
Maikel Franco | 597 | 623 | 26 | 0.336 | 0.292 | -0.044 |
Hanley Ramirez | 526 | 553 | 27 | 0.357 | 0.318 | -0.039 |
Rougned Odor | 606 | 651 | 45 | 0.339 | 0.272 | -0.067 |
Mark Trumbo | 554 | 603 | 49 | 0.343 | 0.295 | -0.048 |
Manny Machado | 639 | 690 | 51 | 0.372 | 0.328 | -0.044 |
Mookie Betts | 643 | 712 | 69 | 0.375 | 0.339 | -0.036 |
Albert Pujols | 548 | 636 | 88 | 0.337 | 0.286 | -0.052 |
Matt Wieters | 370 | 465 | 95 | 0.309 | 0.273 | -0.037 |
Jose Bautista | 540 | 686 | 146 | 0.366 | 0.295 | -0.072 |
On the surface, the results seem fine. My first question is:
Which hitters should or should not be included in the list?
The biggest misses I see involves projected speedsters, like Odubel Herrera, who didn’t steal as many bases as projected. Anyone else? I am just trying to adjust the baseline.
One other change I could see is:
Should the wOBA and PA changes be combined in some way or remain separate?
If a player misses his plate appearance projection by 200 and wOBA by .030, he won’t get flagged but maybe he would if they were combined. I’m still thinking of some value to use here. Or should they be two separate categories?
After I find a reasonable framework, I can start utilizing previous projections to get a simple disappointment chance for each player. Again, let me know if any suggestions exist for improving the metric as it’s harder to go back and fix it later.
Jeff, one of the authors of the fantasy baseball guide,The Process, writes for RotoGraphs, The Hardball Times, Rotowire, Baseball America, and BaseballHQ. He has been nominated for two SABR Analytics Research Award for Contemporary Analysis and won it in 2013 in tandem with Bill Petti. He has won four FSWA Awards including on for his Mining the News series. He's won Tout Wars three times, LABR twice, and got his first NFBC Main Event win in 2021. Follow him on Twitter @jeffwzimmerman.
One idea to merge time lost and rate-based underperformance would be to assign “underperformance points”, so set some rate of UPs per PA under 600 and for UPs per point of wOBA under the projection. Then you could add them up. The challenge would be deciding what scale for each, but I think that’s sort of the point of this exercise anyway.
I like the points system. I’m thinking of doing the sum of the square roots for the values. Both values would need to be near 70% down to make the cutoff.