Setting Guidelines For an Under Performance Metric

Most fantasy owners expect drafted players to under and over perform some amount. When a player overperforms, the owner looks and feels great because they “knew” a breakout was coming. Owners hope they didn’t pick too many players on the other end of the spectrum. The underperformers are the ones who drag down a team and owners find as escape goats for a bad season. I’m going to start laying the groundwork to determine a hitter’s disappointment chances.

The first major step in finding a disappointing hitter is to define what is a disappointment. After owning too many fantasy teams over the years, I’ve had my share of disappointments (e.g. Brandon Webb in a 2009 first round) and feel they are just part of the game. This ambivalence doesn’t mean I shouldn’t know the breakout chances. Even small changes in the odds can make a major difference after rostering 20 or more players.

Two types of disappointments exist. The hitters who underperform production or those who miss a bunch of time. And many times, both happen because of injury. With my high disappointment tolerance, I took to Twitter to set the initial let down parameters.

I’ll start with playing time. For it, I asked the following:

Weighing out the averages, my followers believe having just 378 PA (63% of total) is a disappointment. Basically, if the player misses over two months, it’s a letdown.

As for finding the playing time drop, I could have gone a couple different ways on production, so again, off to Twitter. I first asked which stat should I use and wOBA came out the big winner.

I would have probably used an SGP like measurement but wOBA is probably the best method. The next step was to find out what is an acceptable drop. For the drop, I put out two tweets (the first one had too small of a range I thought) but with just OBP since it is on the same scale as wOBA.

The first one ended up with a weighted average of .309 and the second one was at .317. Just for convenience, I went with a 35 point drop (.315).

With both parameters set, I used the 2017 Steamer preseason projections and queried the players meeting at least one of the two drop-off measures. Here’s the list (300 PA minimum projection).

2017 Under Performing Hitters
Name PA (pred) PA (act) PA (diff) wOBA (pred) wOBA (act) wOBA (diff)
Both PA and wOBA
Jorge Soler 429 110 -319 0.330 0.226 -0.104
Jhonny Peralta 450 58 -392 0.315 0.214 -0.101
Tyler Naquin 419 40 -379 0.317 0.228 -0.089
Dan Vogelbach 352 31 -321 0.323 0.248 -0.075
Jurickson Profar 366 70 -296 0.316 0.242 -0.074
Michael Saunders 483 234 -249 0.325 0.256 -0.068
Paulo Orlando 348 90 -258 0.295 0.228 -0.066
Leonys Martin 461 138 -323 0.288 0.224 -0.065
Travis Jankowski 584 87 -497 0.291 0.235 -0.056
Brock Holt 396 164 -232 0.311 0.256 -0.055
Gregory Bird 474 170 -304 0.356 0.303 -0.053
Adrian Gonzalez 574 252 -322 0.326 0.275 -0.051
Aledmys Diaz 555 301 -254 0.339 0.291 -0.048
Martin Prado 554 147 -407 0.320 0.274 -0.046
Troy Tulowitzki 495 260 -235 0.332 0.292 -0.040
Just PA
Starling Marte 564 339 -225 0.338 0.312 -0.026
Mac Williamson 307 73 -234 0.314 0.289 -0.025
Ryan Schimpf 503 197 -306 0.314 0.304 -0.010
Devon Travis 510 197 -313 0.318 0.308 -0.010
Yasmany Tomas 474 180 -294 0.324 0.319 -0.004
Andrew Toles 336 102 -234 0.313 0.329 0.017
Yoenis Cespedes 584 321 -263 0.339 0.369 0.031
Adam Eaton 651 107 -544 0.334 0.369 0.035
Colby Rasmus 465 129 -336 0.300 0.365 0.065
Just wOBA
Danny Espinosa 511 295 -216 0.279 0.232 -0.047
Adonis Garcia 384 183 -201 0.305 0.269 -0.036
Chris Carter 407 208 -199 0.332 0.284 -0.048
Ian Desmond 569 373 -196 0.342 0.305 -0.038
Arismendy Alcantara 302 108 -194 0.286 0.187 -0.099
Trevor Plouffe 484 313 -171 0.314 0.258 -0.056
Hyun Soo Kim 408 239 -169 0.338 0.268 -0.069
J.J. Hardy 430 268 -162 0.293 0.251 -0.042
Pablo Sandoval 419 279 -140 0.324 0.271 -0.053
Miguel Cabrera 621 529 -92 0.391 0.313 -0.079
Ben Zobrist 537 496 -41 0.343 0.302 -0.041
Carlos Beltran 511 509 -2 0.328 0.283 -0.045
Alex Gordon 527 541 14 0.320 0.269 -0.051
Maikel Franco 597 623 26 0.336 0.292 -0.044
Hanley Ramirez 526 553 27 0.357 0.318 -0.039
Rougned Odor 606 651 45 0.339 0.272 -0.067
Mark Trumbo 554 603 49 0.343 0.295 -0.048
Manny Machado 639 690 51 0.372 0.328 -0.044
Mookie Betts 643 712 69 0.375 0.339 -0.036
Albert Pujols 548 636 88 0.337 0.286 -0.052
Matt Wieters 370 465 95 0.309 0.273 -0.037
Jose Bautista 540 686 146 0.366 0.295 -0.072

On the surface, the results seem fine. My first question is:

Which hitters should or should not be included in the list?

The biggest misses I see involves projected speedsters, like Odubel Herrera, who didn’t steal as many bases as projected. Anyone else? I am just trying to adjust the baseline.

One other change I could see is:

Should the wOBA and PA changes be combined in some way or remain separate?

If a player misses his plate appearance projection by 200 and wOBA by .030, he won’t get flagged but maybe he would if they were combined. I’m still thinking of some value to use here. Or should they be two separate categories?

After I find a reasonable framework, I can start utilizing previous projections to get a simple disappointment chance for each player. Again, let me know if any suggestions exist for improving the metric as it’s harder to go back and fix it later.





Jeff, one of the authors of the fantasy baseball guide,The Process, writes for RotoGraphs, The Hardball Times, Rotowire, Baseball America, and BaseballHQ. He has been nominated for two SABR Analytics Research Award for Contemporary Analysis and won it in 2013 in tandem with Bill Petti. He has won four FSWA Awards including on for his Mining the News series. He's won Tout Wars three times, LABR twice, and got his first NFBC Main Event win in 2021. Follow him on Twitter @jeffwzimmerman.

10 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
sabrtooth
6 years ago

One idea to merge time lost and rate-based underperformance would be to assign “underperformance points”, so set some rate of UPs per PA under 600 and for UPs per point of wOBA under the projection. Then you could add them up. The challenge would be deciding what scale for each, but I think that’s sort of the point of this exercise anyway.