Setting Guidelines For an Under Performance Metric
Most fantasy owners expect drafted players to under and over perform some amount. When a player overperforms, the owner looks and feels great because they “knew” a breakout was coming. Owners hope they didn’t pick too many players on the other end of the spectrum. The underperformers are the ones who drag down a team and owners find as escape goats for a bad season. I’m going to start laying the groundwork to determine a hitter’s disappointment chances.
The first major step in finding a disappointing hitter is to define what is a disappointment. After owning too many fantasy teams over the years, I’ve had my share of disappointments (e.g. Brandon Webb in a 2009 first round) and feel they are just part of the game. This ambivalence doesn’t mean I shouldn’t know the breakout chances. Even small changes in the odds can make a major difference after rostering 20 or more players.
Two types of disappointments exist. The hitters who underperform production or those who miss a bunch of time. And many times, both happen because of injury. With my high disappointment tolerance, I took to Twitter to set the initial let down parameters.
I’ll start with playing time. For it, I asked the following:
If a hitter is projected for 600 PA, gets hurt, & misses time. Minimum PAs he can miss until his season is considered a disappointment?
— Jeff Zimmerman (@jeffwzimmerman) October 26, 2017
Weighing out the averages, my followers believe having just 378 PA (63% of total) is a disappointment. Basically, if the player misses over two months, it’s a letdown.
As for finding the playing time drop, I could have gone a couple different ways on production, so again, off to Twitter. I first asked which stat should I use and wOBA came out the big winner.
I'm still working at some breakout/breakdown metric. If given one metric to measure a player's offensive output, what would you prefer?
— Jeff Zimmerman (@jeffwzimmerman) October 25, 2017
I would have probably used an SGP like measurement but wOBA is probably the best method. The next step was to find out what is an acceptable drop. For the drop, I put out two tweets (the first one had too small of a range I thought) but with just OBP since it is on the same scale as wOBA.
If a hitter is projected for a .350 OBP, how far would it need to drop to seem like a disappointment?
— Jeff Zimmerman (@jeffwzimmerman) October 27, 2017
Try 2, first ? outcome range was too wide
If a hitter is projected for a .350 OBP, how far would it need to drop to be a disappointment?
— Jeff Zimmerman (@jeffwzimmerman) October 27, 2017
The first one ended up with a weighted average of .309 and the second one was at .317. Just for convenience, I went with a 35 point drop (.315).
With both parameters set, I used the 2017 Steamer preseason projections and queried the players meeting at least one of the two drop-off measures. Here’s the list (300 PA minimum projection).
| Name | PA (pred) | PA (act) | PA (diff) | wOBA (pred) | wOBA (act) | wOBA (diff) |
|---|---|---|---|---|---|---|
| Both PA and wOBA | ||||||
| Jorge Soler | 429 | 110 | -319 | 0.330 | 0.226 | -0.104 |
| Jhonny Peralta | 450 | 58 | -392 | 0.315 | 0.214 | -0.101 |
| Tyler Naquin | 419 | 40 | -379 | 0.317 | 0.228 | -0.089 |
| Dan Vogelbach | 352 | 31 | -321 | 0.323 | 0.248 | -0.075 |
| Jurickson Profar | 366 | 70 | -296 | 0.316 | 0.242 | -0.074 |
| Michael Saunders | 483 | 234 | -249 | 0.325 | 0.256 | -0.068 |
| Paulo Orlando | 348 | 90 | -258 | 0.295 | 0.228 | -0.066 |
| Leonys Martin | 461 | 138 | -323 | 0.288 | 0.224 | -0.065 |
| Travis Jankowski | 584 | 87 | -497 | 0.291 | 0.235 | -0.056 |
| Brock Holt | 396 | 164 | -232 | 0.311 | 0.256 | -0.055 |
| Gregory Bird | 474 | 170 | -304 | 0.356 | 0.303 | -0.053 |
| Adrian Gonzalez | 574 | 252 | -322 | 0.326 | 0.275 | -0.051 |
| Aledmys Diaz | 555 | 301 | -254 | 0.339 | 0.291 | -0.048 |
| Martin Prado | 554 | 147 | -407 | 0.320 | 0.274 | -0.046 |
| Troy Tulowitzki | 495 | 260 | -235 | 0.332 | 0.292 | -0.040 |
| Just PA | ||||||
| Starling Marte | 564 | 339 | -225 | 0.338 | 0.312 | -0.026 |
| Mac Williamson | 307 | 73 | -234 | 0.314 | 0.289 | -0.025 |
| Ryan Schimpf | 503 | 197 | -306 | 0.314 | 0.304 | -0.010 |
| Devon Travis | 510 | 197 | -313 | 0.318 | 0.308 | -0.010 |
| Yasmany Tomas | 474 | 180 | -294 | 0.324 | 0.319 | -0.004 |
| Andrew Toles | 336 | 102 | -234 | 0.313 | 0.329 | 0.017 |
| Yoenis Cespedes | 584 | 321 | -263 | 0.339 | 0.369 | 0.031 |
| Adam Eaton | 651 | 107 | -544 | 0.334 | 0.369 | 0.035 |
| Colby Rasmus | 465 | 129 | -336 | 0.300 | 0.365 | 0.065 |
| Just wOBA | ||||||
| Danny Espinosa | 511 | 295 | -216 | 0.279 | 0.232 | -0.047 |
| Adonis Garcia | 384 | 183 | -201 | 0.305 | 0.269 | -0.036 |
| Chris Carter | 407 | 208 | -199 | 0.332 | 0.284 | -0.048 |
| Ian Desmond | 569 | 373 | -196 | 0.342 | 0.305 | -0.038 |
| Arismendy Alcantara | 302 | 108 | -194 | 0.286 | 0.187 | -0.099 |
| Trevor Plouffe | 484 | 313 | -171 | 0.314 | 0.258 | -0.056 |
| Hyun Soo Kim | 408 | 239 | -169 | 0.338 | 0.268 | -0.069 |
| J.J. Hardy | 430 | 268 | -162 | 0.293 | 0.251 | -0.042 |
| Pablo Sandoval | 419 | 279 | -140 | 0.324 | 0.271 | -0.053 |
| Miguel Cabrera | 621 | 529 | -92 | 0.391 | 0.313 | -0.079 |
| Ben Zobrist | 537 | 496 | -41 | 0.343 | 0.302 | -0.041 |
| Carlos Beltran | 511 | 509 | -2 | 0.328 | 0.283 | -0.045 |
| Alex Gordon | 527 | 541 | 14 | 0.320 | 0.269 | -0.051 |
| Maikel Franco | 597 | 623 | 26 | 0.336 | 0.292 | -0.044 |
| Hanley Ramirez | 526 | 553 | 27 | 0.357 | 0.318 | -0.039 |
| Rougned Odor | 606 | 651 | 45 | 0.339 | 0.272 | -0.067 |
| Mark Trumbo | 554 | 603 | 49 | 0.343 | 0.295 | -0.048 |
| Manny Machado | 639 | 690 | 51 | 0.372 | 0.328 | -0.044 |
| Mookie Betts | 643 | 712 | 69 | 0.375 | 0.339 | -0.036 |
| Albert Pujols | 548 | 636 | 88 | 0.337 | 0.286 | -0.052 |
| Matt Wieters | 370 | 465 | 95 | 0.309 | 0.273 | -0.037 |
| Jose Bautista | 540 | 686 | 146 | 0.366 | 0.295 | -0.072 |
On the surface, the results seem fine. My first question is:
Which hitters should or should not be included in the list?
The biggest misses I see involves projected speedsters, like Odubel Herrera, who didn’t steal as many bases as projected. Anyone else? I am just trying to adjust the baseline.
One other change I could see is:
Should the wOBA and PA changes be combined in some way or remain separate?
If a player misses his plate appearance projection by 200 and wOBA by .030, he won’t get flagged but maybe he would if they were combined. I’m still thinking of some value to use here. Or should they be two separate categories?
After I find a reasonable framework, I can start utilizing previous projections to get a simple disappointment chance for each player. Again, let me know if any suggestions exist for improving the metric as it’s harder to go back and fix it later.
Jeff, one of the authors of the fantasy baseball guide,The Process, writes for RotoGraphs, The Hardball Times, Rotowire, Baseball America, and BaseballHQ. He has been nominated for two SABR Analytics Research Award for Contemporary Analysis and won it in 2013 in tandem with Bill Petti. He has won four FSWA Awards including on for his Mining the News series. He's won Tout Wars three times, LABR twice, and got his first NFBC Main Event win in 2021. Follow him on Twitter @jeffwzimmerman.
One idea to merge time lost and rate-based underperformance would be to assign “underperformance points”, so set some rate of UPs per PA under 600 and for UPs per point of wOBA under the projection. Then you could add them up. The challenge would be deciding what scale for each, but I think that’s sort of the point of this exercise anyway.
I like the points system. I’m thinking of doing the sum of the square roots for the values. Both values would need to be near 70% down to make the cutoff.
I like them being separate. They are two entirely different issues from the perspective of lineup and roster management.
Thanks.
I like it. You’re trying to define something subjective – what is under performing? – with something objective. A few thoughts:
1. Linking PA to wOBA seems a little chicken-and-egg-ish. I might suggest trying to filter out subsets of lack-of-PA potential. Is there a difference if a player loses PA because they’re injured vs. because they lose their job in regards to under performing? (A low enough wOBA will cause any player to lose PA.) One could argue it doesn’t matter between the two – counting stats are counting stats – but you can DL stash (replace) an injured player but not a benched player. Likewise, if a player had a role on a team (high expected PA) but was a mediocre player to begin with, and their team replaces them with an upgrade, would that player be under performing? Should it be a surprise they lost PA?
2. I think “under performing” really should take into account what the cost would be to replace that player. Ian Desmond and Adonis Garcia had about the same wOBA and PA difference, but dealing with one under performing would have been much simpler than the other. If the player at the end of my bench under performs it really doesn’t matter by how much.
3. With that being said, I think some type of ratio for the sum-of-rolling-positional-ranking-per-game-active to sum-of-expected-positional-ranking could be the way to go to measure under performing (or at least be interesting). Or, on second thought, maybe just put me in the camp that you should use SGP/$$$.
1. The health vs suck PA loss is an issue. I am thinking of doing all three with the double whammy really being an item to watch out for.
2. I disagree on this point because it would really depend on league depth. In TDGX (20 teams, 40 man rosters), Desmond and Garcia are major keepers.
3. I am in the SGP camps but am torn about the simplicity of wOBA
Why not use the Auction Calculator or some other existing valuation tool to compare projections against actual performance? Seems like you’re trying to recreate the wheel a bit here…
I could have just done auction values (SGP route) but other readers disagreed. I could see it as confusing.
Based off the questions, I don’t think it was completely clear if the disappointment was for real world versus fantasy. If the former wOBA is definitely better, if the latter I’d rather use SGP.
Jeff, I’ve been working on an article to classify breakout assets by skill improvement.
Eg: reduce K% (more balls in play), increase BB% (more times on base), flyball/groundball trends (needs three years worth of data) to forecast SLG/TB/HR improvements, HR/FB (increase strength, launch angles) improvement and normal standard deviations due to “luck”/barrels, etc.
This article fit right in with how I’m assessing players and gave me a couple more ideas. Nice piece.