When (and why) to Ignore Projections
Fantasy baseball is an inherently analytical game – you are trying to use a scarce resource (either dollars or draft picks) in a wiser manner than your competitors. And so it is no surprise that fantasy players have become big fans of the projection systems from ZiPS to Steamer to PECOTA and beyond. Just last week, Justin Vibber shared his ottoneu Surplus Calculator which uses Steamer projections to find expected values for MLB players.
In the ottoneu Slack community, the surplus calculator and other similar tools have become the primary manner of determining player value – if Steamer says a player will produce $30, that is the baseline. And this creates an opportunity to profit by ignoring projections.
Building a winning team requires you to identify opportunities to add value that your opposition doesn’t. Back in the early days of ottoneu (like, a decade ago), I was pulling projections from ZiPS on Baseball Think Factory and creating fantasy values. Most of my leaguemates were relying on standard rankings on fantasy sites, and the result was a competitive advantage for me – I valued different players than they did and targeted those players at prices below what I thought they were worth.
Today, that advantage is gone. Fantasy values are published all over, for lots of formats, including ottoneu. So if the market inefficiency a decade ago was players the projections loved but rankers did not, what is the inefficiency today?
I think it’s players the projection systems are likely to miss on. The projection systems are basically algorithms. They only know what the model accounts for and that is often limited. For example, going into 2015, Steamer and ZiPS were well aware that Jason Kipnis had underperformed in 2014. They also knew he had missed time due to injury. They did not know, necessarily, that he had played extensively through that injury and that his deflated numbers might not reflect what a healthy Kipnis can do.
If you play in a league where the projection systems are taken as gospel, Kipnis was a great opportunity for profit last year, and I ended up owning him in multiple leagues.
I’ve put together my 2016 values based on Steamer and see some examples of players whose projections I won’t take at face value:
Joey Votto – Steamer projects Votto at .283/.418/.479 with 22 HR, 87 R, and 74 RBI.* Last year, he went .314/.459/.541 with 29/95/80. In 2014, he was hurt and managed only 272 PA with a .255/.390/.409 6/32/23, but in 2013 he was again better than Steamer expects this year – .305/.435/.491 24/101/73. Steamer’s projections peg him at $21 in 5×5, $36 in 4×4 and $40 in FanGraphs Points. A hybrid of his 2013 and 2015 lines (say .310/.447/.516 26/98/76), plugged into the rest of the Steamer projections, comes out at $30/$49/$73. (That’s a bit misleading, because Steamer regresses everyone closer to the mean, so other players will also improve, but you get the idea). That awful 2014 has a real impact on the projections, as does typical age related decline, but I feel confident the injury is behind Votto. Yes, he could get hurt again, yes he could regress, but if my competition pegs him at those Steamer prices, I will gladly pay him a bit more, with a clear path towards significant profit.
Robinson Cano – Cano’s first half struggles were well documented, and he ended up being trade (or cut) bait in many leagues. But his vintage second half wasn’t quite as highly publicized. The first half woes were part bad batted ball luck (.290 BABIP for a guy who regularly posts much higher numbers), part intestinal illness, part emotional struggles related to the loss of his grandfather. It was also part aging and part home park that doesn’t help offense. But the Steamer projections are more in line with his overall 2015 line than his 2013, 2014, and 2nd half of 2015 lines. It takes a small leap of faith, but if you are willing to assume away the first half – even partially – another season with a .300+ average, .370+ OBP and high-.400’s SLG isn’t that hard to see. If you competition relies on the projections, you can turn a tidy profit by “overpaying” for Cano.
Carlos Santana – Santana has been on a three year slide – his triple slash rates all peaked in 2013 and have dropped the last two years (ok, his average stayed steady at .231 the last two years). Steamer sees a small bounce back, but the bounce back sits in between the two most recent (and worst) years, but with a lot less power than he showed in 2014 (when he hit 27 HR). However, Santana revealed after the year that he was dealing with a back issue all season. If that sapped his bat speed (a big drop in HR/FB% and HH% would vouch for the drop in pop) and if he is healthy, that return to form could look more like 2013 or 2014 than 2015. Steamer calls Santana a solid util option (14th best 1B) in FanGraphs Points, but I think he can sneak up a couple spots and become a low-end starting 1B (or a top-tier util).
You can’t do this for every player. First of all, it is too much work. Second of all, the projection systems are probably smarter than you (they are definitely smarter than me) so you have to pick your spots. It’s not enough to think a guy might be better than his projection; you have to think it is extremely likely before you gamble heavily on it.
Votto, Cano and Santana are all players I will be targeting (though Santana maybe only in OBP leagues). Who would you target as likely to outpace their projections?
*Note that I set these up last week so some Steamer projections have been updated on the site and are inaccurate in my spreadsheet – I am citing my spreadsheet.
A long-time fantasy baseball veteran and one of the creators of ottoneu, Chad Young's is the Managing Editor for RotoGraphs, and can be heard on the Keep or Kut Podcast. You can follow him on Bluesky @chadyoung.bsky.social.
Franklin Gutierrez comes to mind
Guti is an interesting one. One the one hand, his injury history suggests that if healthy he might really step up. On the other, the current Fan projections on his player page call for big steps up from his career numbers. Basically, Steamer expects slight regression off his career numbers at 33 years old, while fans expect him to play like he is in his prime. I still think he’s a guy destined for less than 100 games played and something more in the .255/.310/.410 range, which I think would be a big disappointment to a lot of fans. But yes, I think the projections on him underrate the upside.
he’s a weird case because i buy into the skill changes – not 100% of what he did last year, but, i don’t think it was just random either – but there’s also pretty definite medical reasons that he just physically can’t be a full-time player any more
so what do you do with that
i’m not sure
Obvious one: Devin Mesoraco
Yes, but I also think there were plenty of people concerned about the sustainability of his 2014 line even before the injuries. I’d expect his BABIP and HR/FB rates to come down significantly. Steamer is probably a bit low, but not crazily so. Interestingly, the Fan projections for him (though there are only 5) project better batting average and little else (the OBP rises with the AVG, but the SLG is actually lower than Steamer).
The other big category of players for me are those with a fundamental shift in approach that projection systems are unable to account for. Recent examples would be Dallas Keuchel, J.D. Martinez, etc.
So I look for players who have added a pitch or begun hitting to all fields after always pulling the ball.
Yep, agreed. Jose Bautista is another example – a guy who started to pull with authority. People who recognized the change in approach bought on the power breakout and won big.
basically all players can and should be tweaked a little bit from the projections if you have Complete Information about the player. which is nearly impossible to have, certainly for every player. but, more information is always better
you just have to
(A) understand what the projections are and how they are produced
(B) build up an experience base of how certain pieces of information about a player tend to play out
(e.g. “broken leg = down first year back, rebound later” – “swing change in the offseason – might be nothing; hot august / september = might be nothing; swing change in july PLUS hot august/september = hiii” – over the years you start to recognize patterns)
trouble is, applying these methods requires good judgment & the ability to weigh multiple pieces of information properly, which is a relatively rare & high-level skill which not everyone has usable amounts of
not to sound elitist or anything
but that’s why some people win and some people don’t
It’s not elitist, but it’s REALLY difficult to predict the future. The projection systems do a good job in aggregate, but certainly miss on many guys. The hard part is picking which ones ahead of time.
yeah. it’s like, if you’re good enough at it to actually beat the projection systems – i believe that’s possible, but if you are, you should probably be using that energy somewhere else, where you could actually be, like, making money with that skill
i do not personally follow this advice, even though i believe myself to be one of these people
Anyone know why the Steamer projections are kind of volatile?
I took the updated ones a week or so ago and noticed that Jose Abreu’s value had tanked, due in large part to a drop in playing time. He went from approximately 150 games and 600+ PA to 108 games and 480 PA. Now he’s back up to 640 PA.
I’ll take a healthy under on Daniel Murphy’s steamer projected .308/.350/.440 triple slash. I can’t believe how crazy-pants that line is has not gotten more attention.
ISO is regressed in line with career after last year’s surge, and BB% is stable. Looks like the line is primarily driven by a projected BABIP/average spike… .330 BABIP is aggressive for my tastes but .320 is consistent with his career from 2011-2014.
Positive BABIP regression should offset negative ISO regression, so I wouldn’t pull back from the overall line much.
The guys on the BP Effectively Wild podcast do a draft once or twice a year, where they try to pick out guys likely to over or under-perform their projections. They don’t do much better than 50/50.
Ben & Sam aren’t dumb. The projection systems will DEFINITELY get some guys wrong, and you will certainly be able to pick out some of the mistakes ahead of time. But there will be just as many situations where the projections win and you are wrong.
Predicting the future is hard. The projections do a good job in AGGREGATE, but they miss many things on individuals. We overrate our ability to pick those out ahead of time.
Yes, but the key is reacting quickly to what happens after the draft. If I bet on the three guys above, you are right that I will probably miss on one or two, but if I know what I am looking for (are they struggling because of bad luck or because the 2014/2015 issues are rearing their heads and maybe I shouldn’t have underestimated them) I can get away from those mistakes with trades, cuts, etc. I will admit this is harder at the top tier (If I bet on Votto being a $50 player and pay $35 and he is a $30 player, I am probably stuck) but the downside is also smaller (a $30 Votto won’t hurt you). On the guys with even worse projections/higher bust risk, you can usually get them cheaper and simply move on.
The big concept – too much faith in the projection systems leads to a new market inefficiency – seems spot on. But I still think we all overrate our own ability to capitalize on the inefficiency.
Even for the guys who are breaking out or slumping IN SEASON, I think it’s more difficult to correctly predict the future than you seem to believe. We remember the times that we correctly picked up on something new (Jose Bautista), and forget all the times we thought we had an edge on the projections and the guy ended up regressing.
This is an excellent point, and it’s my primary counter argument for Chad’s point in this article. I absolutely agree that the projections systems will fail to account for things that a savvy fantasy player can, but I have very little confidence in my own ability to accurately predict which players will be hits/misses. For every instance where the projections are legitimately missing something, there is a case of a player who has a certain narrative around them that causes some to ignore accurate projections.
For the reasons mentioned, I think the fantasy community overrates projecting the future as the deciding factor in winning leagues. More important:
–Luck (injuries, stumbling into a breakout star nobody saw coming, etc.)
–Game theory (allocating resources; draft strategy; keeper strategy; churning the bottom of your roster to maximize chances to hit; trading theory; maximizing categorical points; etc)
–Making all the small moves (very active on free agents; streaming; maximizing ABs; etc.)
Everyone has access to relatively similar projections. As mentioned many times, “Sleepers” are almost extinct – by late March, most drafters are savvy enough to pick up on the hot guys and their prices inflate. Your (my) ability to beat the market on enough players to have a clear, definitive edge is near-0.
So: do everything else REALLY well. Not everyone thinks through game theory well. Many don’t pay close attention all year. Put yourself in a position to maximally benefit from variance and injury luck. Set up your roster so that you increase your odds of having the breakout player that nobody saw coming (yourself included).
yes, agree with this. roster agility is critical, and vastly underutilized.
i think the popularity of BEWARE SMALL SAMPLE SIZE – which of course is a good and valid concept, in the abstract – leads people astray sometimes, in that, many people will hold an underperforming player waiting for them to get on track, rather than pivoting to an available breakout at no cost. when in fact the player is underperforming due to an injury, or rather obvious skill problem cropping up, etc
but of course, again, doing this properly requires complex good judgment. it doesn’t mean “drop adrian gonzalez if he has a cold first two weeks”
sometimes “reacting to what’s in front of you” can LOOK like “predicting the future” if you do it faster than your competitors are able to recalibrate their expectations and preconceptions
ive decided that predicting the future is too much of a crap shoot and focusing on roster management is more important. of course, i still try my hand at predictions but ultimately rely on the projections the vast majority of the time. maybe a few low to mid round gambles
Good stuff, Chad.
Maikel Franco.
Cole Hamels is projected as a $10 value in 2016. That seems jarringly low considering he is coming off of 5 consecutive 1,000+ point seasons in ottoneu with fangraphs scoring. I haven’t been able to come up with any explanation. His average salary in fangraphs points leagues right now is $31. Can anyone shed light on the $10 projected value?