Summation of 2021 Projection Accuracy

Earlier this offseason I examined the accuracy of several projections. I’m going to give my recommendations today on the best way to balance those findings between getting the best results and keeping the process simple. I’m going to focus on playing time and stats for pitchers and hitters. While there could a way to weigh every single stat of every projection, it’s just a waste of time in my opinion. The best answer is to aggregate the best options.

I know some people will want a more in-depth answer while the following will be too much for others. Some projections, like ATC, are already trying to perfect the mix and still fall short of a straight average. The cause for the disconnect is that some of the stand-alone projections are constantly improving. What may be the best projection mix in one season is suboptimal in the next. I’m willing to have 95% of the projection accuracy and instead spend my time looking for information that the projections might have missed.

First, here are the original articles.

In those articles, the following projection systems were used. Some of the projections are a single source while others are an aggregate of several projections.

Single source projections

Steamer (FanGraphs)

  • ZIPS
  • THE BAT
  • THE BAT X
  • Davenport
  • Pod (Mike Podhorzer)
  • Masterball (Todd Zola)
  • PECOTA (Baseball Prospectus)
  • RotoWire
  • Razzball (Steamer)
  • Paywall #1

Projection aggregators

  • DepthCharts (FanGraphs: Steamer and ZIPS)
  • ATC (FanGraphs)
  • ZIELE (Fantasy Pros)*
  • Average of all the above projections

And the following is how I interpret and would utilize the results.

Pitcher Playing Time

For the playing time stats, Razzball owned the competition with Pods as the only stand-alone consistently near the top. Not surprisingly, all four aggregators stayed near the top but were probably being dragged down by some of the off projections.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

Pitcher Rate/Counting Stats

The Average owns this category with a clean sweep once the rates are adjusted to the league scoring environment. The other aggregators made a decent showing. Of the stand-alone values, both of the Steamers (Razzball and FanGraphs) stood.

The one exception I would include is to consume as much information on Saves as possible. Who gets Saves is entirely manager driven so there is no way to project them. I would look at all available options and dive into any disagreements.

Overall Pitching

The simple answer is Razzball or any of the aggregators (ATC, ZEILE, or Depth Charts). Their results held up in all categories.

If I was to aggregate my own set, I’d go with an even weighting Razzball, Pods, and ATC (possibly ZiPS – Depth Chart).

Hitter Playing Time

For playing time, three of the aggregators, Average, ZEILE, and ATC shoved in this category (Depth Charts takes a hit because it only uses one playing time input). It’s an easy win for the Wisdom of the Crowds.

Hitter Rate/Counting Stats

For the stand-alone projections, THE BAT’s stand out (I’d use THE BAT X). Just below THE BAT are all four aggregators.

Overall hitting

THE BAT X since it’s handling its playing time weakness by “stealing” playing time estimators from ATC. Otherwise, I would go with ATC or ZEILE.

 

 

 

* ATC, Clay Davenport, Depth Charts, Harper Wallbanger, Luke Gloeckner, Mike Podhorzer, CBS Sports, ESPN, RotoChamp, Razzball, numberFire, Steamer, THE BAT, and ZiPS.





Jeff, one of the authors of the fantasy baseball guide,The Process, writes for RotoGraphs, The Hardball Times, Rotowire, Baseball America, and BaseballHQ. He has been nominated for two SABR Analytics Research Award for Contemporary Analysis and won it in 2013 in tandem with Bill Petti. He has won four FSWA Awards including on for his Mining the News series. He's won Tout Wars three times, LABR twice, and got his first NFBC Main Event win in 2021. Follow him on Twitter @jeffwzimmerman.

3 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
evo34Member since 2023
3 years ago

Were you able to evaluate SLG and OPP accuracy?