Ranking Small Sample Pitchers

Reinhold Matay-USA TODAY Sports

A couple of weeks ago, I examined four starting pitchers using a small sample of predictive data. It was a half-hearted comparison. I’m correcting that today with a simple FanGraphs download to spreadsheet comparison.

I decided on the stats to use based on work I did for The Process. Here is a look at what early-season stats are most predictive of rest-of-season stats (R-squared values).

I used the two overall STUFH values (BotOverall, Pitching+) and the top two ERA estimators (SIERA, xFIP). Additionally, I wanted to weigh the stats that immediately stabilize (Ball%, SwStr%, Fastball velocity).

One major change, I put all the values on an ERA scale for easier comparison. Three values came in an ERA format, but the others need to be calculated. Here are the formulas I used (also in the provided spreadsheet).

  • Pitching+ ERA: (Pitching+) * (-0.067) + 10.815
  • SwStr%-Ball% ERA: (-19.4472)* SwStr% + 9.985324 * (Balls/Pitches) + 2.672178
  • Fastball Velo (FBv) ERA: FBv * (-0.1416) + 17.339

Here is a link to the values along with the pitchers featured in this week’s waiver wire column. I limited the time frame to just the past two weeks. I use a method that makes the best decision with a small sample.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

Not all the values are in the download, so I created a copyable spreadsheet (File, Create a Copy) to paste the pitchers’ stats (cell L4), and then the various ERA values are calculated along with an overall value.  The average ERA can be ordered by using the promote option in cell J4.

In this instance, Brandon Walter stands out with everything looking great, except his 92 mph (4.32 ERA) fastball. He could bomb, but the goal is to make the best decision with little information.

One possible change is to adjust the weightings. I equally weighed the values. Someone can always give more weight to certain values (Pitching+) or just remove others (FBv). For me, the table allows for easy comparison of pitchers. If I were to evaluate each pitcher, I’d look at the above stats. This makes the analysis easier.

Two additions could be included: the first is to add a projection based on the preseason prospect rank (overall and team), the other one is to include the pitcher’s ERA projection (via xlookup).

Let me know if you have any questions on setting up the spreadsheet to help evaluate pitchers with a small MLB data sample.





Jeff, one of the authors of the fantasy baseball guide,The Process, writes for RotoGraphs, The Hardball Times, Rotowire, Baseball America, and BaseballHQ. He has been nominated for two SABR Analytics Research Award for Contemporary Analysis and won it in 2013 in tandem with Bill Petti. He has won four FSWA Awards including on for his Mining the News series. He's won Tout Wars three times, LABR twice, and got his first NFBC Main Event win in 2021. Follow him on Twitter @jeffwzimmerman.

13 Comments
Oldest
Newest Most Voted
JRMayneMember since 2016
1 year ago

Thanks for this! A few quick items:

  1. Walter’s listed at 12.2 innings, but has 17.2.
  2. You probably should adjust for handedness for velo (and ideally for height.) Lefties can often survive at 92; righties are less likely to.
  3. Walter is different in your chart from the rest of these guys, and I think that’s because he’s different than the rest of these guys.
JRMayneMember since 2016
1 year ago
Reply to  Jeff Zimmerman

Ah, thanks!

TylerMember since 2016
1 year ago
Reply to  JRMayne

He limited it to the last two weeks, that first Walter start was back in May.

Walter caught my eye earlier this week and it’s always good to see someone smarter than me confirm my priors. I’ve also had my eye on Colton Gordon, Houston might have found a couple solid gems to replace their injured starters.

docgooden85Member since 2018
1 year ago

Can you put this behind a pay wall that my competitors can’t read for free? It’s too valuable to just give those clowns… Also, thanks and I’m gonna miss you next year.

MadiganMember since 2021
1 year ago

Great stuff as always, Jeff! Is the stuff+ based off the latest model? I know in the Process, it used last year’s model because Eno didn’t update it until well after publication.

SculpinMember since 2025
1 year ago

Thanks for this. I was just wondering if I had the right small sample pitcher in Walter, now I won’t worry about that until he gets another couple starts. I was looking at Mick Abel who just got cut in my shallow mixer.

Walter is an enigmatic guy. He has thrown that 92 mph fourseamer only 7.5% of his pitches. It is seemingly always a surprise (so far), because he gets a 55%(!) whiff and .210 xSLG on it. His most-used pitch is an 88 mph cutter, which also yields the highest xSLG at .473. He throws his two best pitches, sweeper and changeup, about 46% of the time. The changeup is particularly devastating.

In short, a classic – and so far excellent – soft-tossing lefty who throws his fourseamer just enough to keep hitters from waiting for his changeup.

TylerMember since 2016
1 year ago
Reply to  Sculpin

The Statcast numbers on the break of his sweeper, sinker, and changeup are eye-popping. He’s got a healthy chase rate and that kind of movement might explain why.

the ghost of tyler chatwoods controlMember since 2021
1 year ago

This is great stuff, thanks. Would you consider adjusting for opponent quality or park factors in the future? Would think that has the potential to have a large impact on such a small sample. Though some of these pitch-specific factors (FBv) and to a lesser degree BotERA and Pitching+ERA are insulated from park and opponent effects.

ccovilleMember since 2020
1 year ago

This is great. Hopefully this helps shorten my morning routine of looking at numbers and endlessly debating if these guys are actually good.