Evaluating Early Season Pitcher Performance

In the first month of the season, fantasy sites and blogs will be littered with your standard buy low and sell high columns. The authors will highlight hitters suffering/benefiting from a low/high BABIP or pitchers whose xFIP (or other expected ERA metric of choice) is dramatically different from their ERAs. I won’t get into why I think these articles are rather useless, but I do want to discuss how to go about evaluating early season pitcher performances. There is a two-step process I use and since I am feeling generous, I would like to share it with you.

I ask myself two questions when analyzing a pitcher during the season:

1. Are his results (ERA and WHIP) stats real?

2. Will he sustain those underlying peripherals?

Are his results (ERA and WHIP) stats real?

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

The first order of business is to do what the majority of fantasy owners likely do by now, or at least those a step above the newbie level. That is to compare the pitcher’s ERA to his SIERA (my personal expected ERA metric of choice) to determine how real his results have been. It is easy to notice a high BABIP and blindly assume the pitcher’s ERA should drop, but what if that comes with a low HR/FB ratio? It is difficult to do the math in your head and figure out how the luck in one metric offsets the poor fortune in another. So a quick look at SIERA can tell us how all those metrics mix together. Of course, this is FanGraphs, so you all probably do this step already.

It cannot be overstated though how much small sample size can affect a pitcher’s ERA. The actual number early on means so little as to render it almost meaningless. Only a couple of earned runs here and there can make a strong season look mediocre. To illustrate this point, imagine a pitcher who has allowed 16 earned runs over 45 innings (around a month and a half of innings). That results in a strong 3.20 ERA. However, if this same pitcher allowed just 4 more runs (just 1 extra run every 11 innings or so) to total 20, suddenly his ERA shoots up to 4.00 and he doesn’t even look appealing to a shallow league owner! So fantasy owners would be wise not to focus on ERA at all when analyzing a pitcher so early. That is why metrics such as SIERA are even more useful when dealing with small sample sizes.

Will he sustain those underlying peripherals?

This step is just as important as the first one, but I am unsure how many fantasy owners actually perform it. It is simply not enough to determine that a pitcher has been unlucky this year because his SIERA sits at 3.40, but a .330 BABIP and 68% LOB% has inflated his ERA to 4.20. One must also look at how sustainable his underlying peripherals are.

Remember that a pitcher has a greater opportunity to strike hitters out when they face more batters. So all else equal, a high BABIP is going to increase K/9 and reduce SIERA. Of course, it will also increase his BB/9, but the K/9 increase probably has a greater effect on SIERA than the BB/9 increase. So once his BABIP drops back toward league average (or his career mark), the strikeout rate is going to decline and the SIERA will rise. The better luck will help his ERA improve, but it’s not going to drop all the way down to where his SIERA had been.

Next, a pitcher may be getting lucky with strikeouts based on sequencing or an unsustainable rate of foul ball strikes. A check of the pitcher’s SwStk% and how his marks in that metric have historically matched up with his strikeout rate can give you an idea as to whether he will sustain his current K/9. Similarly, looking at the pitcher’s F-Strike% will tell you how sustainable the pitcher’s BB/9 is.

Even if the strikeout rate does match up with the SwStk%, you must then go a step further if the K/9 is dramatically different than past years. A look to see if there have been changes in pitch mix, velocity or a new pitch added to his arsenal is required to help determine how sustainable this new K/9 level is.

The bottom line is that it is not enough to simply compare SIERA with ERA to identify buy low and sell high candidates. You must dig deeper to determine if the components that drive SIERA itself are sustainable. If the components themselves change over the remainder of the season, then that SIERA mark is going to change as well and the pitcher’s ERA cannot be counted on to eventually meet it where it currently stands.





Mike Podhorzer is the 2015 Fantasy Sports Writers Association Baseball Writer of the Year and three-time Tout Wars champion. He is the author of the eBook Projecting X 2.0: How to Forecast Baseball Player Performance, which teaches you how to project players yourself. Follow Mike on X@MikePodhorzer and contact him via email.

12 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Brent Crossman
13 years ago

Good post. One thing I’ve noticed in your posts is you reference swinging strike rate as being a predictor for strike out %. I’ve never found that to be any more correlated with future K% than simply using the historical K%. Perhaps there is a study linking the residual between (Expected K% based on SwgStrk% and Actual K%) vs Future Movement in K% but I haven’t seen it, and every time I test it I don’t a meaningful connection.

This is another good article on regression http://www.hardballtimes.com/main/article/it-makes-sense-to-me-i-must-regress/

(K rate and GB rate being the two that get reliable quickly, although still not for a while)