For a Starter to Beat His ERA Estimators …

The “ability” of a pitcher to consistently beat his ERA estimators will always be a discussion top. Today, I’m going to put context on who has suppressed their ERA for two straight seasons and how they performed in the third season. I’ve been trying to see if I have missed anything while digging into under and overperforming starts and found that I might have missed the obvious, the starter’s team.

Before getting to the team context, here are the baseline chances for starting pitchers to consistently beat certain ERA benchmarks.

Beat ERA Benchmarks

The requirements I used to select the pitchers in question were:

  • Seasons since 2005.
  • Over half of the pitcher’s appearances must be starts.
  • Minimum 80 IP in each season except 2020 where the minimum was 40 IP

For the first test, I examined pitchers who beat their SIERA by 0.50 in the first two seasons and then how they performed in the third season. Here are the results (count = 120).

Results for the 0.50 SIERA-ERA Grouping
ERA SIERA Difference FIP xFIP BABIP
Season 1 3.22 4.15 0.93 3.83 4.10 .273
Season 2 3.24 4.15 0.91 3.83 4.08 .272
Season 3 3.93 4.14 0.20 4.06 4.10 .286

A few notes from the table.

  • The average difference dropped from about 0.90 down to 0.20. The pitchers still beat their estimators but by not as much.
  • The pitchers are still posting a decent BABIP in the third season with 47 (39%) of them still outperforming their BABIP by 0.5 runs. Looking that the rest of the year three results, 21% beat the projections by less than half a run, 24% had their ERA underperform by less than half a run, and finally, and for the final 16%, their ERA was over a half run higher than the estimator. The key takeaway for me would be that 40% of the starters who beat their ERA estimator for two straight seasons can’t beat the ERA estimator in the third year.
  • I looked into several variables and the key factor common in pitchers who beat the estimator was a low BABIP. Some may have also limited home runs or posted a low left on-base percentage, but the non-BABIP values evened out over the whole sample.
  • Not one batted ball-generating pitcher (e.g. groundball) stood out. The ERA estimators, especially SIERA would already take these into account.

Next, I upped the threshold to 0.75 runs. I wanted to go higher be the sample size was getting too small. Here are the number of pitchers who meet each difference criteria (the “1” was Zach Davies starting in 2019).

Sample Size SIERA-ERA Groupings
SIERA-ERA Count
0.25 236
0.50 120
0.75 41
1.00 13
1.25 6
1.50 1

And here are the results for a .75 run difference.

Results for the 0.75 SIERA-ERA Grouping
ERA SIERA Difference FIP xFIP BABIP
Season 1 3.02 4.14 1.13 3.72 4.08 .266
Season 2 2.95 4.04 1.09 3.61 3.96 .267
Season 3 4.00 4.12 0.12 3.99 4.06 .289

In this case, the original differences averaged out to be well over a run but in the third season, the difference was just 0.12.

Here are the percentages that the pitcher had a certain ERA difference in season three.

ERA-SIERA: Chance
>0.75: 22%
0.00 to 0.75: 37%
-0.75 to 0.00: 29%
< -0.75: 12%

With this sample, 59% maintain some outperformance, almost identical to the 0.50 sample.

Team Context

While the core reason for the low ERA was BABIP related, the reason for the low BABIP might not be pitcher-related but team related.

First, here is the percentage chance that the 0.50 pitchers were on the same team.

Team Status for 0.50 SIERA-ERA Grouping
Team & ERA Performance Same Team%
Same Team% (Y1 to Y2) 82%
Same Team% (Y2 to Y3) 76%
Outperformed SIERA by 0.50 (Y2 to Y3) 87%
Outperformed SIERA (Y2 to Y3) 79%
Underformed SIERA (Y2 to Y3) 71%

And for the 0.75 Sample.

Team Status for 0.75 SIERA-ERA Grouping
Team & ERA Performance Same Team%
Same Team% (Y1 to Y2) 78%
Same Team% (Y2 to Y3) 76%
Outperformed SIERA by 0.75 (Y2 to Y3) 78%
Outperformed SIERA (Y2 to Y3) 79%
Underformed SIERA (Y2 to Y3) 71%

The 0.50 sample results are cleaner (amazing what a larger sample size will do) but both point to pitchers who remained with the same team keeping more of the advantage. Here is how the pitchers who remained with the same team performed in the third season compared to those who changed teams.

SIERA-ERA in Year 3
0.50 Difference 0.75 Difference
Same Team (Y2 to Y3) 0.26 0.17
Different Team (Y2 to Y3) 0.04 -0.04

So, on average, any starter who kept their some of their gains remained with the same team while those who changed teams had their ERA regress back to their SIERA. Determining who might have this advantage is the next step but it’s not an easy one. Some same-team pitchers will get the advantage because the team’s strength (e.g. great infield defense) matches up with the pitcher’s strength (e.g. generating groundballs). Also, the catcher or team’s attack plan could be the key factor. At this point, it is tough to determine the exact cause so I’ll call it a day. I’ll mull over the results for a while and determine my next course of action.





Jeff, one of the authors of the fantasy baseball guide,The Process, writes for RotoGraphs, The Hardball Times, Rotowire, Baseball America, and BaseballHQ. He has been nominated for two SABR Analytics Research Award for Contemporary Analysis and won it in 2013 in tandem with Bill Petti. He has won four FSWA Awards including on for his Mining the News series. He's won Tout Wars three times, LABR twice, and got his first NFBC Main Event win in 2021. Follow him on Twitter @jeffwzimmerman.

4 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
GreggMember since 2020
1 year ago

This is one of the best articles I’ve read on Fangraphs all year. Very interesting findings.

Last edited 1 year ago by Gregg