Using xK and xBB With SIERA

Expected ERA metrics like SIERA, FIP and xFIP are one of the best sabermetric developments we have benefited from in recent years. No longer do we have to eye the various luck rates and attempt to make mental calculations as to how lucky or unlucky a pitcher has been. Expected ERA metrics do the work for you and spit out a number on the same scale as ERA so you could quickly identify those pitchers benefiting from good fortune and those who have not.

Unfortunately, as great as the expected ERA metrics are, they work best if the inputs have little statistical noise. For example, they all heavily rely on a pitcher’s strikeout and walk percentages. But what if those rates themselves are a bit flukey over smaller sample sizes? You know the saying, garbage in, garbage out. So I decided to take my recently published formulas for both expected K% and expected BB% and plug them into Matt Swartz’s SIERA formula. The idea here is that this might be an even more accurate picture of how well a pitcher has pitched.

So I began by combining FanGraphs and Baseball Reference data once again to get all the relevant metrics on one spreadsheet. I then started with the following formula provided by Matt.

SIERA = constant – 15.518*(SO/PA) + 9.146*((SO/PA)^2) + 8.648*(BB/PA) + 27.252*((BB/PA)^2) – 2.298*(netGB/PA) –/+4.920*((netGB/PA)^2) – 4.036*(SO/PA)*(BB/PA) + 5.155*(SO/PA)*(netGB/PA) + 4.546*(BB/PA)*(netGB/PA) + .367*(IP as SP)/(IP total)

*netGB = GB – FB
**The -/+ term is determined based on whether or not GB >= FB. If it is, you would use the minus sign, otherwise if FB > GB, use the plus sign.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

I first had to calculate this myself, rather than rely on the published SIERA marks on the player pages, because I needed to figure out what the constant is. It turned out to be about 5.65 and after several player page checks, the SIERA marks matched for all.

I then calculated each pitcher’s xK% and xBB% and substituted those expected marks for their actual marks in the SIERA formula. However, I actually used slightly different versions of the formulas I linked to in the second paragraph. Turns out, using Str% from Baseball Reference improves the adjusted R-squared for xK% by a marginal, but meaningful degree, so I used this new formula instead.

I then noticed a problem with the xBB% calculations. On average, they were a bit on the high side, with the average pitcher owning an xBB% about 0.4% higher (or a little more than 5% greater) than his actual BB%. Since the xBB% formula wasn’t as strong as the xK% formula to begin with, I decided that it should be scaled down just to match the BB% average. So I simply reduced each pitcher’s by the same rate so the average of the xBB% and BB% columns were about even.

Because I still feel we have much more room to improve the xBB%, this can provide us a new way of looking at SIERA. It’s just a matter of substituting the best xK% and xBB% marks with the pitcher’s actual SO/PA and BB/PA marks in the current formula.

This new SIERA could be compared with the pitcher’s actual SIERA marks and then sorted. Tune in tomorrow to see the results and learn which pitchers’ SIERA marks should actually be higher or lower given their xK% and xBB% marks.





Mike Podhorzer is the founder of ProjectingX IQ, an advanced fantasy baseball analytics platform that transforms projection data and in-season performance signals into actionable intelligence. He is the 2015 Fantasy Sports Writers Association Baseball Writer of the Year and three-time Tout Wars champion. He is the author of the eBook Projecting X 2.0: How to Forecast Baseball Player Performance, which teaches you how to project players yourself. Follow Mike on X@MikePodhorzer and contact him via email.

22 Comments
Oldest
Newest Most Voted
Mister
13 years ago

Whoaaa, so this is like an expected expected ERA? That’s meta.

So the new xBB% formula is the same as the previous one, but minus 0.4%?

Sarge6
13 years ago
Reply to  Mister

xMETA?

Mister
13 years ago
Reply to  Mike Podhorzer

Well, the point you brought up in your article on xBB% was that you needed to take into account sequencing. Maybe looking at splits and taking into account a pitcher’s control on 3 ball counts would help? You could add zone% on 3 ball counts, or Str% on 3 ball counts. I’m not sure if that’s a repeatable skill or not, but it might be. It seems plausible to me that there would be some pitchers who have great control but throw more balls than you would expect early in counts trying to get hitters to chase. Then, if their control is really great, they’re able to pound the strike zone on a 3 ball count. Just a thought.

shibboleth
13 years ago

This looks awesome and I can’t wait to put it to use! If I may make a request for the pipeline: those less mathematically and sabr-inclined (there’s got to be a few of us around here) would appreciate a primer piece on how all these expected ERA tools should best be leveraged by a fantasy manager. Right now I split the difference between xFIP and SIERA for judging pitching pickups and I have no idea if that’s really advisable!

Sarge6
13 years ago
Reply to  shibboleth

Yes, yes, yes. A one-stop, comprehensive “Idiot’s Guide to Looking at Sabermetric/Non-Traditional Stats to Get Ahead in Your Plain-Vanilla Stats League” would be an epic service.

Bryan Cole
13 years ago

I’ve spent all morning trying to figure out the mathematical way to get rid of that -/+ term. The best I can come up with is “-sgn(GB-FB)” and I think that’s actually more confusing than what you have up there.

I would also be interested in that primer shibboleth mentioned; if it already exists, where can I find it?

kolatch
13 years ago
Reply to  Bryan Cole

Assuming you are using excel just create an if statement with the second half of the equations sign determined by GB relationship to FB

Daniel W
13 years ago

I LOVE LOVE LOVE SIERA. I’m not even kidding. It is my one single favorite thing on this entire website, just a hair ahead of Hot GIF Action on NotGraphs.

One thing though. SIERA makes me incredibly frustrated with guys like Roberto Hernandez and Rick Porcello. I’m hoping your new calculations will shed some light on the outliers.

Dingbat
13 years ago
Reply to  Daniel W

I feel your pain, re: Hernandez and Porcello. What’s with those guys?

David WiersMember since 2016
13 years ago
Reply to  John

…seriously?

John
13 years ago
Reply to  David Wiers

I found a number of serious issues with the approach here, and I addressed them in a response. Seriously.

Tom
13 years ago

Love this. I’ve tuned in tomorrow (today) and the results are where?

Mike
13 years ago

John Ricco 1 – Mike Podhorzer 0

cdcl85
12 years ago

what happened with this?

cdcl85
12 years ago
Reply to  cdcl85

when are you planning to include it? Thanks.