Diagnosing Jon Gray
In a fairly surprising turn of events, the Rockies demoted Jon Gray Saturday. Gray has arguably been baseball’s most enigmatic pitcher this year, posting a career-worst 5.77 ERA supported by career-best peripherals — e.g., a 13.4% swinging strike rate (SwStr%) underpinning a 28.9% strikeout rate (K%), and fielding independent metrics of 2.78 xFIP, 3.08 FIP, and 3.15 SIERA. Given our most basic sabermetric understandings of baseball, Gray should be a very good pitcher, even if he pitches half his starts at hitters’ paradise Coors Field.
I have written about how a common-breed Rockies pitcher’s peripherals might be penalized for calling Coors Field home (Gray inspired this bit of research as well). FIP metrics generally underestimate ERA by anywhere from 0.8 to 1.3 runs for home starts (compared to 0.0 to 0.2 runs for road starts), suggesting that Rockies pitchers may underperform (a) their FIPs by 0.35 runs or (b) their SIERAs by 0.65 runs — given error bars, maybe more.
Still, that doesn’t explain why Gray’s ERA is nearly 6 right now. I shed light on the ridiculousness of the move; his strand rate (LOB%) is suppressed and his batting average on balls in play (BABIP) is elevated, even compared to his uniquely bad baselines. I’m not sure there’s much more to it.
Nick Mariano of RotoBaller noted here that Gray’s fastball has been incredibly hittable since his debut and especially this year. Despite my thoughts on the inevitability of regression in Gray’s favor, I wanted to pursue Mariano’s train of thought a little further. Gray’s fastball is bad, but how bad? And why?
Answer: it’s bad. I mean, this probably won’t surprise you, but among 125 pitchers with at least 300 batted balls against their four-seamers from 2015 through 2017, Gray’s fastball ranks 123rd in BABIP allowed (.362) and 106th in line drive rate (LD%) allowed (30.3%). Among 41 fastballs that allowed at least 500 batted balls (Gray’s incurred 505 from 2015-17), Gray’s predictably ranks last in BABIP and 36th in LD%. I’ve been talking about everything pre-2018, but this year has only been worse: 31% line drives (according to Baseball Prospectus’ PITCHf/x leaderboards) and a .406 BABIP allowed (source), respectively ranking 55th and dead last among 73 fastballs thrown 500 times this year. Four-seamers are particularly vulnerable pitches; Gray’s, exceedingly so. It’s hard to believe this is anything less than a trend.
I qualitatively compared the composition of Gray’s fastball to those of Hector Santiago, Ian Kennedy, and Matt Moore — all decidedly unimpressive pitchers who, nonetheless, suppress BABIP against their fastballs. Brooks Baseball has a “grooved pitches” variable; I expected Gray’s to be exorbitantly high relative to his colleagues. Alas, they all float in the 5% to 7% range, showing no significant differences. I looked at pitch location and movement, hoping but failing to eyeball a glaring outlier. There might be some merit to attributing the issue to Gray’s release points, which differ dramatically for his four-seamer compared to his other pitchers, which are clustered at a different release point. But the trend doesn’t hold in 2014-15, and his fastball sucked then, too. I took the quantitative route and ran a few regressions that turned up empty as well.
It’s an unsatisfying conclusion, but maybe it’s just an extremely bad pitch. (There’s a good quote from Ben Lindbergh’s piece for The Ringer this morning about Gray missing middle-middle too often.) You know who else throws an extremely bad primary pitch? Michael Pineda, who has the 2nd-worst BABIP the last four years (min. 400 innings) and whose cutter has incurred a .341 BABIP on more than 900 balls in play. We have all but accepted that Pineda is who he is. We might have to do the same with Gray — that these problems are not simply the product of Coors Field (he has a career 5.02 ERA on the road).
All of these problems begin to compound, too. Although I just wrote off Coors Field as being the problem with his fastball, it is the problem with just about everything else, being an extreme hitters’ park that, contrary to popular belief, plays up BABIP way more than it does home runs. Higher BABIP leads to more baserunners leads to lower strand rates (r2 = 0.28) leads to more runs allowed. The fielding independent metrics, founded upon regression analysis, look at key variables (strikeouts, walks, ground balls, etc.) and inherently assume all else (namely, BABIP and LOB%) is held constant.
In other words, FIP and xFIP and SIERA evaluate a specific set of pitcher outcomes and assume everything else is league-average, for better or, in Gray’s case, for worse. Since 2000, Rockies pitchers have underperformed FIP by 0.32 runs, xFIP by 0.53 runs, and SIERA by 0.54 runs (very slightly more conservative than the numbers from my ERA-minus-SIERA post linked at the beginning). Those deficits encompass more than 26,000 innings thrown both home and away. (I know you’re expecting splits: 5.08 ERA versus 4.23 xFIP at home, 4.50 ERA versus 4.41 xFIP away.) We can’t reasonably expect Gray to come within half a run of his SIERA in the long run as a true-talent league-average BABIP pitcher, which he is not. It appears he’s worse than that. We should adjust our expectations accordingly. Gray’s career ERA-minus-SIERA differential stands at 1.10 runs. I think it’s a bit exaggerated, but it may not improve by a substantial margin. This says nothing of his potential issues while pitching with runners on base, as Lindbergh discusses. However, I’m not completely sold on this being a legitimate issue; it’s supposedly the same problem that affected Robbie Ray in 2016 with his historically high BABIP allowed, only to turn around and have a stellar 2017 campaign devoid of such problems.
This brings us full circle: Gray can be both (1) not as good as we hope and also (2) “due” for regression. Those tenets are not mutually exclusive. Gray’s 2.62 ERA-minus-SIERA screams that he’s much better than his 5.77 ERA suggests, irrespective of Coors Field or his fastball. He will come back from AAA, cash in on some good luck on his BABIP and LOB%, and have a dominant second half, and we will attribute the success to his demotion. Fact of the matter is pitchers historically have rarely, bordering on never, sustained a .386 BABIP and a 63.1% strand rates for a full season.
Granted, the folks reading this post are more likely Gray believers than dissenters. I don’t need to convince you he’s better than this. But I do need to convince you Gray’s 2.78 xFIP betrays you. Gray’s absolutely a regression candidate, but he’s still not the staff ace the Rockies have so desperately needed for so long, nor is he the fantasy No. 2 you see under the surface. Given his current peripherals, he’s more likely a true-talent 4.00 ERA guy; given his career marks, maybe closer to 4.30 ERA. And if you believe in the issues with men on base: even worse.
Isn’t it possible that some of this is because the Rockies defense is not very good?
Sure! It’s just usually hard to prove, kind of like the whole “is it the Cubs’ pitching or defense” fiasco from 2016
I wonder if it’s suitable to pull catch probability and create a delta for teams. or even right down to the starts of certain starting pitchers.
Since 2015, the Rockies rank 8th in defensive WAR (including 9th this year) despite the fact that the defensive metrics unfairly punish them for that huge outfield.
Arenado is an absolute wizard at 3rd. LeMahieu, Parra, and CarGo each have 2 gold gloves (even if Parra’s and CarGo’s were a while ago). Story is really solid too. Blackmon is probably a better fit in a corner than in center and Desmond is bad at 1B, but I think their overall true defensive value is likely somewhere between above average and excellent depending on the exact lineup.
Thanks for the article, Alex. Gray has burned me in more than one league this year and I’m always curious to read someone’s thoughts on why.
Given the huge disparity in fielding-independent numbers with the bases empty (31% K-BB%, 1.93 FIP) and with runners on (10% K-BB%, 4.69 FIP) is there something he’s doing differently that goes beyond luck – perhaps sequencing pitches, or even mechanically?
Statcast pegs his average fastball velocity at 94.6 mph with bases empty but 95.6 with runners on. Is there any merit to the decidedly un-scientific hypothesis that Gray might just be overthrowing after allowing hitters to reach base? It might explain the higher BB rate with runners on (4.8% vs. 9.9%) and what clearly looks like substandard fastball command:
Bases empty fastball heatmap: https://imgur.com/BEBcbor
Runners on fastball heatmap: https://imgur.com/xE5MhSW
There might be merit to Gray being worse than the league (the league is always worse with runners on) in this regard. As I mentioned briefly above, Robbie Ray struggled with this in 2016, but those struggles evaporated in 2017. It seems to me a similar scenario for Gray: the woes with runners on has only been a significant issue this year (Gray’s yearly splits with runners on), which suggests to me it’s just bad luck in sequencing more than anything else. There might be something mechanical or mental to why it’s so bad this year, but I don’t think he’s broken, at least not permanently. But if he can’t get himself right, maybe he stays broken for the remainder of 2018. Your guess is as good as mine at this point. I find myself increasingly resigned to attribute statistical oddities to random variance. (shrug)
Gerrit Cole is a pretty tempting comparison to make for Jon Gray – a flame throwing former #1 overall pick who flashed excellence, but never quite reached his potential in Pittsburgh, frequently underperforming his peripherals.
Cole’s success in 2018 may be in part to park factors, but it appears to have much more to do with coaching and approach. In other words, Gray may not be quite the victim of Coors he’s made out to be, but moving to another team still might be the key to his future success.
I agree. Getting out of Coors will help, and throwing fewer fastballs will help. The wRC+ marks at the bottom (“Total”) of this table tell you pretty much everything you need to know.
Maybe they are sending him down to work on a new pitch? Perhaps he can develop a cutter or sinker down there and start throwing one of those as his primary. It would be a lot harder for hitters to just sit on his BP fastball, which he has always thrown more than half of the time.
Yes! Although ironically sinkers are typically even worse BABIP pitches than four-seamers. But it really can’t get any worse, so it’s worth a try. I don’t know what prerequisites are necessary to throw a splitter but that gets my vote.
Or, if none of those options, then at least throw more breaking stuff, because it’s way, way better than his fastball. Even if he went to just 40% fastballs, it could make a huge difference.
If the road ERA is poor and he can’t simply blame coors, then yeah I’d say a new pitch seems like a good plan. Whether he can figure something out mid-season is another question. But just ask someone like Trevor Bauer what a new pitch can do for your career. ERA halved. It helps to have a new plane to work with!
Is there a way to see how his fastball performs out of the stretch vs. from the wind up?
Not that it’s a great pitch to begin with, but one thing I noticed watching his last start is that he seemed to lose all fastball command when pitching from the stretch. Didn’t seem to impact his other pitches as much. This is just anecdotal and I don’t know if the stats fully back it up, but that would explain the poor performance from his fastball and poor performance with runners on. Optimistically, maybe it’s something they think they can fix in the minors with a mechanical tweak.
When Gray got demoted I was curious what the worst BABIP of any qualifying pitcher in the last 20 years was and it was .355, Kevin Millwood, in 2008. Only 5 qualifying pitchers have had a BABIP over .350 in a season in that time. Jon Gray’s current BABIP is .386.
That is borderline impossible to believe. There is bad luck and then there is THAT. The Rockies defense is pretty good, no matter what metrics say, and there is no doubt that Gray hasn’t been sharp but man that is historically bad luck. Gray’s LOB% is the 20th worst over those same 20 years, but all 19 players with a worse LOB% were guys with K/9s in the 5-7 per 9 range while Gray sits there with an 11.64 K/9.
Looking at Jon Gray’s Fangraphs page for this season is like trying to add 2+2 and ending up with a potato. He exists in some weird fifth dimension now.
His season looks a lot like 2016 Robbie Ray, who also suffered historically bad BABIP and LOB% rates while having dominant peripherals. It ended up being a lost season, but 2017 was incredible. I don’t think Gray has the same ceiling, but I think the same sentiment applies.
I noticed that same Robbie Ray season as well when I was sorting through the “leader”boards and thought the same thing. High K, high BABIP, disastrously low LOB% and an ERA miles above the FIP/xFIP.
Interestingly, Ray is fighting it a bit this year too with similar BABIP and ERA from that 2016 season, but even more Ks (and walks). They’re both 26 and as talented as it gets so as long as they’re healthy, I wouldn’t have any any real worries about either, but it is a roller coaster.
I’m going to be curious to see if Gray comes back with a different pitch distribution. Early on in his MLB career he was throwing a decent changeup, although it never graded out very highly in the minors. I wonder if the lack of change, even as a show-me pitch, is making his FB play down even more than it does already. I seem to remember him talking about a new changeup grip this spring but he’s either not using it or it is classifying as something else some of the time.
His first AAA start he had a no hitter into the 6th before it unraveled a bit, still finished with 6 IP 2 H 2 ER 0 BB 6 K. A few more of those and he’ll be back in no time.