Of all of the recent advances in sabermetrics, catcher framing is likely the one with the greatest impact on our view of the game. Already, it has begun to affect our notions of player value, giving us a new respect for defensively minded backstops. But even beyond that, our new knowledge of framing reallocates a huge amount of the value we had implicitly assigned to the pitcher.
Catcher framing, and its effect on the game, are also difficult to measure rigorously. Fortunately, we are lucky enough to have Jonathan Judge, Harry Pavlidis, and Dan Brooks on the case. Their most recent article provided a precise framework for measuring much of the value due to catcher framing.
However, their work has been focused to date on examining the direct impact of the catcher upon the strike calls. Catcher framing quality to date has been measured only in the set of pitches that are not swung upon, whose value is determined by the umpire's call. But there is another player present in the matchup in the person of the batter, and catcher framing also might impact the batter's actions.
The batter suffers when there's a good framer behind the plate, and prospers when there's a poor one. A good framer expands the zone, making marginal pitches more likely to become strikes. Yet the batter is not a wholly passive observer in this process. If the batter behaves optimally, he must adjust his strategy to compensate for the framer's quality, changing the pitches that ought to be swung upon.
For example, let's imagine two batter/pitcher/framer trios in the same situation. In one, there's a good framer behind the plate; let's call him Jonathan Lucroy. In another, there's a terrible framer, say, Josmil Pinto. The count is 2-2, and the pitcher laces a fastball that will land on the black, right at the edge of the rulebook strike zone.
As always, the batter is faced with that pivotal question of whether to swing. Given the location and the count, there is a decent probability of a strikeout if he leaves the bat atop his shoulder. On the other hand, a swing risks making poor contact.
The decision is further complicated by the framers. Lucroy dramatically increases the probability of a strike call, thus enhancing the downside of taking the pitch (increasing the probability of the strikeout). Conversely, Pinto decreases the same probability, making it more feasible to be patient. The batter, if he is taking framing into account, ought to be more likely to swing when Lucroy crouches behind him than when Pinto holds the mitt.
To be clear, the above situation only holds if the batter is 1) aware of the quality of the framer and 2) adjusts his behavior accordingly. So that's the first question I'll ask: Do batters adjust their swinging in accordance with the true called strike probability, as affected by the catcher's framing skill?
Here's how we can get to the answer. I built two models of called strike probability. In the first model, I considered only the raw coordinates of the pitch, horizontal and vertical, as well as the count. In the second model, I considered the above variables, as well as the identity of the catcher. The latter model, we know from extensive prior research, is more accurate because it incorporates the effect of the catcher.
For each model, I predicted the called strike probability for all of the pitches thrown in 2014. Then, I ran a logistic regression to predict whether a hitter would swing or not, based on the called strike probability, as reckoned by the two models, and the count.
You might have guessed at this already, but hitters, it turns out, are attuned to the skill of the catcher behind the plate. The second model, incorporating the effect of framing, fits the data significantly[1] better than the first model. In plain English, what this means is that strike probabilities that incorporate framing better predict the behavior of the batter than those that rely only on the physical coordinates of the ball.
This result therefore implies that hitters are able to take into account the framer behind the plate in making the decision to swing or to hold, which answers the first pair of questions I posed. The batters are indeed aware, and they do seem to change their behavior, modifying the probability with which they swing in accordance with the catcher's reputation. Not that we needed any more evidence in favor of the reality of pitch framing, but I do think that this result is a powerful piece of verification: Batters have every reason to perform optimally, and they have clearly judged that to do so, they must consider the framing skill of the catcher in determining when to swing.
Leaving that aside for now, I want to push this line of inquiry a step further. Going back to the example I posed above, the hitter is more likely to swing with a good framer behind him. The swing itself negates the pitch from being counted as a positive outcome for the catcher, but there's no denying that the catcher influenced the outcome of the at-bat. Specifically, he forced the batter to make a swing he might not otherwise would have, at a pitch that was further from the center of the plate than perhaps the batter would have liked.
That's important because I have shown before that the closer a pitch is to dead center, the better the quality of contact the hitter can make. For every inch one travels horizontally from the center of the zone, BABIP and SLG drop dramatically. So, one way in which catchers might be influencing at-bats is by inducing hitters to swing at pitches away from the center of the zone, thereby reducing the quality of contact that the batters make.
It's one thing to posit that this effect might be present, and another thing to show it. Let's take a look at Jonathan Lucroy, an excellent framer by any standard, and highly rated in particular by BP's new metric CSAA (at 26 Runs/7k chances). For pitches when Lucroy was catching, the opposing batter swung 45.4 percent of the time. On average, those pitches were .53 feet from the center of the strike zone horizontally. The same batters, in the other at-bats they saw, swung at pitches .518 feet from the center of the zone. That's a significant difference[2] (p = .002). Against Lucroy, then, their swings got a little further from the zone's center, consistent with the scenario I outlined above. The batters are forced, by Lucroy's exceptional talents, to try to make quality contact with pitches a little bit further outside than they are normally comfortable with.
Now let's look at the flip side of framing, at those stabbing, noisy receivers who cost their pitchers precious strikes. Recent analysis suggested that Josmil Pinto was an exceptionally poor receiver, so let's look at his pitches. On average, when hitters faced pitchers Pinto was catching, they swung at pitches .51 feet from the center of the zone, near Lucroy's number. When they faced all pitchers, they swung at pitches .516 feet from the center of the zone horizontally. That difference -- -.006 feet -- is the reverse of what I noted for Lucroy. That is, they actually swung at pitches closer to the center of zone against Pinto, relative to other batteries they faced.
I went ahead and did the same calculations for a select few other framers marked by Jonathan, Harry, and Dan as either very good or very bad:
You've been framed
| Name | Framing Value (CSAA) |
Swing Distance With |
Swing Distance Without |
|
Yasmani Grandal |
|
.528 feet |
.519 feet |
|
Buster Posey |
|
.532 feet |
.516 feet |
|
Carlos Santana |
|
.461 feet |
.515 feet |
From these examples, you can see that a good framer increases the horizontal swing distance of the batter. Meanwhile, a poor framer, like Carlos Santana, can even decrease the swing distance quite substantially (granted, Santana caught relatively few pitches last year, so this number should be taken with a grain of salt).
The effect size is usually quite small, I should note: .12 feet is a bit more than an inch[3]. But also bear in mind that, like Lucroy's framing, that modest effect is multiplied over many thousands of swings. Putting numbers to it, batters going against Lucroy and his pitcher swung 8,691 times in 2014. Consequently, one way to think about it is that Lucroy forced his opponents to swing at pitches a grand total of more than 1,000 feet (8,691 swings * .18 feet per swing) further from the center of the strike zone than if a poor framer like Santana or Pinto had been behind the plate instead.
More concretely, Lucroy probably forced the opposing batters to swing at pitches they didn't like just a little bit more, in thousands of separate instances. That has all sorts of negative effects, like increasing swinging strike rate, decreasing BABIP, and preventing hard contact. Fully accounting for all of these effects will wait for a later treatment, because it is by no means a trivial task. We would also need to adjust for all of the batters, pitchers, and parks involved, all of which is perhaps best accomplished within a formal modelling framework.
But what I have established here is that the effect of a good receiver extends beyond the pitches that batters let go by. A good framer, by changing the probability of a strike at the edge, causes the opposing hitter to modify his own behavior, causing him to swing at pitches a little bit further from the center of the zone. In addition to harming the batter's chances directly, by flipping balls to strikes, a good framer changes the dynamics of the at-bat indirectly as well. This effect suggests that the numbers we've generated to date for the value of framing are probably underestimates, which is good news for all the steady receivers of the world.
[1] AIC of the first model: 44819; AIC of the second model: 51459. Relative likelihood of Model 2 = 0.
[2] By permutation test.
[3] Also note that for this initial attempt, I'm only looking at the horizontal distance from the zone center. We would also expect the vertical distance to be affected, so these estimates of swing distance are probably too conservative.
