Beltran's fourth-inning homer was his third in the six-game homestand.
"I'm not really trying to hit homers," Beltran said. "It's one of those streaks as a hitter where every ball you hit is in the air and has a chance of being a homer."
Phillips tied the game with an RBI double in the sixth.
Allen Craig walked with one out in the bottom half, Yadier Molina singled him to second, and Carpenter's broken-bat single drove in the go-ahead run, Pete Kozma and Daniel Descalso chased Bailey with consecutive run-scoring singles.
"In that sixth inning I don't think they hit any ball solid," Bailey said. "Right now, things are just not going our way."
NOTES: Beltran threw out Bailey at second in the fifth inning when the pitcher tried to stretch a single to right. ... Lynn struck out Shin soo-Choo three times. ... The Reds have won three of their last 29 series in St. Louis. ... Carpenter had two doubles in a game for the third time this season. ... Cincinnati is off Thursday after playing 20 days in a row. and starts a three-game series at Chicago on Friday. Mike Leake (1-1, 4.34) will face the Cubs' Carlos Villanueva (1-1, 2.29) in the opener. St. Louis will play four games at Milwaukee starting Thursday, when Jake Westbrook (1-1, 0.98) and Wily Peralta (2-1, 5.02) start. ... The Cardinals' seven-game errorless streak ended when Descalso allowed
Jay Bruce's ninth-inning grounder to bounce under his glove.