AL West-leading Texas is 13-2 against the Astros this season and 37-19 against the division.
Holland (7-6) pitched six innings, allowing two runs, six hits and three walks.
Evan Gattis had three hits for Houston, including a solo homer.
Joe Musgrove (2-3) allowed five runs and eight hits over 4 1/3 innings.
Ian Desmond stole home as part of a double steal in the seventh inning.
Beltre and Robinson Chirinos each had three hits. Mazara, Desmond, Mitch Moreland, Carlos Beltran and Rougned Odor each drove in two runs.
Mazara hit his two-run homer in the fifth, when the Rangers chased Musgrove.
Right-hander Brady Rodgers made his big league debut for Houston in the eighth and allowed five runs while getting two outs.
Houston led early after Teoscar Hernandez drove in a run with the last of three singles in the second inning.
Half an inning later, Beltre hit his 26th homer into the visitors' bullpen in left-center field, and then Texas went ahead 3-1 on Moreland's two-out, two-run double in the fourth.
Holland had two strikeouts, both by Jason Castro. The first ended the second inning with two runners on base.
Holland has won his last two starts and is 5-1 at home this season. He is 5-2 with a 2.52 ERA in 10 starts with five or more days of rest.
Houston's Jake Marisnick hit a two-run homer against Dario Alvarez in the ninth.
FANCY FIRST
Gold medal-winning Olympic gymnast Madison Kocian threw out the first pitch before the game. She slowly brought herself into a handstand before picking up the ball and delivering a perfect strike .
TRAINER'S ROOM
Astros: 1B Marwin Gonzalez remained out. He hasn't played since experiencing discomfort in his right hamstring on Wednesday. "I'll use him if I need to," manager A.J. Hinch said, "but I'm going to try to stay away from him as long as possible until he feels better."
Rangers: C Jonathan Lucroy was scratched from the starting lineup because of flu-like symptoms. Manager Jeff Banister said Lucroy could play Sunday.
UP NEXT
Astros: RHP Collin McHugh (9-10, 4.80) is scheduled to start the series finale on Sunday. He's 4-1 in his career against Texas. The loss came on June 9, when the Rangers knocked McHugh out in the fourth inning.
Rangers: RHP Yu Darvish (5-3. 3.01) will start on Sunday. He's 3-0 in his last five starts, all Texas victories.
