After Brad Boxberger struck out the side in the eighth, Jake McGee got the final three outs for his 12th save in 13 chances.
Lohse benefited from a key defensive play in the fifth when Reynolds, the first baseman, ran down Logan Forsythe's bloop hit that went into foul territory. Reynolds threw the ball to shortstop Jean Segura, who then made a relay throw to get Forsythe at third.
Lohse was coming off a pair of victories in which he had allowed two runs in 13 2/3 innings. The right-hander dropped to 5-4 in 12 games against the Rays.
"It was frustrating," Lohse said of the sixth inning that included two walks. "I thought I made some good pitches. It was a tough one. Leave it at that."
Tampa Bay right fielder Kevin Kiermaier made nice catches on balls by Khris Davis and Reynolds during the fifth. Ben Zobrist went 1 for 3 with a sixth-inning walk and has reached base in 11 of his last 16 plate appearances.
"The ball K.D. hit, the ball Reynolds hit, at our ballpark and a lot of other ballparks, those are home runs," Brewers manager Ron Roenicke said.
This is just the third series between the teams and the first at Tampa Bay since June 2005. The Rays have won five of seven against the Brewers.
"It was an outstanding night made even better because we did win the game," Maddon said.