Nigel Adkins admitted Southampton got lucky with the penalty decision which settled their game at Aston Villa.
Mark Halsey awarded a spot-kick for an Enda Stevens challenge on Jay Rodriguez, but replays showed the striker was quick to go to ground under little or no contact from the Villa defender.
Rickie Lambert ignored the home protests to bury what turned out to be the winner, and Adkins was in no mood to apologise afterwards.
He told Sky Sports: "It's a big talking point. For me the big decision is the one on Jay Rodriguez, I think that's what he's given it for.
"There's no contact, for me, Jay has moved his leg out of the way - and it's just as well as there would have been contact.
"We don't advocate diving whatsoever - we've got to make sure everyone is well aware of that - but they say it evens itself out and we could have had seven or eight penalties this season. We've got one here and Rickie Lambert's put it in the back of the net."
Victory took Saints above Villa in the table on the back of a four-match unbeaten run in the league.
Adkins said: "It's a good three points away from home against a team close to us in the division. It's a clean sheet, too, which is important.
"We could have had the game out of sight in the first half. In the second half - credit to Villa - they came at us and we've had to show a lot of character to weather the storm."
Aldershot boosted their League Two survival hopes with the victory.
After a league win against fellow strugglers Barnet and an FA Cup win over Rotherham in their last two encounters, a goal in either half was enough to see off Accrington.
Brown tapped in at the far post from Kieron Cadogan's pin-point delivery to open the scoring and grab his second of the season.
Cadogan initially had a corner headed clear by Accrington defender Laurence Wilson, but reclaimed the ball just outside the area and his superb cross was easily converted by Brown.
Peter Vincenti almost doubled Aldershot's lead with a header from Anthony Tonkin's cross 15 minutes later and Ben Herd's strike from outside the area forced a fine save immediately after.
The Shots continued to press forward after the break as Lopez scuffed an effort wide before Sonny Bradley had a header cleared off the goalline.
But the home side got the second goal their pressure deserved nine minutes from time when Lopez headed in Cadogan's cross from inside the six-yard box.
Madden had a great chance to score early on when Harry's Maguire's weak header back left goalkeeper George Long exposed but he fired wide of the target.
Madden put another effort off-target and Long was forced to turn a James Hayter shot over the bar.
United's best effort before the break came from Tony McMahon who sent a free-kick wide.
Madden opened the scoring in the 49th minute, creating space for himself inside the area before firing low past Long after receiving the ball from Byron Webster.
After McMahon put a long-range shot just over, Madden increased Yeovil's lead midway through the half following an error from Long.
The keeper hesitated on the ball and he was caught in possession by the alert Madden who was left with the simple task of walking the ball into the net.
Nick Blackman had a shot saved by Marek Stech as the hosts tried to pull a goal back but United have now suffered back-to-back home defeats.
