The bottom-of-the-table Shakers had not scored for more than 13 hours in League One and were facing an eighth-straight league defeat as Oxford led 1-0 with nine minutes to go.
But substitutes George Miller and Harry Bunn struck after 81 and 84 minutes respectively to give Bury their first away victory since February 2017 – when Lowe himself was the match winner.
He admitted after the turnaround at the Kassam Stadium: “I feel drained. But we expected to win because of the mentality that’s been drained into the lads.
“From today we had 19 games to do something and that meant winning games and believing we were going to win games.
“It’s a great feeling but we have to be realistic about the situation we’re in.
” Bury had been the more threatening team yet fell behind to James Henry’s 45th-minute goal. Lowe said:
“It was a sucker punch when we went behind but we kept believing. “We didn’t change what we were going to say to the players at half-time.
“We stressed we must believe we can go on and win, and we did believe that. And we were solid from back to front. The shape was outstanding.
“It was a great all-round team performance. I’ve got a tight group, showing great togetherness.”
Bury might also have had a spot-kick when Dwight Tiendalli appeared to foul Zeli Ismail in the box.
“It was a stonewall penalty,” said Lowe. “But I don’t want to look at the negatives because we still went on and won.
“We need to keep working hard now and not take our foot off the gas.”
Oxford manager Pep Clotet, whose side remain 10th as a result, said: “We had to win that game. We had control of it but we have to concentrate for 90 minutes and not go to sleep for five.
“Our defensive work lately has been good until the throw for their first goal when they missed James Hanson and we weren’t ready to prevent the ball being put away from just a few yards.
“Then we lost our organisation as we tried to go and win the game and we had no cover for a long ball. No-one dropped off. It’s not acceptable.
“Bury clearly came to not get beaten and they gave us no space but we scored a good goal and were in control.
“A win today would have put us in a good position in the league. Now it feels like it’s back to square one.”
On-loan Manchester City teenager Isaac Buckley-Ricketts played a part in Oxford’s goal on his debut, and Clotet said: “He showed his ability.
Cardiff remain unhappy with Derby's decision to postpone Sunday's Sky Bet Championship game at Pride Park.
Dundee United boss Csaba Laszlo has been left hoping for St Mirren to slip up in the race to seal promotion to the Ladbrokes Premiership.
Crewe will consider starting Chris Dagnall when they host Forest Green on Tuesday.