Oldham Athletic lost out narrowly at the Lamex Stadium after a late goal from substitute Danny Newton secured the three points for the home side.
Latics did twice have the lead through Ishmael Miller and Callum Lang, but they were pegged back by Joel Byrom and Kurtis Guthrie.
Latics came out of the blocks well as Miller drove forward and saw a shot deflect inches wide.
Moments later Gevaro Nepomuceno crossed for Jonathan Benteke, who put a glorious chance wide as it didn’t quite connect with the correct part of his foot.
Oldham did have their deserved lead as Nepomuceno took a corner and the ball eventually fell to Miller who shot on the turn low past Seny Dieng in the Stevenage goal.
The whole team ran over to celebrated with Manager Frankie Bunn in a big group huddle as Latics got what they deserved for their early dominance.
Stevenage got themselves a foothold in the game and Daniel Iversen had to be at his very best to deny an Alex Revell header after John Hunt crossed from the left.
Revell volleyed another chance wide before the hosts equalised through Byrom.
Jamal Campbell-Ryce crossed from the right and Iversen punched it away well, but the ball fell to Byrom waiting on the edge of the box and his shot went in via a deflection.
The game an even affair after the Stevenage equaliser, but Latics had a great chance to go in at half-time with a lead.
Dan Gardner floated in a freekick towards Captain Peter Clarke who headed just wide of the goal.
Miller had a chance at the start of the second half as Lang crossed into the striker, but he headed wide when alone in the box.
Miller then tried to chip Dieng from the halfway line and nearly did so as the ball just floated over the bar.
Latics did regain the lead shortly after as Nepomuceno fizzed in a great cross for Lang to bundle home and it was nothing more than the away side deserved.
However, Stevenage equalised moments later in a fortunate fashion as Newton cut inside and his deflected shot landed right on the head of Curtis to score.
Steve Seddon then got in down the left-hand side and crossed into Newton who headed past Iversen to give the home side the lead.
Latics tried to get themselves back into the game, but it wasn’t to be for Bunn’s men as they must go again on Tuesday night away at Notts County.
Attendance TBC (TBC Away)
Stevenage
Dieng, Wildin, Hunt (Newton 59’), Timlin, Cuthbert, Byrom, Revell ©, Seddon, Campbell-Ryce (Kennedy 56’), Guthrie, Nugent (Wilkinson 46’)
Oldham Athletic
Iversen, Hamer (Dummingan 90’), Clarke ©, Edmundson, Hunt, Lang, Gardner (Lyden 74’), Missilou, Nepomuceno, Miller, Benteke (Baxter 88’)