Valley produced another late show to progress in the Emirates FA Cup thanks to David Kolodynski's stoppage time winner at Malvern Town.
After another extremely close encounter Rugby scored a goal deep into added time for a second time in three days to break Malvern hearts and set up a Preliminary Round tie against Newcastle Town at Butlin Road.
Town boss Carl Adams made two changes to the team that had started the original tie, with Luke English and Karabo Motshweni in for Liam Francis and Barry Fitzharris.
Rugby made a decidedly shaky start to the replay, and the home side dominated the opening exchanges.
Jordan Annear blasted over a good chance, before Town finally showed signs of making a contest of it, with Loyiso Recci seeing his header to English's long throw cleared away from the line and then Tom Fielding shot into the side netting after some defensive uncertainty from the hosts.
Malvern continued to pile pressure on Town keeper Matt Hill from a series of inswinging corners, but generally there was a lack of goal threat at either end of note.
Roger Lee did skim one wide from fully 25 yards though after neat build up play from Motshweni and Fielding, with Fielding himself also missing the target after Drew Kear had picked him out in the penalty area.
Fielding snatched another one wide as Rugby finally settled into the game, and their breakthrough came on 38 minutes from the penalty spot, with Jordan Wilson confidently stroking home after David Kolodynski was brought down by Malvern keeper Kieron Blackburn following Motshweni's ball over the top.
However the lead was short lived, when Matt Turner matched Wilson's achievements from the spot after Josh Thomas was penalised for a foul in the box.
Both teams went close before the interval, with Turner fiercely firing one over from the edge of the area after they had broken forward rapidly, with Valley then getting in behind the hosts after good interchange play between Fielding, Motshweni and Wilson ended with Kolodynski's shot at the back post being blocked.
The second half started quietly, with the only significant opening of its early exchanges seeing Levi Francis's effort deflected away for a corner.
Another well-worked move involving a number of Rugby players saw Blackburn block Kolodynski's strike with his foot, with the visitors just unable to capitalise on the resulting loose ball.
Wilson squandered a great chance for Town, after he had ran on to Kolodynski's through ball to shrug off his marker only to shoot straight at Blackburn.
Alex Bell's free-kick flew over the crossbar and then Harry Clark missed out when Hill tipped away his rising strike after another quick Malvern counter.
Kolodynski's left-footer was blocked and sub Ryan Sahota blazed one over after he was introduced for his competitive debut.
With the game looking likely to go into extra time (and possibly beyond), there was late drama in the tie again and it was Rugby celebrating from it once more when the hosts failed to deal properly with a Luke English long throw and from the ensuing mayhem it was Kolodynski that was on hand to steer the ball home for the winner.
Valley
Line-up: Hill; Rosser, Recci, Thomas; English, Kear (Summerfield), Lee (Fitzharris), Motshweni, Fielding (Sahota); Kolodynski, Wilson. Subs not used: Lock, Ahenkorah, Taylor, Francis. Bookings: Wilson, Sahota, Kolodynski.