Valley were left to regret a late penalty miss with Quorn converting one of their own minutes later to take all three points after a close encounter at Farley Way.
In a game that had plenty of goalmouth action, the game eventually boiled down to two penalties with Rugby's Jordan Wilson missing from the spot only to see opposing captain Ryan Beswick score his.
Ryan Sahota started his first leaguegame for the club as one of three changes to the line-up that had won their opening league fixture of the season at home to Sutton Coldfield three days earlier, and the young midfielder impressed again - scoring Town's equalising goal almost immediately after the hosts had taken a 71st minute lead.
Luke English and Barry Fiztharris were also back into the side for a fixture that was frantic from the off, with both teams often looking for a direct approach on the pristine artificial playing surface.
Tyrell Shannon-Lewis got in behind for the home side early on, and his resulting strike drew a good save from Matt Hill.
Rugby really should have taken the lead shortly after though, when David Kolodynski read the flight of Hill's long punt to lay the ball onto Jordan Wilson, but with the home keeper stranded, he topped his shot and it was blocked on the line by a defender.
A further chance for Wilson saw his header cleared away from the goalmouth, and as the end-to-end start to the game continued, Jack Samples slashed one wide and Paddy Webb's shot straight at Hill.
At the other end, Kolodynski chipped harmlessly into Charlie Woods's hands, whilst back-to-back chances for Quorn's Webb went begging.
Beswick then swung in a dangerous corner that somehow everyone from both sides failed to get a touch on, and with the hosts in ascendance leading into the interval, Webb had consecutive efforts blocked away by Dan Summerfield and English, with Samples also guiding one across the face of the goal and an on-target Courey Graham header flicked away to safety by the head of Sahota.
Quorn had the first real chance of the second period too, when Webb thundered one back off the post after Cain Noble had played him in as part of a well-worked move.
Sahota went close for Town too though on a couple of occasions, when his header at close quarters to Wilson's flick-on flew agonisingly over the frame, and then he shot into the side netting from distance after a neat turn on the ball had given him the opportunity.
The deadlock was broken however when Thabang Dube's ball over the top found Noble in space and he ran on to smash home past Hill.
Valley's response came within a minute though, when Wilson helped on Recci's long throw down the wing and Drew Kear showed good pace to reach the ball before sending in a perfect cross for Sahota to open his Town account with a cleverly executed flicked finish despite the attentions of two Quorn defenders.
Recci's surge into the box shortly after the equaliser saw his shot blocked, before Rugby were handed the opportunity to go ahead when Sahota took advantage of defensive uncertainty between Charlie Marzano and his keeper to nip past the latter, with Woods clipping his heels and gain a penalty in the process.
Wilson's spot kick smacked into the hoardings wide of the goal though, and the travelling Valley faithful's disappointment was soon compounded when Summerfield was adjudged to have handled a deep cross into the Town box, with home skipper Beswick making no mistake with his low strike from twelve yards.
Rugby made a decent attempt at getting back into the game again though, with Wilson heading one wide and then the same player had a rising effort tipped over by Woods, although Dube did also strike the base of Hill's post.
Late pressure from the visitors saw them win a number of corners and free-kicks, but aside from Kear lifting one way over the target, they did not test Woods further and the defeat was sealed.
Valley
Line-up: Hill; Rosser, Recci, Thomas; English (Kear), Summerfield, Lee, Fitzharris (Francis), Sahota; Kolodynski (Motshweni), Wilson. Subs not used: Lock, Taylor. Bookings: Summerfield, Rosser, Fitzharris, Wilson.
