Steve Howards late penalty winner in the League Cup second round was the perfect remedy for Paolo Sousa's men after a poor start to their Championship campaign.
The City boss made five changes to the side that crashed to a 3-0 loss at Turf Moor on Saturday.
And the Foxes faithful could have been forgiven for thinking they were witnessing another disaster when Leeds took the lead on 32 minutes when former City star Max Gradel picked out Davide Somma who glanced his header past Conrad Logan.
There were signs that Leicester's fortunes were turning however when Leeds almost doubled their lead just after after half time - but Argentinian striker Luciano Becchio saw his effort cleared off the line just minutes before the Foxes levelled.
And, unlike Saturday's poor showing, the Foxes flew out of the blocks in the second half and Richie Wellens was able to round off a superb City move involving new signing Franck Moussa to level matters after an hour.
Steve Howard rounded off a fine Foxes fightback when the away side were awarded an 89th minute penalty when Collin's wrecklessly handled inside the box and 34-year-old veteran Howard didn't disappoint, converting his penalty and sending the Foxes faithful into the Carling Cup Third Round.