"It is definitely tough to change captains between back-to-back Tests," added Smith - man of the match at Edgbaston after scoring 277 and 85.
England, though, may yet draw strength from events that stunned them in Birmingham, with the bowlers desperate to atone for their insipid first-day performance.
As for Hussain, team-mates and a vast majority of the spectators will be willing him to contribute heavily with the bat.
"I hope Nasser goes out there at Lord's and scores a lot of runs," added Graveney.
Meanwhile, all-rounder Jacques Kallis is out of the Second Test after deciding to stay in South Africa to spend time with his family following his father's funeral.
Kallis may return for the Third Test, which starts on 14 August.