"I had lunch in one of the executive boxes," said the 30-year-old. "I wasn't enjoying it to be honest. We were playing a Test on my home ground and I wasn't involved.
"Probably for the first time there was a bit of jealousy because I desperately wanted to be out there and playing.
"I went into the dressing room but you are always wary of over-staying. They've got a job to do and they don't want people hanging around. I had five or 10 minutes in there and then popped out.
"It has been a struggle this past week so I haven't seen a great deal of the Test but I've got a lot on at home and I'm also trying to get fit."
Flintoff's wife Rachael gave birth to the couple's third child, Rocky, six weeks ago so he has at least been able to spend more time with his young family. But there is no doubt he desperately hoped to play in both the Lord's and Old Trafford games against New Zealand - and that he would have been selected despite a lack of success with the bat which included three ducks.
So everything had been rosy? "Yeah, I was batting great!" joked Flintoff, showing he has not lost his sense of humour while speaking at the launch of Lancashire's Twenty20 Cup campaign
"No, it was. I was bowling probably as well as I have done. I think I had maybe put on a yard of pace and from a fitness point of view (with the ankle) it was great. But chatting to 'Rooster' (physio Dave Roberts) about it, having had such a lay-off from bowling, I would have been lucky to get away with nothing happening.
"It's unfortunate this has happened but it could have been a lot worse. And the ankle is fine. I've just got a dodgy side for a bit."
Flintoff says he has not been given a date when he should be fit to play again but adds "these things have a history of taking six weeks."
That recovery programme would take Flintoff to halfway through the one-day series against New Zealand and, given that he will need some match practice, the summer's second Test series, against South Africa, seems the likeliest target.
