It another setback for Calzaghe, who had hoped to make 2005 the defining year of his career.
The Welshman, who is undergoing a messy divorce, pulled out of a title defence last month citing the need for more time to prepare.
He was floored in the fourth round of his last contest against Egyptian Kabary Salem in Glasgow in October.
Veit has won 15 fights since Calzaghe knocked out him out in the first round when they met in Cardiff in April 2001.
Magee's trainer, Pat Magee, said his fighter was "devastated" by the news.
He said: "As far as I know, the Germans have objected to Joe putting his title on the line. It is a nightmare for everybody concerned and I have to protect Brian's position because this is no fault of ours."
