"But when he faced Republic of Ireland international Matt Holland against Ipswich, who have just come down from the top flight, he certainly did not look out of place.
I think that he realises that the offthe-field stuff will sort itself out and he just has to get on with playing.
"If he is performing as well as he can it is to everybody's benefit.
"He is not saying that he wants to leave but I have told him that if another club comes in for him with an offer that is right for us we would not stand in his way."
Millwall are prepared to sell Cahill to raise much-needed transfer funds but are unlikely to accept an offer below £4.5 million.
Villa have made enquiries about him but have not made a bid even though Taylor wants another central midfielder and an attempt to buy Holland from Ipswich is looking doomed.
Cahill said: "It is good the speculation seems to be over because it has been difficult. Now I can just get on with my football."
Millwall have no new injury problems going into tonight's game, but will be without midfielder David Livermore through suspension.