Don't flirt with UKIP, Patten tells Tories