Soho rector is removed from his post