Olympic chiefs get a warning