Brown didn't give bank enough power, says minister