Leader's pension gaffe damages 'man of the people' speech