Mr Gibb was responding to Labour's Rupa Huq (Ealing Central and Acton), who said the original decision sent a "toxic" message at a time when the movement still had great importance, considering the wide gender imbalance in politics.
Ms Huq pointed out that only 29.4 per cent of MPs were female and school groups she took on tours in Parliament always asked about the lack of women.
Opening the debate, she said: "This proposed syllabus implies that women do not belong in politics and that their contributions are not significant.
"It's a toxic message and it's been condemned roundly by loads of people, including the Girl Guides - you wouldn't think that they are a radical dangerous group usually.
"This mooted rewriting of history is nothing short of sinister, it's deleting women."