Woman can only give birth every year.
A single man on the other hand might impregnate women each and every week, from maturity till his heart stops beating.

So woman held considerable power in any society and it would only be natural for men to seize the means of reproduction.

I think that’s what happened, historically speaking.