Who were the only people allowed to vote in most of the colonies?