One large limit placed on a person exercising a right is that

They cannot cause harm to others or take away rights of others