Money is not interchangeable with free speech. That's a myth promoted by the moneyholders. Free speech law in the US protects content, not form.

If government can prevent people from rallying near a party convention, government can prevent people from bribing candidates for office.