How does anyone lose the right to speak if everyone has the right to refute and mock, as free speech allows?

Yelling "fire" when a building is not on fire is a lie, which means it's not about speaking your truth.