"The right to speak means a duty to listen."

Nope. It just means you have the same rights to speak that anyone else has. If a school group offers you a right to speak, no one is obliged to attend.

Free speech for me but not for thee is not free speech. Every dictator believes in that.