In theory I could go on a major Nazi rant and by your logic nothing could be done about it in the name of free speech, which obviously isn't the case.

The way you're treated and regarded by others has alot to do with the amount of respect you've earned (or lost) and this place is no different