If you're the one making the complaint and are offended, then you owe it to the person to explain to them why you're offended. The person causing offense isn't a mind-reader. It's somewhat ironic that you're going to consider something a big deal but not put the effort into explaining why.
I also think it's a true statement, that the only way society moves forward is if people have room to say wrong things and are corrected before they say the right things. If you're exhausted if dealing with it, that's fine, take your personal space and remove yourself from the situation, but if you have enough energy to passive-aggressively explain your marginalization (which I think could be debated within certain contexts considering how so much safe space is dedicated to you across the internet and at university campuses and teachers in nearly every school district can be fired for saying anything that could be construed as homophobic) in this space, you probably have enough energy to have a civilized conversation with these people you hate.