Because you don't have the right to be a walking injunction imposing your personal quirks on everyone in line of sight. You want to change everyone's behavior to suit yourself.

'Not being able to do stuff' is more important than 'not being able to force everyone in the world to obey arbitrary rules I set for them'. This doesn't really seem like a very hard concept to grasp.