Yeah except that in most cases I've seen, it's less someone walking into your house and punching you in the face and more someone accidentally elbowing you in the side on the bus. In the first case you'd be well within your rights to be pissed off, no one is going to argue that.

But if you flip your shit in the second case, the only one being an asshole is you.