I do the same thing. If I get mad, excited or even depressed, I notice the physical symptoms of a panic attack (especially heart beating harder or faster) and it throws me into a panic. I think it's because your adrenaline responds to emotions and when your adrenaline gets going, you get the same physical sensations you would during panic. So, your mind thinks you're panicking and off you go.
