Here at our house, we call those moments "going into overpat".

There are certain areas of a cat's body that tend to be more sensitive than others. Patting or scratching their stomachs can sometimes over stimulate them and provoke a seemingly random attack. You have to pay close attention to the position of his ears also.

Note in the first frame of your shoe attack video, his ears are in a semi sideways position. If this happens when you are patting him - stop. If you are unable to safely free your hand or arm, give him a substitute item to attack. Pick something he normally likes to wrestle with. A favorite toy, or even your shoe. this will distract him from your hand or arm, and get him focussed on something that is okay. Praise him when he goes for the alternate item.

I have found that naming the toy helps to get our cat focussed on it, she now recognizes when I say "Where's Mousey?" and goes for it.