I've been in a discussion about this once before. I'm almost positive the explanation was partly because its cheaper to animate a character running with their arms static than moving side to side. The style sorta stuck, so even higher budget animation will often have this effect.

Even sonic the hedgehog does this, so its not just a ninja thing.