I just think there are seven sword types, and the 7 who can wield them like a master become part of the 7 swordmen, otherwise they would've died out after one generation.