It's usually the Marines' that use it. The only exceptions I can remember are Crocodile's holding cell (of which perhaps he got the kairoseki from the marines) and back in the Skypeia arc when *whats his name with wings* uses it on Enel.