What armor do you usually wear?
You should totally wear that charm if you block or parry. It is one of the best available.
Stagger charm is only meaningful if you wear Gosaku's armor. That combination will allow you to stagger everything in one or two strikes.