Well, the thing about Senku is, even if it's not gunpowder, it could be something else. They're being overly cautious because who knows what crazy shit he's built in the few days they've been gone! Maybe he, ya know, invented umbrellas to keep his guns dry!

That or, ya know, so the plot can happen.