The enemy is totally the guys from Minami trying to take over Akiba. They're not adventurers, but People. If they're People, then they were somehow convinced to fight for the the Minami Adventurers. What doesn't make sense is why they're intentionally stirring up trouble if their main goal is infiltration.

The plethora of Akatsuki bits over the past few weeks kept it going.