Jellal's sticking around to fix up this Zeref mess. If someone's getting in his way, he needs to deal with her. It's not like his only concern is high-tailing out of there and never to be seen again.

It doesn't seem like many other people can help him out. His guild (or maybe even just him) is the only one to notice Zeref's magic.