That's the idea, but you blurred his hands a bit too much...let me make you an example.

Edit: forget the example, taking too long :-)

What I mean was, take a really small blur brush, like maybe 2 pixels, zoom in to like 300-400 times and just touch the edged of his hands and hair, the very very outlines, and those jagged edges will soften, without actually blurring the interior of the image.