I think the distinction matters.
A man who has nothing right now can't hurt you without immoral actions. He has nothing to offer but the absence of his violence.
After he has rebuilt his life, he can do no wrong and hurt you. He has value now that he adds to the people around him. That gives him the option to hurt you by simply taking his ball and going home. He takes his value away and focuses it on those who he feels deserve it. He can even choose to keep it entirely to himself.
If you have become dependent on that value, that is a risk for you. Since he is willing to go back to nothing if you aren't the risk is asymmetric.