I swear by Yahweh
"I swear, as surely as Yahweh is alive"
if you do not go, not one man will remain with you
"only if you go will any of your men remain with you" or "if you do not go, all of your men will leave you"
not one man will remain with you
"not one man will remain loyal to you"