do not abandon him
"make sure to take care of him"
for he has no portion nor inheritance with you
The tribe of Levi did not receive a portion of land as their inheritance. Their share of the inheritance was the honor of serving Yahweh as his priests.