"reject them from being my people." This may imply that he would destroy them, and some versions translate it that way.
Here "your" is singular and refers to Moses.