# They must join you

"They" refers to members of the tribe of Levi; the word "you" is singular and refers to Aaron. 

# perform the duties

"do all the work"

# not come near you

Here "you" is plural and refers to both Aaron and the rest of the Levites.