Here "he" refers to Eleazar the priest.
Being unacceptable to God or unfit to do any sacred work is spoken of as not being clean.