The man was unclean because of his contact with the scapegoat, which carried the sin of the people.
"the goat that is sent away."