Wearing rough, cheap clothing was a symbol of mourning over sin.
"I became a joke to them" or "they made fun of me"