Answer a fool and join in on his folly

"Answer a fool according to his folly" or "Answer a fool foolishly"

so he will not become wise in his own eyes

"so that he will not become wise according to his judgement" or "so that he does not consider himself to be wise"