it is a very small thing that I should be judged by you

Paul is comparing the difference between human judgment and God's judgment. Man's judgment is not important compared to God's true judgment upon man.