"my fellow believers"
"God will judge us who teach more severely."
Here James includes himself and other teachers, but not the readers.