"we have said bad things about Yahweh and you"
The words "we" and "us" here refer to the people but not to Moses.