the tent of meeting must go out ... in the middle of all the camps
This means that the tent of meeting must be carried by the Levites in the middle of the tribes as they travel.
They must go out
"They" refers to the twelve tribes.
by his banner
"by his tribe's banner"
See in Reader