This refers to the largest group of fighting men, those not in the ambush group.
those who were "set in ambush on the west side of the city"