Here "him" refers to Simon. Also, those with him include Andrew, James, John, and possibly other people.