They ... They

Here "they" refers to the adversaries mentioned in Psalms 74:4.

They said in their hearts

This is an idiom. Alternate translation: "They said to themselves" or "They thought to themselves" (See: rc://en/ta/man/jit/figs-idiom)