I will say to God, my rock

The writer speaks of God as if he were a huge rock that would provide protection from enemy attack. (See: rc://en/ta/man/translate/figs-metaphor)

Why do I go mourning

To "go mourning" is to perform customs related to being very sad.