greatly to be praised
"people are to praise him greatly"
the city of our God on his holy mountain
This is a reference to Jerusalem, which was built on Mount Zion.
the city of our God
Possible meanings are 1) "the city where our God lives" or 2) "the city that belongs to our God"
See in Reader