that my name may be there forever

"that I may be there forever"

My eyes and my heart will be there every day

"I will watch and protect it forever". This implies that he will protect his temple.