Scripture talks about how He is grieved...
Genesis 6:6
The Lord was sorry that He had made man on the earth, and He was grieved in His heart.
Psalm 78:40
How often they rebelled against Him in the wilderness
And grieved Him in the desert!
2 Chronicles 21:7
Yet the Lord was not willing to destroy the house of David because of the covenant which He had made with David, and since He had promised to give a lamp to him and his sons forever.
Isaiah 63:10
But they rebelled
And grieved His Holy Spirit;
Therefore He turned Himself to become their enemy,
He fought against them.
Isaiah 65:3
A people who continually provoke Me to My face,
Offering sacrifices in gardens and burning incense on bricks;
Ephesians 4:30
Do not grieve the Holy Spirit of God, by whom you were sealed for the day of redemption.
Psalm 139:24
And see if there be any hurtful way in me,
And lead me in the everlasting way.
Hosea 12:14
Ephraim has provoked to bitter anger;
So his Lord will leave his bloodguilt on him
And bring back his reproach to him.
Source:
8 Bible verses about Grieving God