The first one, regret, may simply be being sorry that you got caught doing evil or that you had to give up doing evil. The second is as you say 'moving on' but it also means 'turning around' or 'changing your ways'. When a person really repents of something before God his intention is to leave that thing behind and never do it again or even to look back at it yearning for it. This is much easier to say or to describe than it is to do. God knows this better than we do... and He will help us if we sincerely want to change or to be changed to put our repentance into effect from this moment forward.
"And Jesus looking upon them saith, With men it is impossible, but not with God: for with God all things are possible." Mark 10:27
"Now when they heard this, they were pricked in their heart, and said unto Peter and to the rest of the apostles, Men and brethren, what shall we do?
Then Peter said unto them, Repent, and be baptized every one of you in the name of Jesus Christ for the remission of sins, and ye shall receive the gift of the Holy Ghost.
For the promise is unto you, and to your children, and to all that are afar off, even as many as the Lord our God shall call." Acts 2:37-39
"Blessed are they which do hunger and thirst after righteousness: for they shall be filled." Matt 5:6