Image keeps jumping on hover

I am using an On-Hover animation on an image, and using Move, Rotate, Scale animations on-Hover. However, for 2 such images, if i hover on the area where the object originally was (before the on-hover move animation), then the image keeps jumping for as long as the cursor is in that area. Below are a video and image to show my situation.

What can I do to correct the On-Hover behavior?