Unity Animation doesn't work at all?

I have a gun that has multiple animations. An Idle, a Walking, a sprint, and an AimDownSight. Whenever I set the animations for Idle and Walking they work flawlessly. The second I start trying to use AimDownSight and Sprint it doesn't. Both animations require me to rotate the gun to make the animation. When I go into the game and play the animation the gun flies all over the place. I was able to fix this by adding a key to each axis for each keyframe. After I did that, when I would change between sprinting and walking the gun would fly away and stay way off in the corner, still playing the animations. Then when I'd press sprint, the gun would fly back to my character. I don't know how to fix this any help would be appreciated.