Hasta La Motion!

My question is about motion tracking a shot that has zoom in it and using that effectively in blender.

When i have a shot in which i zoom in with my camera the objects tends to move like it is flying in the video and the only way to keep it in its steady position is to play with the axis values(possibly the wrong way). Is there a way to keep the object stable while the camera zoom sin (of course there has been tracking, estimation of focal length and solve motion before i import it in Blender).

Any help will be much appreciated. Thanks in advance 🙂