Hasta La Motion!

I want to practice tracking some video footage that has zoom in\out whereas in the zoom in phase you obviously see details you didn’t see before so all previous tracking points are useless..

I did some tests with realviz matchmover and wasnt’ able to get smooth results at those parts though it could be just me not using the right technique.

What is the acceptable approach for such tracking and which software can handle it best?

Thanks.

*edit*
If I wasn’t clear enough, then for example lets talk about a video of a downtown street shot from a handheld camera while at the middle of the video there’s massive zooming in to one of the buildings.