Hasta La Motion!

i am setting up a shot were camera goes from 20 feet towards a line of very tiny CG objects (1,5") and in the end the camera is so close that only 1 little object is visible.

i thought about having some ping pong ball markers in XYZ space and then when camera comes closer to the object also placing some 10x10x10" objects for tracking?

I did a test without the 10x10x10" object and when the camera comes close to the final CG object, my 3d floor has rotated on the X axis according to the rest of the sequence.

Any suggestions or experience about setting up this kind of tracking markers??
Thanks!
Giso