Hasta La Motion!

Last question of the day, promise.

So I have 2 videos that I filmed separately for my project. One is of just the background video with no movement, and one is of my hand holding an object and moving it around slowly. What I need to accomplish, is to mask the movement video with my hand over the background video, so that effects on the background can still be seen where my hand and the object are not.

My natural train of thought is to rotoscope / mask the movement video and just outline the object / my hand in every frame.

Is there a way to do this easily without having to use the pen tool and do it frame by frame, thus causing jitters? The object is not moving very quickly, so I am considering masking with Paint inside AE.

Is that the easiest route? (I don’t have combustion, only AE and Nuke PLE)

Thanks!
(Sorry if this is a newbie rotoscoping question…)