Oooh! Will try that!
A colleague of mine suggested for trying to do interpolation: catmull rom spline
Since I will have the motion all be relative, and the thing has to respond to OpenCV messages. What do you think? Am I going about this incorrectly so far?