I found a routine here http://scolton.blogspot.com/2010/07/arduino-interrupt-driven-servo-routine.html that uses PWM, resets one of the board's timers, and uses interrupts to control the servos
That's exactly what the Servo library does.
No need to reinvent that particular wheel.