I agree. Bigger servo.
Or, you might move the servo slightly past the target point and then back.
Before you give it a command, determine which direction it is from the current position.
Add (or subtract, depending on direction) the 2-5us.
Give the servo time to get there.
Then issue a new command for the actual position without the adjustment.