So I tried softwareservo, which surprisingly acts almost exactly the same. It twitches slightly less often but the twitches are stronger. I am only using 2 servos so I MIGHT be able to get away with the really old servo library (that I think only worked on pins 9 and 10) but I'd prefer to avoid that if possible.