Yeah, and my suspicion is/was that you somehow made an error in the physical connections and the GND of the servos somehow was routed through the breadboard. Breadboard connectors only start to smoke above a few amperes, which is not something that's attainable by just an Arduino and a couple of switches. Then there would have been smoke in different kinds of places.