Stepper Motor rattling on arduino startup/reset

You left the pin floating - bad idea. Use a pull-down resistor of 4k7 or so to ground on the step wire. This prevents it floating (which allows random interference and the symptoms you describe)