28BYJ-48 stepper

at the expense of extra heat when running fast.

I think you mean extra heat when running slow. A stepping motor takes the most current when it is stopped, as it speeds up it takes less and less.

Not while you have LEDs in series with the motor winding.

I see you have now corrected the diagram, does this reflect what you actually have?