UNO + Olimex Midi Shield (Resolved)

The LED isn't hooked up to the MIDI OUT

If it follows the standard your MIDI OUT is connected to an optocoupler on the MIDI IN side. There should be something in the middle of the cable you have that is MIDI to USB converter. So it is driving that optocoupler.