Powering LEDs when using Vin w/battery (Arduino Nano)

If I recall correctly, power to Vin needs to be over 7V due to voltage drop in the internal regulator. So you're probably possibly not getting 5V on your pins. Have you measured?