Noobian:
Tried running from the 12V directly? Also did you swap power inputs while the Arduinos were running?
Everything was powered down before swapping.
Running it off the 12v, after a quick test seems to work, in the finished design the 12v supply can vary between 11v and 15v would the higher voltage not be a problem