Yes and no.
I know the way I've presented the problem looks a bit daft.
But the actual circuit is a bit more complicated and has a press button switch that grounds the circuit to turn it off (including pulling an IC reset pin low). I need to add an Arduino controlled thing in there to which can ground the circuit in the same way as the switch.