majhi:
So basically I want the Arduino to just control the on/off states on the relay and not provide any direct power to the lights themselves (since that won't work anyway with the low voltage and current). It seems simple enough, almost deceptively so. Am I missing anything crucial? Thanks in advance.
You would probably use a transistor rather than a relay, but you have the basic idea. There is a whole section of the forum dedicated to discussing this type of thing.