5v to 24v transistor

Yes, you can use the Arduino/Bluetooth/phone as a switch. Either a relay or a logic level MOSFET will do it. A MOSFET is a type of transistor but much more useful for high powers than the one you have.

Steve