Controlling Robot Using cellphone

Can you just connect the arduino to the cell phone's audio jack, like when listening to a phone call with ear plugs? The Arduino would have to decode the frequencies of the tones.

While decoding a phone call's tones is cool, you could just write an app for your phone that connects over the internet to your server or the Arduino could connect directly with the server (over bluetooth or wifi.) This is pretty normal stuff.