Or is this impossible?
You do know that google has built actual, self-driving vehicles that have logged over 100,000 miles, over 1000 of that completely without human intervention (and the rest with only occasion human help), right?http://en.wikipedia.org/wiki/Google_driverless_car
I would say that if this can be done, what you are trying to do is certainly possible. Indeed, here is this:http://blog.davidsingleton.org/nnrccar
This guy managed to do this while taking a free online course from Stanford (which I also participated in - it was an excellent course taught be Andrew Ng, who is an excellent instructor):http://www.ml-class.org/
If that isn't enough, you could always take this course (better hurry - starts on Monday!):http://www.udacity.com/overview/Course/cs373
...yeah, I'd say it's possible...