You have chosen a problem which is exceptionally hard for computers to do and easy for a human to do. What does Google say about it? Who else has done this kind of thing before?
I suspect that we will have widespread use of self-driving cars before this problem is solved.