This is essentially what you are trying to do:
http://www.euclideanspace.com/maths/algebra/vectors/lookat/index.htm