That is rather unusual for a brushless motor designed for motion control to be without hall sensors. I guess they used the encoder to generate the commutation signals. Have you checked the encoder outputs to see if there are additional pins for the encoder? Here is an example of such an encoder: http://www.renco.com/fileadmin/files/Productinfo/RCML15_Datasheet_646770_06_C.pdf.