It is just three photo diodes so yes you need an op-amp or at least a transistor on each diode. A bit like the circuit here:-
http://www.thebox.myzen.co.uk/Hardware/Sneak_Thief.html
You will also need a white LED to illuminate what ever it is you are trying to measure the colour of unless that thing is actually a source of light like stained glass or a monitor.