MPU6050 DMP, do I need to read the whole packet?!

I'm struggling with the time lag when reading DMP quaternion data from FIFO in the MPU6050, the thing is that we need to read the whole 42 byte packet, right?
Is there any way so I can read only the quaternion bytes, making the data aquisition faster?