Will LDR sensor module latency be a problem?

You should use a sensor that is at least 10x faster than that, that is, with a response time of less than 3 microseconds. A photodiode will work.