Will LDR sensor module latency be a problem?

Photodiodes are better performers than photoresistors - repeatable, fast, temperature-insensitive, no toxic components. There are also many light sensor chips that make digital interfacing directly possible.