Controlling many RGB LEDs with infrared light?

Hey all, I'm fairly new to arduino and was curious if a project that I had in mind was feasible. I built a circuit using two photocells and seven LEDs, then wrote the appropriate code to make the arduino control the LEDs based on the time between the change in the value of the photocells. For example, if you move your hand across the photocells slowly, the LEDs light up in sequence slowly, if you move your hand over them quickly, the LEDs light up rapidly, and if you hold your hand over both cells, the leds randomly turn on and off.
What I was thinking about doing was expanding on this idea and making a circuit with 100+ RGB LEDs in a square, and possibly four infrared photocells with four infrared LEDs next to them so that I could get consistent readings (by reflecting the infrared light off your hand to the sensor?) to control the matrix of RGB LEDs in any amount of ambient light, whether it be pitch black, or outside in the sun. I'm curious if IR photocells are made that are capable of this, and if an arduino UNO could control all the LEDs (I know that many PWM chips of some sort would be required)?.

Edit: I looked up the cost of RGB LEDs and decided single color ones would be slightly less ambitious and better fit my needs LOL.