Your biggest concern will be interfacing your 5V devices with your 3.3V ESP32. All the GPIOs on an ESP32 are 3.3V signal levels and connecting a signal with a greater voltage like 5V will damage the ESP32.
So you wind up using voltage translators and voltage dividers at the appropriate places.