You can program the esp8266 directly in the Arduino IDE without using the nano at all. There is a nice interface you can load in the board manager. Then just upload sketches. You just need a serial interface to your computer. (Unless its like a wemos d1 mini which has the serial built in)
And yes, its safest to level translate the serial lines to 3.3 v.