Problem Uploading Board on Arduino Uno Running IDE 1.8.3

After switching to another board and then coming back to an Uno I am getting the following error output:

avrdude: ser_open(): can't open device "\.\COM4": The system cannot find the file specified.
Problem uploading to board. See http://www.arduino.cc/en/Guide/Troubleshooting#upload for suggestions.

I am running this on Windows 10. The correct board is selected. The Windows device manager is saying that the USB is connected to COM3 and the IDE says it is connected to the same serial port. The first line of the error is referencing COM4. Should I try to fix that or are there other things to try? I have gone through restarting both Windows and the IDE several times as well as resetting of the board. The LED attached to pin 13 is blinking when I restart as well. Any other suggestions?

Select COM3 from the Tools > Port menu in the Arduino IDE.

That was way too obvious. Thanks.