oric_dan:
If it suddenly started working, then it was probably a loose wire. Check your connections. I presume you're using the soldered prototype now. I meant to say this before about whiteboards - bad connections are probably the source of about 90% of people's problems. I never use them. Also, like westfw indicated, I "always" wire up the back-side gnds, Vcc, and Vref pins.Migrating to the 1284P | The Robot Diaries <--- that link is a riot. No references. His comments are straight out of the excruciatingly long forum thread in 2013, 27 pages or so, where we debugged the RX0 problem using eternal frustration as the motivation.
Also, Serial1 works 100% on the 1284, I use it all the time. So, check your connections and setups.
Also, all the SoftSerial libraries are a POS from my experience, although others swear by them, and you find 100s of examples of their use. They may work somewhat ok for RX only on 1 channel, but are useless for real 2-way comms in my experience. If you must use SoftSerial, try PaulS' AltSoftSerial from the pjrc.com site. I've not used it, but the description sounds like it's competently coded. Try it, and report back, I'd be interested to hear of someone's experience with it, :-).
Also, re your comment on the other thread, I tried the ESP8266 back in December, and gave up on it immediately. Very unreliable. There are MANY threads in the Networking section of people not being able to get it to work properly. I've not checked recently, so maybe someone has had better success now.
Also, despite others' hesitations on the matter, I use 16-Mhz with Vcc=3.3V every single day. Perfect reliability, although I don't go to 80 degC, etc.
I'm not really sure where the problem was to be honest.
I went round in circles and did everything 10 times on my breadboard and prototype board.
All I'm thinking is when I moved to my prototype board I didn't use nick gammons sketch to upload the bootloader and used maniacbug library to do so.
However when I used it just before on the prototype board then it suddenly worked; I could flash the chip with my own sketches. Which could be related to his sketches changing the necessary fuses before uploading the same bootloader.
However I'm sure the fuses were changed.
I read that whole thread from 2013, are you basically saying the hardware problem doesn't exist or there is some type of problem with UART 0's RX?
As I need to heavily rely on this for my product as firmware upgrades will be done through a USB to Serial FTDI with UART 0.
I've just tried Serial 1 and Boom. it works, which is a huge relief and weird. I don't need an extra UART for now so Serial 1 will do but I will save them links for later use.
When you say "all the SoftSerial libraries are a POS from my experience", what do you mean by POS?
I came across a thread funnily enough from 2013 that discussed problems with the 1284 and software serial,
http://forum.arduino.cc/index.php?topic=157297.0
It talked about the need for modifying the software serial library to get it to work, this was 2 years ago have you heard anything since with your experience of the chip?