When you change your baud rate, did you change the IDE's serial monitor Baud also?
Your problem is still the 3V3 current delivery.
Maybe you could/should look into building a stand alone atmega board with decent 3V3 regulator added on it to solve your footprint issue.