Peltier plate voltage drop

Take less current from the Peltier. Energy harvesting generally generates very low amounts of power. Your typical USB battery bank is going to be a huge load in comparison to the paltry amounts generated by an energy harvester.