I don't think you can safely or reliably recharge LiPos without a dedicated LiPo charger circuit. The charger has to monitor when the cell is full and stop the charge to prevent damage.
Someone more familiar with charging ICs may be able to recommend something.