How to make a buck work over some voltage limit?

Tofer:
With such a small voltage difference it has a lower current limit.

Have you taken into account that max-charged charged batteries have a considerable higher voltage? Fully charged LiPos at 4.2V may often kill electronics that would be fine at the rated 3.7V.