That buck converter could have a 2-4volt dropout voltage. Who knows.
That means you must power it with 8-10volt minimum to get your 6volt out.
Try three or four LiPo batteries in series.
10-12volt is better for the batteries as well, because battery current is lower when battery voltage increases.
Leo..