Regulator gets hot with 7.4v and 11.1v li-po

And not much current draw!

Hook up the same load and you will have the same problem.

Note, that any heat you can feel is just wasted amp-hours from the battery. Using the switching convertor will make your battery last much longer.