While too hot to touch is too hot is an old adage nowerdays it is not true. Many modern chips run very hot. A heat sink will help but the heat sink can itself be too hot to touch.
However the OPs problem is almost certainly due to the fact that they are not turning it on fully.