What is too big of current that will fry the voltage regulator?

The answer will depend. High voltage (even with very small current) can kill it. Lots of current (even with very low voltage) can kill it. Middle current + middle voltage (lots of power dissipation) can kill it too.