Am I right about my assumption?
Yes.
And are there any ways around this?
Increase the input voltage accordingly.