Strange behavior from voltage regulator

Problem kind of solved. I shortened the outgoing lead and Voila: