Separate out Grounds fom eachother

A step down converter may or may not have separate grounds...
Use a cheap adapter... (not too cheap, for those may be dangerous).