Connecting a pin to Gnd is best practice because you are less likely to damage something vs accidentally grounding your +5V to Gnd, which we have seen happen. Take out your regulator, take out your PC USB supply.
Internal pullup resistor limits current flow to <0.5mA, nice & safe. No extra parts needed.