Of course things are changing. You have "floating pins". Please google that! Your pins must be permanently tied to either 5 volts or to ground through resistors to avoind what you are seeing. If your program does not read the pins, then no one cares if the pin is floating.
I hope you are not messing around with jumper wires while the Arduino is powered up. Are you using jumper wires in place of switches?
A schematic of your wiring would certainly make it easier to provide help.
Paul