If I connect GND(Arduino) to the negative terminal of a 9V power source will I fry something?

Unless I have misunderstood your battery is the wrong way round. The long bar is positive, the short one negative. When I first learnt about electrical circuits I remembered this by imagining that I could cut the long bar in half and use the 2 pieces to make a + sign.

Plus everything everyone else said!