Arduino voltage regulator feeding more voltage than input?!

I know what it is. It is ....... impossible !

What kind of multimeter are you using ?
Which Arduino board are you using ?
Do you use the Ground from the GND pin ?