If I display this in binary I am missing exactly those leading zeros.
The key word in that phrase is DISPLAY. The 0s are NOT missing. They are just not necessary to convey the required information. 0x3 is the EXACT same value as if you typed 0x00000003.