The freeduino clique came up with a reasonable-sounding theory that in the original Arduino (serial, the one in the famous photograph), the voltage regulator mounting hole also served as the 4th mounting point...
I stick self-adhesive rubber feet on the bottom, after Lady Ada...