SD card not working unless I enable pullup on MISO. Is this okay?

Oh, sorry I posted the wrong part of the schematic. I've updated the link above.

Here's the full schematic for my board:
http://mightymicrocontroller.com/Mighty-schematic-full.png