SD Card - how to reduce the power consumption?

500uA might be ok - it depends on the actual card used. Check the sdcard's chipselect is high when idle.
You may disconnect the card fully with a high-side switch (ie. pmosfet).