C:\Program Files\Arduino <-- That's your distribution folder. No user-serviceable parts inside (unless you know what you're doing.)
C:\Users\You\Documents\Arduino <-- This is where you live.
C:\Users\You\Documents\Arduino\libraries <-- Aftermarket parts
C:\Users\You\Documents\Arduino\sketches <-- Your sketchbook