Thanks.
The crazy thing is that i came to that exact solution my self and tried to by 4051's on my way home from work, but they were sold out 
My only concern is if the resistance through the two IC's is to big for the switches to actually close.
I also think that i need 8 pins (or 3 and a 595 shiftregister) because i would need to enable / disble the inhibit pins to prevent one switch from being closed all the time.
I will reprot back what i find out when i get some 4051's from the online store insted.