Yes you can use the ICSP pins but beyond that I cannot follow what you are doing. Since you can read schematics post a simple one showing exactly how you connected it. MOSI goes to MISO always. SCK to SCK. Do not forget about CS\ chip select if it is not true it will not work.
In this moment we use an Arduino Zero, the sketch should to use 5 SPIs (one master and 4 slaves) one spi slave we will use as port communication with another SAM (V71), in real board we want use the version ATSAMD21J17 RT version (64 pin) that should to be support all the SPIs. Than some pin are busy for other functionalities (GPIO. console, 6PWM, etc) than we must to use the ICSP connection.
You can use one SPI bus for several devices, 4 or 5 would be no problem. You can use a 74HC138 or similar device for a mux which would only require 3 pins for device select and the original CS\ as the enable. You might want to breadboard it first.