What's the VA rating of your transformer? How much capacitance do you have in your rectifier circuit?
It seems most people don't bother with a soft-start unless they're using 500VA or more. You do need a slow-blow fuse, however. Otherwise, a fast-acting fuse needs to be several times your maximum current rating, which isn't much defense if the circuit misbehaves.