which I think might be quite slow in practice
Can you share the arguments for that thought? in short why?
What is the speed you want?
In my simulation to solve this problem I came to ~100 msec (code see - Impact location, using four sound sensors. - #22 by robtillaart - Sensors - Arduino Forum - )