Can you please elaborate a bit on what the capacitors would do for the circuit.
It would stop the regulator from oscillating and working incorrectly.
You need them, see the data sheet for the regulator you are using if you want to know the minimum value.