Capacitors will do something but for a very stable voltage a linear regulator still is a better choice.