is a USB charger OK to use as power source - w/o regulators?

Generally no. But without looking at the output you can't tell for sure.

Assuming it is a USB power supply and not a true battery charger circuit, it should be outputting voltages within the USB spec.

Smoothing caps can't hurt.