I'm tempted to go with USB because it is a more universal standard and I already have a thumb drive I can use.
Just so you know, FTDI chips only talk to computers over USB. Thumb drives dont work.
Dataflash is the easiest by a long shot.
Just put on a button which transmits all the recorded data over USB when your done.