I don't know what the joke is, and I don't see anything funny. There is the storage section in the very forum that, amongst other things, specifically addresses this matter, and I assumed that, if you already have a hard drive in a USB enclosure, it is just a matter of getting a USB host board for Arduino, and you are off to the races.
For all that, other than the convenience of what you might have to hand, I'm not sure what the point is either. As Crossroads says, SD cards are the way to go. The practice is commonplace, you can get a card slot board for $2, and it is all so simple.
You first need to consider the practicalities and real needs. "Very high" and "huge amount" are meaningless terms and, while you consider them, you might as well include "how long", as it is just as valid.
The output from a datalogger does not usually take much space. I understand that Arduino can handle SD cards up to 32Gb. I get by with 2Gb as I found that timestamped output from four sensors recorded every ten seconds will take over three years to fill it.