So I am looking for an option on where I can access the files in the SD card through the USB dongle without having to remove the SD card from the device.
A common thing beginners don’t know is the difference between a USB host and USB client. You can not read / write a USB memory stick, which is a client device with an Arduino which is also a client device. To do this you would need a USB host shield on your Arduino.