Visual Basic?

In visual studio .net the difference between VB and C# is not very big. Of course come code constructs are not the same, but all the .net related stuff is allmost identical.

Just for the record - remember that the USB port on the Arduino is really a serial port. In your PC program it will show up as a "virtual" COM port named something like "USB to serial..."