Hi insanehadi,
You will need some breadboards, LEDs, pushbutton switches, resistors, capacitors and an inexpensive digital multimeter. You may not require all of these as part of your calculator, but they will be invaluable as you learn about Arduino and build simple circuuts and prototype your calculator.
EDIT: you will also need a trimmer-potentiometer to adjust the contrast on the LCD.
Paul