Loud vibrating nema 17 stepper while turning with hall effect homing function

You need to use microstepping to get the quietest and most reliable performance from a stepper. I'd suggest trying x8 or x16 microstepping.

Its essential to use speed ramping with all but the tiniest steppers, so AccelStepper library is a good place to start as it does this for you.