Systems in cars do something similar through Bluetooth
I would explore the profiles you need for that like Hands-Free Profile (HFP 1.6), Phone Book Access Profile (PBAP) and Advanced Audio Distribution Profile (A2DP)
You'll need to pair that system with your phone