I can only speak to the NAV implementation but you can turn OFF the AutoConnect and that would force you to select a phone each time you start the car.
That would make the procedure consistent regardless of who drives the car.
Just another option. YMMV.
J