I use multiple headsets and I find it very hard to manage these headsets when I jump into conf calls.
The two utilities mentioned by Scott will be a life saver :)
Audio Switcher: A simple app runs as part of the notification area, that help you to switch default audio input and output devices. There is no down load available. You have to copy code from git and build it. Once build is completed, find the exe from the bin folder and run the AudioSwitcher.exe program.
https://github.com/davkean/audio-switcher
EarTrumpet:https://www.microsoft.com/en-us/p/eartrumpet/9nblggh516xp?activetab=pivot%3aoverviewtab