If you're using a wired microphone ... click the three-dot icon next to your Bluetooth microphone, and select Remove device.