Bluetooth Passthrough Stops Working if USB Adapter is Ever Removed

[IronKnife]

I have an Mpow Bluetooth 5.0 USB Adapter that I use for Bluetooth passthrough for Dolphin on my laptop. If I use Zadig to switch the driver to libusbK and run dolphin, it connects and works great. I can connect multiple remote and even if I restart my laptop they will still connect. But if I ever remove the Bluetooth adapter and put it back in (Not while in use obviously), I can still run games without any errors coming up, but none of my remotes will sync. The only way to fix this is to restore the adapter to the default BTUSB driver, and then reinstall the libusbK driver, and then leave it plugged in. I tested the adapter and had the same issue across multiple PCs. The WinUSB driver acted exactly the same. Does anyone know anything concerning this issue? Is it just in issue with this particular adapter? Am I doing something completely wrong?