I have this problem too. I am running Windows 8.1 and I am using the drivers I installed from their website. My laptop doesn't have a DVD drive so I can't use that mini CD. I would get the drivers off their website anyways just because they are probably more up-to-date. What I currently do when ending an emulation is just unplug the USB adapter and plug it back in due to the fact that dolphin immediately becomes responsive again once I unplug the adapter.
[color=green]Windows 7 x64 / i5 4690k @ 3.5 GHz / GTX 970 / 8GB RAM[/color]