Wii remote won't stay connected?

[Emi]

I'm using the USB Bluetooth Dongle and one of the Wii remotes that came with the Wii itself, pairing it with Dolphin as Real Wiimote. However, whenever I try to play a game, the Wii remote will disconnect after a couple minutes. I've tried pairing the Wii remote with Dolphin again while the game is still open, but it still acts as if though it's still disconnected, so I have to restart the game anyway. But this happens every time I try to play the game, so I'm never able to get very far into the game.

How can I get it so the Wii remote won't disconnect?