Random slowdowns

[Viceroy]

Having some problems in Dolphin where I'll run a game fine at first then it will randomly and permanently slow down 20%. Altering the resolution doesn't help, or hurt, oddly. I think it has something to do with cpu or gpu not utilizing the program correctly.