The unofficial Ishiruka branch of Dolphin has asynchronous shadercache generation so you won't get the stutter most of the time as it'll have already guessed that you'd need the shader and prepared it, although there might be a few more issues in the cases where it guesses poorly. I think there are some other possible optimisations the devs are considering for official Dolphin, but none of the ones they know won't break anything are especially low-hanging fruit, so to speak.
OS: Windows 10 64 bit Professional
CPU: AMD Ryzen 5900X
RAM: 16GB
GPU: Radeon Vega 56
CPU: AMD Ryzen 5900X
RAM: 16GB
GPU: Radeon Vega 56
