It'd be more sensible to pause the emulator if it's waiting for something from the other one than to crash, so I'd guess if both Dolphin and VBA-M keep pausing to wait for each other it'd explain the slowdown.
OS: Windows 10 64 bit Professional
CPU: AMD Ryzen 5900X
RAM: 16GB
GPU: Radeon Vega 56
CPU: AMD Ryzen 5900X
RAM: 16GB
GPU: Radeon Vega 56
