is it normal that I get a huge FPS/VPS drop when using the LLE sound plugin... everything goes from full speed to like 60%
Yes, it is normal because an additional core is being emulated by your PC.
Would this mean that there's an actual benefit to having a quad-core CPU for Dolphin now?
not until skid debugs the lle on thread issues.