So here are the settings I have for Graphics. One thing I noticed is that under the Hacks tab "Store EFB Copies to Texture Only" unchecks itself once I start the game. When I reselect it I do notice a difference in performance. Like when I'm in the stage select screen or selecting which ship I want to use it runs at 60 FPS and the VPS is 60-100%, but only under the Native resolution. Once I select a stage (I use Hoth as that seems to be one of the more intensive stages) the performance dips to roughly 40 FPS and 50-80% VPS. The game is playable but the sound stutters and people talking sound like they're drunk. Basically everything slows down just a little bit during cutscenes, mostly. For sound I do remember to select DSP LLE Recompiler. I read that DSP HLE causes issues.
If anything stands out in those settings please let me know!