Fast is safe enough for nearly every game, and safe is fast enough that it shouldn't cause any slowdowns, and is, in fact, enabled whenever custom textures are used. It really doesn't matter as a setting these days.
Okay thanks for the clarifications, its just some games like pandoras tower seems like the flesh is invisible (not like is bothering but feels like its lacking something xD)
Most settings you don't really need to worry about since Dolphin has game specific INIs for most games with optimal settings
You usually just need to set the graphics backend you prefer and whatever enhancements you like.