Copying Save Data and Controller Configurations

[Pringo]

Hi, I was wondering what files exactly I should be looking at if I want to copy over my game save data and controller configurations from one Dolphin revision to the next. I realize I can just copy over the User folder but I would prefer to start fresh from any settings changes I've made. However I don't want to lose my game saves and controller setup in the process. Thanks in advance for any help with this.