Dolphin benchmarking - possible without user interaction?

[Sukrim]

Hi there,

I thought of doing a little project and building (and testing) different builds (and potentially even different configuration options) of dolphin. A search for benchmarks only suggests that so far they consist of people loading certain save states of certain games and then guesstimating the performance of dolphin on their hardware from that.
I would rather have a way to run a script that automates this process and that gives maybe more exact data than "FPS was mostly hovering around 80".
Are there some ways to get data that could hint to quality/speed into some logs? Is there a way to just tell dolphin to do x and y and then close down again, or do I have to code this in autohotkey or something similar myself?

Ideally in the end I want to have something like this: http://speed.pypy.org/
Until then it might still be a long way, but performance is something in my opinion that also should matter in an emulator to some degree and you cannot track what you can't measure.

Any hints that might help are more than welcome, looking forward to hearing from you.

[Shonumi]

Dolphin already has some rather robust benchmarking abilities, though they're not utilized often. Benchmarks have been attempted recently as well using only screenshots (search for Wind Waker Benchmark). Fwiw, the FPS tend to remain stable if you're just standing in one spot, so it makes the guess a bit more educated.

About those benchmarking capabilities, delroth added FPS logging in Dolphin. It records the FPS to a text file, one number for every second. You can simply add all of these numbers in a script then divide by the number of recorded seconds to get an exact average. Of course, this only makes sense if you can tell Dolphin to do the exact same thing everytime you run a game for benchmarking. Dolphin can also record movies (as .dtm files) which are essentially save states with button presses recorded at specific frames. It's similar to how SSBB records its "movies".