Can't get two XBox One controllers to work at the same time

[StripTheSoul]

Heya!

So, I got the following controllers: 2 XBoxOne Controllers, a Xbox360 Controller and an old (but still well-functioning) Logitech RumblePad Pro.
In Windows Game Controller settings, all four of them are visible and I can go into the settings of each one and calibrate them without any issues, so I guess this is not an issues on Windows' side.
Now, in current Dolphin controller settings, I select four Standard Controllers, then try to config each one of them... in the devices I got three devices called XInput/0/gamepad (the other two with the numbers 1 and 2) and one DInput/0/Logitech Rumblepad.
So there also everything seems fine. However, the last controller just isn't doing anything in the config window. I put it on 2 (0 and 1 are already one of the XBox One Controllers and the 360 Controller, so 2 would be the second XBox One Controller), but nothing happens. Also, when I close and reopen the config of Port 4, the device automatically puts itself to XInput 1, so the Xbox 360 Controller is now in Port 2 and 4.

Any suggestions? :/

[StripTheSoul]

Gnaaaa... now I got it to work... but only when I put the controller in Port 4 (or rather the second XBox One Controller) to device 2 and then bind something... then it recognizes the controller and shows something when I press the analog stick to the side e.g.
But why doesn't it work immediately when picking the device? It worked for the other ports/controllers. Kinda confusing.