Windows alert chime sound when using keyboard

[themanuel]

Just like the subject says.  If I use the keyboard for inputs, or even if I use a controller but press a hotkey on the keyboard while a game is running, the Windows chime sounds on every keystroke.

Does anybody know what causes this?
I can simply turn Windows sounds off but if this is triggering something on the OS and there is a solution, I would like to apply it.

Thanks.