Windows 10 freezes when using a KVM switch while VirtualBox is running VMs

[bati2712]

I have the following problem. I have Windows 10 PC, Virtualbox 5.1.14 r112924 installed, and a Keyboard/Mouse Switch via USB connected to this PC for Mouse and Keyboard. Using the KVM switch is working perfectly fine with all applications. BUT when I run a VM in VirtualBox, and then I use the KVM switch to connect to another computer, and switch back to Windows 10, I have no access to that computer anymore. Keyboard and Mouse don't work anymore. I have to hard reboot the Windows 10 computer. This is reproducible every time. The guest OS is always CentOS 7.2.