Check
$ VBoxManage list systemproperties|grep "Webservice auth"
The result is most likely 'VRDPAuth'. Fix this with
$ VBoxManage setproperty websrvauthlibrary default