Virtualbox 5.2.18 (and 5.2.19) crash on OpenIndiana Hipster

[Espen Martinsen]

Hi, ref: ​https://www.illumos.org/issues/9752

When starting a VM on 5.2.18/19 from hostOS openindiana (illumOS) it crashes in

rtR0SegVBoxSolCreate().

#echo disable_smap/d | mdb -k disable_smap: disable_smap: 1

[Michael Thayer]

Not a Solaris person I'm afraid - do I read the last line correctly as saying that SMAP is disabled? For classical Solaris we advise disabling it in /etc/system (don't have the details, sorry). More generally, since we do not have the spare resources to support OpenSolaris in the core team, it might be worth finding people in the OpenSolaris community willing to invest the time into understanding how VirtualBox works, at least the host (kernel and other) integration parts, so that they can take over maintenance of an OpenSolaris port themselves. People from the FreeBSD community (possibly others) do this and we incorporate their patches, usually with host-specific ifdefs. It should be doable for people who have a reasonable understanding of how the kernel works, for example because they write or maintain drivers.

You can look at our Linux kernel code as an example of how to deal with SMAP, as we already support it on Linux hosts.

[Alexander Pyhalov]

It is not related to SMAP.

I know nothing about FPU operations, but it seems that recent changes related to FPU and GDT in illumos-gate has caused this - ​https://github.com/illumos/illumos-gate/commit/4c28a617e3922d92a58e813a5b955eb526b9c386 and ​https://github.com/illumos/illumos-gate/commit/309b04b88ca20521fb8141c40ad19b8528b37d7d .

The corresponding KVM fixes looked like ​https://github.com/joyent/illumos-kvm/commit/440eb6bba02ae3bc620f1766f4556caa2f2cbcad (FPU-related fix) and ​https://github.com/joyent/illumos-kvm/commit/657e3ab2d1aefe7cab92349b884c616b517bf200 (GDT-related fix).

[Alexander Pyhalov]

as_map() fix

[Alexander Pyhalov]

The following patch (https://www.virtualbox.org/attachment/ticket/17947/vbox.patch) fixes VirtualBox. The issue was analyzed and fixed by Andy Fiddaman.

[Espen Martinsen]

Awesome!

Looking forward to try out this fix. What are the timeline for getting this out to official 5.2.x release?

-mnespen

[andyf]

Unless

Runtime/r0drv/illumos/

is created, this is going to need wrapping in an #ifdef for illumos as the patch would break Solaris.

[Michael Thayer]

I am wondering (I may have wondered this before) whether it would make more sense for Illumos to build their own packages, like FreeBSD (and possibly other BSDs) too. We carry their source changes, as we could probably carry yours (I will check that) but they make sure that everything builds and works. That would probably benefit both sides, as we do not really have the resources to put effort into Illumos support, and you would be in control of the port.