[vbox-dev] bug in H3DOR_FMT_RGBA support for offscreen framebuffer redirection

[Rūdolfs Bundulis]

Hi Vitali,

well luckily cuda saved me from having any penalties - since i do rgb to
nv12 on cuda it actually does not matter if take the pixels from top or
from bottom:D If I manage to get our university to a stable spot then
(currently I am experiencing hangs with Windows 10 and the OpenGL
redirection but I wont bother anyone here till I've gathered some adequate
evidence) yeah, I can try to provide a patch for this:) As I said, it is
simply an inconvenience not a show stopper so I can live with this.

2016-05-19 21:48 GMT+03:00 Vitali Pelenjow <Vitali.Pelenjow at oracle.com>:

> Hi Rudolfs,
>
> H3DOR_FMT_RGBA was added as a placeholder for a possible optimization.
> Exactly as you said to avoid additional conversion to _TOPDOWN.
> However it was  never implemented  in display_vrdp.cpp. I.e. only the
> ConsoleVRDPServer side has been implemented.
>
> You could try to implement H3DOR_FMT_RGBA.
> I do not think anyone here has time for this in near future.
>
> Thanks,
> Vitali.
>
> Rūdolfs Bundulis wrote:
>
>> Hi,
>>
>> While implementing 3D redirection in my framebuffer I think I've
>> discovered a bug - the H3DOR_FMT_RGBA format is not handled properly. If
>> you look at display_vrdp.cpp:345 then if the returned strings do not match
>> H3DOR_FMT_RGBA_TOPDOWN then successful return code is returned but the
>> initialization functions are called which results in my framebuffer getting
>> a null pointer in all the instance parameters passed to the calls. I guess
>> since the vrdp server sets both everything goes fine and only issues can be
>> experienced with external framebuffers.
>>
>> What is more interesting to me - is H3DOR_FMT_RGBA going to be supported?
>> I am mixing the contents of the GPU framebuffer and the offscreen OpenGl
>> surface and having to rotate the latter makes a bit of an inconvenience
>>
>> Best Regards,
>> Rudolfs Bundulis
>>
>>
>> _______________________________________________
>> vbox-dev mailing list
>> vbox-dev at virtualbox.org
>> https://www.virtualbox.org/mailman/listinfo/vbox-dev
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.virtualbox.org/pipermail/vbox-dev/attachments/20160519/9ebbec91/attachment.html>