3D completly broken on Windows 2003 Server / XP64 host [FIXED IN SVN]

[frg]

3D ist completely broken since 4.3.14. AMD HD7770 GPU.

Reported here for beta and ignored:

​https://forums.virtualbox.org/viewtopic.php?f=15&t=62527

Affects all Windows guests

Latest good version I know works is 4.13.94724

If you don't plan to fix it just let me know and close the ticket. As a test I converted 2 VMs to vmware and they work well.

FRG

[frg]

Vista x86

[frg]

Windows 7 x86

[galitsyn]

In the VBox.log you have:

00:00:04.094492 OpenGL Info: Render SPU: GL_VENDOR:   Microsoft Corporation
00:00:04.094504 OpenGL Info: Render SPU: GL_RENDERER: GDI Generic
00:00:04.094508 OpenGL Info: Render SPU: GL_VERSION:  1.1.0
00:00:04.094511 OpenGL Info: Render SPU: GL_EXTENSIONS: GL_WIN_swap_hint GL_EXT_bgra GL_EXT_paletted_texture

This most likely mean you don't have properly installed host video card drivers or running VM via remote desktop connection. Could you please confirm if this is a case?

[frg]

Yes I completely deleted the old drivers and also used DDU to clean everything up. Reinstalled 14.4 and it made no difference. Please check vbox-ok.zip. The same drivers work well with 4.13-94724. It looks to me like a detection issue.

00:00:02.889744 OpenGL Info: This is an ATI card, taking care of fullscreen.. 00:00:02.890417 OpenGL Info: Render SPU: GL_VENDOR: ATI Technologies Inc. 00:00:02.890425 OpenGL Info: Render SPU: GL_RENDERER: AMD Radeon HD 7700 Series 00:00:02.890431 OpenGL Info: Render SPU: GL_VERSION: 4.2.11927 Compatibility Profile Context 00:00:02.890480 OpenGL Info: Render SPU: GL_EXTENSIONS: GL_AMDX_debug_output GL_AMD_blend_minmax_factor GL_AMD_conservative_depth GL_AMD_debug_output GL_AMD_depth_clamp_separate GL_AMD_draw_buffers_blend GL_AMD_multi_draw_indirect GL_AMD_name_gen_delete GL_AMD_performance_monitor GL_AMD_pinned_memory GL_AMD_query_buffer_object GL_AMD_sample_positions GL_AMD_seamless_cubemap_per_texture GL_AMD_shader_stencil_export GL_AMD_shader_stencil_value_export GL_AMD_shader_trinary_minmax GL_AMD_sparse_texture GL_AMD_stencil_operation_extended GL_AMD_texture_cube_map_array GL_AMD_texture_texture4 GL_AMD_transform_feedback3_lines_triangles GL_AMD_transform_feedback4 GL_AMD_vertex_shader_layer GL_AMD_vertex_shader_viewport_index GL_ARB_ES2_compatibility GL_ARB_base_instance GL_ARB_blend_func_extended GL_ARB_color_buffer_float GL_ARB_compressed_texture_pixel_storage GL_ARB_conservative_depth GL_ARB_copy_buffer GL_ARB_depth_buffer_float GL_ARB_depth_clamp GL_ARB_depth_texture GL_ARB_draw_buffers GL_ARB_draw_buffers_blend GL_ARB_draw_elements_base_vertex GL_ARB_draw_indirect GL_ARB_draw_instanced GL_ARB_explicit_attrib_location GL_ARB_fragment_coord_conventions GL_ARB_fragment_program GL_ARB_fragment_program_shadow GL_ARB_fragment_shader GL_ARB_framebuffer_object GL_ARB_framebuffer_sRGB GL_ARB_geometry_shader4 GL_ARB_get_program_binary GL_ARB_gpu_shader5 GL_ARB_gpu_shader_fp64 GL_ARB_half_float_pixel GL_ARB_half_float_vertex GL_ARB_imaging GL_ARB_instanced_arrays GL_ARB_internalformat_query GL_ARB_map_buffer_alignment GL_ARB_map_buffer_range GL_ARB_multisample GL_ARB_multitexture GL_ARB_occlusion_query GL_ARB_occlusion_query2 GL_ARB_pixel_buffer_object GL_ARB_point_parameters GL_ARB_point_sprite GL_ARB_provoking_vertex GL_ARB_sample_shading GL_ARB_sampler_objects GL_ARB_seamless_cube_map GL_ARB_separate_shader_objects GL_ARB_shader_atomic_counters GL_ARB_shader_bit_encoding GL_ARB_shader_image_load_store GL_ARB_shader_objects GL_ARB_shader_precision GL_ARB_shader_stencil_export GL_ARB_shader_subroutine GL_ARB_shader_texture_lod GL_ARB_shading_language_100 GL_ARB_shading_language_420pack GL_ARB_shading_language_packing GL_ARB_shadow GL_ARB_shadow_ambient GL_ARB_sync GL_ARB_tessellation_shader GL_ARB_texture_border_clamp GL_ARB_texture_buffer_object GL_ARB_texture_buffer_object_rgb32 GL_ARB_texture_compression GL_ARB_texture_compression_bptc GL_ARB_texture_compression_rgtc GL_ARB_texture_cube_map GL_ARB_texture_cube_map_array GL_ARB_texture_env_add GL_ARB_texture_env_combine GL_ARB_texture_env_crossbar GL_ARB_texture_env_dot3 GL_ARB_texture_float GL_ARB_texture_gather GL_ARB_texture_mirrored_repeat GL_ARB_texture_multisample GL_ARB_texture_non_power_of_two GL_ARB_texture_query_lod GL_ARB_texture_rectangle GL_ARB_texture_rg GL_ARB_texture_rgb10_a2ui GL_ARB_texture_snorm GL_ARB_texture_storage GL_ARB_timer_query GL_ARB_transform_feedback2 GL_ARB_transform_feedback3 GL_ARB_transform_feedback_instanced GL_ARB_transpose_matrix GL_ARB_uniform_buffer_object GL_ARB_vertex_array_bgra GL_ARB_vertex_array_object GL_ARB_vertex_attrib_64bit GL_ARB_vertex_buffer_object GL_ARB_vertex_program GL_ARB_vertex_shader GL_ARB_vertex_type_2_10_10_10_rev GL_ARB_viewport_array GL_ARB_window_pos GL_ATI_draw_buffers GL_ATI_envmap_bumpmap GL_ATI_fragment_shader GL_ATI_meminfo GL_ATI_separate_stencil GL_ATI_texture_compression_3dc GL_ATI_texture_env_combine3 GL_ATI_texture_float GL_ATI_texture_mirror_once GL_EXT_abgr GL_EXT_bgra GL_EXT_bindable_uniform GL_EXT_blend_color GL_EXT_blend_equation_separate GL_EXT_blend_func_separate GL_EXT_blend_minmax GL_EXT_blend_subtract GL_EXT_compiled_vertex_array GL_EXT_copy_buffer GL_EXT_copy_texture GL_EXT_depth_bounds_test GL_EXT_direct_state_access GL_EXT_draw_buffers2 GL_EXT_draw_instanced GL_EXT_draw_range_elements GL_EXT_fog_coord GL_EXT_framebuffer_blit GL_EXT_framebuffer_multisample GL_EXT_framebuffer_object GL_EXT_framebuffer_sRGB GL_EXT_geometry_shader4 GL_EXT_gpu_program_parameters GL_EXT_gpu_shader4 GL_EXT_histogram GL_EXT_multi_draw_arrays GL_EXT_packed_depth_stencil GL_EXT_packed_float GL_EXT_packed_pixels GL_EXT_pixel_buffer_object GL_EXT_point_parameters GL_EXT_provoking_vertex GL_EXT_rescale_normal GL_EXT_secondary_color GL_EXT_separate_specular_color GL_EXT_shader_image_load_store GL_EXT_shadow_funcs GL_EXT_stencil_wrap GL_EXT_subtexture GL_EXT_texgen_reflection GL_EXT_texture3D GL_EXT_texture_array GL_EXT_texture_buffer_object GL_EXT_texture_compression_bptc GL_EXT_texture_compression_latc GL_EXT_texture_compression_rgtc GL_EXT_texture_compression_s3tc GL_EXT_texture_cube_map GL_EXT_texture_edge_clamp GL_EXT_texture_env_add GL_EXT_texture_env_combine GL_EXT_texture_env_dot3 GL_EXT_texture_filter_anisotropic GL_EXT_texture_integer GL_EXT_texture_lod GL_EXT_texture_lod_bias GL_EXT_texture_mirror_clamp GL_EXT_texture_object GL_EXT_texture_rectangle GL_EXT_texture_sRGB GL_EXT_texture_sRGB_decode GL_EXT_texture_shared_exponent GL_EXT_texture_snorm GL_EXT_texture_storage GL_EXT_texture_swizzle GL_EXT_timer_query GL_EXT_transform_feedback GL_EXT_vertex_array GL_EXT_vertex_array_bgra GL_EXT_vertex_attrib_64bit GL_IBM_texture_mirrored_repeat GL_KTX_buffer_region GL_NV_blend_square GL_NV_conditional_render GL_NV_copy_depth_to_color GL_NV_copy_image GL_NV_explicit_multisample GL_NV_float_buffer GL_NV_half_float GL_NV_primitive_restart GL_NV_texgen_reflection GL_NV_texture_barrier GL_SGIS_generate_mipmap GL_SGIS_texture_edge_clamp GL_SGIS_texture_lod GL_SUN_multi_draw_arrays GL_WIN_swap_hint WGL_EXT_swap_control 00:00:02.893987 OpenGL Info: Render SPU: GL_MAX_VERTEX_UNIFORM_COMPONENTS_ARB=1024 00:00:02.894000 OpenGL Info: Cfg: u32Caps(0xf), fVisualBitsDefault(0x23) 00:00:02.894635 Shared crOpenGL service loaded.

3D works I have no problems in other applications.

FRG

[sunlover]

frg, please try latest VBox build:

https://www.virtualbox.org/download/testcase/VirtualBox-4.3.17-96426-Win.exe

[frg]

Sorry, made no difference. Still broken.

[frg]

4.3.17-96486 broken too but did output some additional error messages. It looks like the troublesome hardening routines are the culprit. Could you please either fix this or put a switch in to disable them.

00:00:04.157856 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll: Not signed.
00:00:04.158217 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.210462 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=1 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.210521 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.210628 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=2 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.210662 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.210762 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=3 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.210797 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.210895 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=4 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.210929 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.211027 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=5 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.211061 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.211159 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=6 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.211192 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.211289 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=7 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.211366 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.211468 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=8 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.211502 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.212146 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=16 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.212181 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.213342 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=32 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.213377 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.216055 supR3HardenedErrorV: supR3HardenedScreenImage/LdrLoadDll: cached rc=VERR_LDRVI_NOT_SIGNED fImage=1 fProtect=0x0 fAccess=0x0 cErrorHits=64 \Device\HarddiskVolume4\WINDOWS\system32\atio6axx.dll
00:00:04.216090 supR3HardenedErrorV: supR3HardenedMonitor_LdrLoadDll: rejecting 'D:\WINDOWS\system32\atio6axx.dll': rcNt=0xc0000190
00:00:04.221555 OpenGL Info: Render SPU: GL_VENDOR:   Microsoft Corporation
00:00:04.221566 OpenGL Info: Render SPU: GL_RENDERER: GDI Generic
00:00:04.221572 OpenGL Info: Render SPU: GL_VERSION:  1.1.0
00:00:04.221577 OpenGL Info: Render SPU: GL_EXTENSIONS: GL_WIN_swap_hint GL_EXT_bgra GL_EXT_paletted_texture
00:00:04.223087 OpenGL Info: Cfg: u32Caps(0x1f), fVisualBitsDefault(0x23)
00:00:04.223198 Shared crOpenGL service loaded.

[galitsyn]

Re to your ​post on forums.

Unsigned drivers cannot be loaded on 64bit Windows host. Therefore, host was not using the drivers you have installed. That is where the log messages from comment 1 came from.

I take this issue as invalid.

[frg]

Sorry but you are wrong. This is not Windows Vista / 7 x64. The issue is valid and Virtualbox broken!

[frg]

Allow unsigned drivers

[frg]

And for what's it worth. My LSI SATA, latest Intel network and alot of other drivers are unsigned and work fine.

[bird]

You are right, comment 6 is wrong. A couple of questions that would help fix this:

1. I need the VBoxStartup.log file for this session. You'll find it next to the VBox.log file.
2. Which version of the ATI drivers are these? Did you download them from AMD/ATI? (I'm asking because I downloaded the latest XP drivers from AMD and while the atio6axx.dll file was not signed directly, the associated catalog file was signed correctly and it should be installed on your system. Maybe VBoxStartup.log will shed some more light on that.)

[frg]

I did download the drivers directly from AMD. It might be the missing WHQL signature which causes this. Even with the 4.3.17 network drivers I get the warning message and they show up as unsigned afterwards.

I will upload the los in a minute.

Thanks for taking the time trying to fix this.

FRG

[frg]

vbox.log corresponding to vboxstartup.zip

[bird]

Thanks. Unfortunately, I don't have any ati/amd graphics chip on a box old enough for XP or XP64, so it's a bit difficult to be sure here. But it seems the problem is that XP doesn't catalog 3rd party stuff in c:\windows\system32\catroot[2] like more recent systems seems to be doing. Since the atio6axx.dll is part of a driver, there is a signed catalog file for it installed under c:\windows\system32\drvstore, but the catalog api doesn't look there.

I'll see what I can do to deal with this. Might take a few days unless there is a simple solution...

[bird]

I've made a shot at a workaround. Would be great if you could try out https://www.virtualbox.org/download/testcase/VirtualBox-4.3.17-96501-Win.exe in the next few hours. (If you don't have time, just download 4.3.18 which will probably be out by then.)

Cheers,

bird.

[frg]

Seems to work. Big thanks.

FRG