We will need them in buffers for Vulkan, as well as for software
vertex shaders. Currently we simply store them in sysmem buffers and
read directly back out of them to load GL uniforms.

This does decrease memory usage a bit for d3d10+.