Don't load the buffer location if we are clearing the whole buffer, and never
load the texture location (for Vulkan; GL already did this). Only prepare them
instead.