In principle the GL driver also checks the location, but it turns out to be
slightly faster to do it ourselves.