This was caused by a missing prepass. Only early out if drawing the prepass, otherwise, run all checks. This is much safer.