Texture handling really needs deeper improvement, this fix doesn't really help for other situations like modifiers, but solves the inconvenient case of sculpting with no material at least.