Do not compute temp helper data when we do not need it (even though in that case it was totally cheap to compute).