Transforming e.g. a mesh can invalidate caches like bvh trees. Therefore, if it can be skipped, it should be skipped.