Avoid calling `modify_geometry_sets` because this can potentially result in additional data copies when the geometry references the final mesh of other objects. For more details, see https://projects.blender.org/blender/blender/issues/119938#issuecomment-1155109. This implements a special case to avoid the regression until e.g. #119968 is done. Pull Request: https://projects.blender.org/blender/blender/pulls/120177