This is not the nicest behaviour but trying to keep both bullet and blender side objects in sync breaks in this case. There might be a better soluion but this avoids crashes for now. Fixes: [#35995] Delete crash on specific scene (Physics)