Code was assuming that if an object had a Scene parent ID (in Outliner context), Outliner was in Scene view and object had to be removed from whole scene. However, in ViewLayer view, in case an object is in a Scene's main collection, its parent item is the scene.