The problem was the automatic instance deduplication. There were two instance references before baking, both of which were referenced by instances. When loading the bake, they were deduplicated, so there was only one geometry, but the instances still referenced two. The fix is to not do deduplication when loading instances from a bake.