This was found to be a bottleneck in the file from #144756 which has 235 group inputs and 174 group input nodes, which leads to 40,890 sockets. Most of those are never used, so it's wasteful to add them to the map of input values. The inferencing time improved from 24ms to 16ms. Can likely still be improved more, but that's a good improvement for such a small change already.