Was caused by a code which was putting animation value back to original datablock. The tricky part here is that we don't always know ID, so can not put those values. Would be nice to have a solution for this, but for until then we should be relatively good.