The end goal for this is to lower the number of needed matrices. This also cleanup some uneeded transformation.