The matrix of the rotation gizmo is somewhat confusing. Attaching to the Z axis has more predictable results.