apply the other change in each matrix entry
