Why did Israel refuse to exchange the position of his hands on the two sons of Joseph?

Israel refused because the younger brother would be greater than the first-born.