Invariance of Characteristic Polynomials Under Conjugation