His racism led to policies that harmed or killed or upended the lives of hundreds of thousands of people on the basis of their race, across multiple racial groups. I really don't care whether he said the N word, and I don't know how anyone could imagine he didn't.
just like the SA