"People I don't agree with" and "Nazis" aren't the same people. I sympathize with people who have lives that lead them down the path to that, but once they've committed themselves to Nazism and start saluting in the street, then there's no more sympathy.
To be clear, you can come back from a lot of shitty beliefs. I have. But I also didn't march in white pride parades with swastikas. I'm not talking about run of the mill conservatives.
I got banned from a regular sub on Reddit for saying it's ok to punch Nazis. How refreshing.