I really respect people who edit comments to acknowledge when they're wrong, but leave the original mistake intact (but usually strike through). Like this:
~~I delete my comments when I'm proven wrong because it's embarassing and I don't want to perpetuate misinformation~~
Actually, I'm leaving my mistake up, because then people can follow the conversation easier and see how I came to realise I was wrong