Very intuitive -- not.

How to remove old / incorrect email address suggestions from MS Outlook.

Edit: The MS Knowledge Base went away. Sheesh. Here's the alternate solution.