Facebook tracks your browsing history even if you log out. I suspect Amazon is the same way. Does it bother you to know that these sites can track almost every site you visit? If not, why does it concern you that it can link your account to your wife's.

Clear all cookies between browser sessions.