should you divorce after the affair