Your story is little bit like in the hindi Silsila (1980) after the part when Amitabh discovers that his wife is pregnant with this baby, he ends the passionate affair with Rekha abruptly. Beings married with a kid should change the ball game entirely. Stopping to fool around should be a good step. My honest opinion.:)