All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger. We ask Allaah to exalt his mention as well as that of his family and all his companions.
It seems that the statement of this man to his wife 'Why don't you break [the relationship] and leave?' is a metaphor in giving her a choice for divorce. But as she kept silent then this does not imply anything and it does not affect the validity of marriage.
Finally, it should be noted that:
1) One should avoid getting angry and should act according to the advice of the Prophet . One of the companions asked the Prophet: 'Advice me'. The Prophet replied: "Do not get angry''. The man repeated the request several times and each time the Prophet responded in the same way: "Do not get angry." [Al-Bukhari]
2) One should be keen in fulfilling all what would help stabilize marital life, like mutual understanding and having good social relations, and avoiding things that could break up marriage.
Allaah knows best.