All perfect praise be to Allaah, the Lord of the worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad, sallallaahu ‘alayhi wa sallam, is His slave and messenger.
Recording angels stay with a person all the time and never leave him, whether the person is a Muslim or a disbeliever, ritually pure or impure.
However, the angels that do leave a person in the state of ritual impurity are the angels of mercy. In a Hadeeth on the authority of ‘Ammaar Ibn Yaasir the Prophet mentioned that there are three types of people that angels do not approach, among whom is the person who is in the state of ritual impurity until he performs ablution. [Abu Daawood]
Shams Al-Haq Al-Aabaadi stated that these angels are those who descend with mercy and blessings on the children of Aadam. They are not the recording angels because they never leave a person.
Allaah Knows best.