All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad, sallallaahu ‘alayhi wa sallam, is His Slave and Messenger.
According to the question, it seems that the questioner is going through difficulty regarding paying the debt. However, the debt cannot be waived as a result of financial hardship, rather it remains a debt that you owe; whenever you can afford to pay it, you should hasten to pay it off. It is not permissible for you to neglect it for it is a confirmed right that cannot be waived by the passage of time.
As for traveling, it is permissible for you to travel along with having the determination to pay off the debt whenever you can afford to pay it from wherever you are with the possible means.
Allaah Knows best.