All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger. We ask Allaah to exalt his mention as well as that of his family and all his companions.
We have not come across any specific Prophetic narration which could be said to remove the bad thoughts of other people about a person. Nonetheless, you may say a general supplication and say for instance: "O Allaah! Take away the bad thought of others about be, and make them mention me in a good way, you are the Lord of The Worlds.", and the like. You may also supplicate with the supplication of the Prophet Ibraaheem (Abraham) Allaah Says (what means): {And grant me a mention [i.e. reputation] of honour among later generations.}[Quran 26:84].
You should follow the footsteps of righteous people and keep company with pious women and avoid places of doubt and suspicion, and avoid keeping company with dissolute women.
Allaah Knows best.