All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger.
Compulsive feelings that your ‘Awrah is not covered are something that you should not pay attention to if you are sure that it is covered. But if you are sure that it is not covered, you should cover it immediately. Your prayer is not then invalidated by you pulling down your shirt or shorts to cover your ‘Awrah; however, you should try to repel these compulsions and not get carried away with them so that they do not cause you difficulty or much evil.
For more benefit, please refer to Fatwa 3882.
Allaah Knows best.