All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad, sallallaahu ‘alayhi wa sallam, is His Slave and Messenger.
If your work in this café shop is lawful, then it is permissible in principle, because Allaah The Almighty says (what means): {But Allaah has permitted trade and has forbidden interest.}[Quran 2:275] Sometimes, a lawful act may involve something that makes it unlawful, and talking with non-Mahram women freely without abiding by the Islamic rules is not permissible and leads to temptation.
Therefore, if this work requires doing prohibited acts, you are not permitted to continue in it because it is not permissible for the Muslim to relinquish any part of his religion in order to please people or for fear of their mockery. A believer may hardly be safe from such mockery; Allaah The Almighty says (what means): {Indeed, those who committed crimes used to laugh at those who believed. And when they passed by them, they would exchange derisive glances. And when they returned to their people, they would return jesting.}[Quran 85:29-31]
In fact, a Muslim's adherence to his religion before such people better influences them. They may be pleased with you when you agree with them, but this will not make you have any effect on them.
Finally, we advise you to look for another job away from doubtful matters, and when you fear Allaah, He will facilitate that for you. Allaah The Almighty says (what means): {And whoever fears Allaah - He will make for him a way out. And will provide for him from where he does not expect.}[Quran 65:2-3] The Prophet, sallallaahu ‘alayhi wa sallam, said: "You will never quit something out of fearing Allaah The Almighty but He will give you something better than it." [Ahmad]
Allaah Knows best.