Because I can’t date anyone, I have to travel alone, but are you afraid of being misunderstood as a person with no friends?

Once you have made your decision, don’t think about other things. Sometimes traveling alone is nice and free. You can go wherever you want and do whatever you want. Just because you can't date someone doesn't necessarily mean you're not popular. It could be that the other person really can't spare the time, or it could be that no one else is interested in the place you want to go. This has little to do with popularity.