Will it be difficult to travel to Europe if I only speak English?

There are some, because in Switzerland, English is not among the three official languages. The Nordic countries are relatively better, but English is basically not spoken. Even if your English is pretty good... You can see a lot of advertisements for English training schools on the streets in France and Germany, which also shows that many Europeans don't know much English.