If hackers do search engines and don't follow the robots protocol, wouldn't the world be over?

The robot agreement is like traveling to a scenic spot. Some of them say that the scenic spot is temporarily closed and tourists cannot enter such a scenic spot. Similarly, the sign of this pause is the robots agreement, and this tourist refers to the search engine.

If thieves or bad guys, or people who don't follow the rules, ignore the warning of the suspension of opening and forcibly enter the scenic spots that are suspended, it is also possible to enter. If the hacker is a search engine, it is normal not to follow the robots protocol. But the world will not be destroyed.

Robots protocol is a warning to search engines. Search engines are not allowed to enter, but ordinary users can see what search engines are not allowed to see when they open a website, such as robots in Taobao, but ordinary users can freely enter Taobao and buy what they like in Taobao, which search engines can't see at all.

Robot protocol is a ban on search engines. Some people say that robots can protect private secrets, which is completely nonsense. Since you put your things on the website, you just want someone to see them and browse them. Unless you don't need the traffic brought by a search engine like Taobao, you can maximize the brand effect of Taobao. If the user information of the website is afraid of being leaked to the search engine, it is also nonsense. Don't take the search engine as a god, it's just a child. Search engines crawl in the form of web pages, unless you make user information into a web page and put it on the website, it won't.

Baidu said that 360 violated the robots agreement because 360 grabbed Baidu's webpage content, and Baidu robots dropped by 360. 360 was not allowed to grab Baidu's content, but 360 still grabbed it. I think that's all. The so-called user experience and security are bullshit and excuses. If you can't find something to say, you dare to say anything.

Robot is an agreement, which can be observed or not, just like suspending opening. Government officials are going in. Can we pause? Just like giving your seat to an old man on a bus, you can give your seat or not. Giving up your seat is a virtue. You can answer or not, it has nothing to do with your quality. But social pressure and the government force you to give up your seat, then they are against your own will, they are shameless, and they are more morally corrupt than those who are morally corrupt.