What is the use of proxy IP? What is this for?

Python crawler is a detection machine. Its basic operation is to simulate human behavior, go to various websites and recite the information it sees. Like a bug crawling around the building tirelessly.

Classification of HTTP proxy

According to the degree of anonymity of proxy ip, proxy IP can be divided into the following four categories:

Transparent proxy: You can "hide" your ip address directly, but you can still find out who you are.

Anonymous proxy: Anonymous proxy is better than transparent proxy. People can only know that you used an agent, but they can't know who you are.

Confused proxy: Like anonymous proxy, if you use confused proxy, others can still know that you are using proxy, but you will get a fake IP address, which is more authentic.

High-density agent: It can be seen that high-density agent makes it impossible for others to find out that you are using an agent, so it is the best choice.

In terms of use, there is no doubt that using stealth agents is the best.

Moreover, it is not enough to use only one or two chemicals when carrying out a large number of reptiles. The ip must be shielded, and it is impossible to continue to capture data, so a large number of high stealth IPS are needed.

The difference between HTTP and HTTPS

Http is a very common application layer protocol, which is the abbreviation of hypertext transfer protocol. The content it transmits is plaintext.

HTTP is an http protocol running on top of TCP. The transmitted content is plain text, and neither the client nor the server can verify the identity of the other party.