How to get started with Python crawler?

It's a good motivation at first, but it may be slower. If you have a project in your hand or mind, you will be driven by the goal in practice, instead of learning slowly like a learning module.

If you want to get started with Python crawler, you need to do a lot of preparation. The first is to be familiar with python programming; The second is to understand HTML；;

Also understand the basic principle of web crawler; Finally, learn to use python crawler library.

If you don't know python, you need to learn python, a very simple language. The basic syntax of a programming language is nothing more than data types, data structures, operators, logical structures, functions, file IO and error handling, which will be boring but not difficult to learn.

In the beginning, you don't even need to learn python's classes, multithreading and modules. Find a textbook or online tutorial for beginners, and you will have a three-point understanding of python basics in about ten days.

The meaning of web crawler:

Web crawler, in fact, can also be called network data collection. It is easier to understand that it requests data (in HTML form) from the network server through programming, and then parses the HTML to extract the data you want.

This will involve database, network server, HTTP protocol, HTML, data science, network security, image processing and so on. But for beginners, you don't need to master so much.