How is the panoramic image of the car displayed? It stands to reason that there should be a camera shooting down from the height of the car, but it is unrealistic!

The 360-degree panoramic image system mainly consists of the following six parts: image acquisition, camera calibration, image transformation, image beautification, seamless image splicing and fusion, and image display. Four super-wide-angle cameras SWVC(Super-Wide-View-Camera) installed in front, back, left and right of the car body are often used to photograph the surroundings of the vehicle. However, due to the phenomenon of "fisheye distortion" in the image after SWVC is adopted, it is necessary to synthesize and correct the image by mathematical algorithm to synthesize a panoramic bird's eye view around the car body, so as to display the real image around the car on the car display screen and avoid the collision danger during driving. Therefore, core algorithms such as camera calibration, image beautification and seamless image mosaic will dominate the whole system.

In the camera internal parameter calibration part, it is considered to make calibration tools instead of manual work, and cooperate with the corresponding algorithm to calibrate the camera. In the calibration of camera external parameters, the traditional calibration method will be broken, and the optimization algorithm of evolutionary computation will be introduced to simplify the calibration process and shorten the calibration time without affecting the calibration accuracy. In the part of image mosaic, because of the difference of imaging systems of different cameras, the imaging of the same time coordinate point will be biased, so the method of registration and re-fusion of related points is abandoned, and the image is spliced and fused directly according to the human visual model by visual transition method.

Expand knowledge:

360-degree panoramic image system, also known as satellite panoramic driving safety system (also known as panoramic auxiliary parking system, panoramic scanning system, panoramic monitoring image system, 360-degree panoramic parking auxiliary system and automobile 360-degree scanning system), collects the images around the vehicle at the same time, and finally forms a panoramic top view of the vehicle on the screen after being processed by a series of intelligent algorithms of the image processing unit, which intuitively presents the position and surrounding conditions of the vehicle. The system greatly expands the driver's perception of the surrounding environment, and makes the driver take his time in dealing with situations such as vehicle starting, turning, parking, meeting in narrow lanes and avoiding obstacles. It can effectively reduce the occurrence of accidents such as scraping, even collision and rolling.

References:

panoramic camera