Dialogue between Characters in Riverside Scene at Qingming Festival

China's traditional culture can be passed down to this day, thanks to the literary classics of the Ganges. Philosophy, history, religion, literature, customs, textual research, ethics ... Five thousand years of Chinese studies are not all-inclusive, but they are all-inclusive, and the historical process of ancient and modern times and the flexibility of human feelings cannot be found along the deep ditch of words.

The ancients said that and while one man guards it and thousands of books, why not stay in the southern hundred cities. Books can be mirrors, wise and pleasant. Every document and ancient prose is a precious cultural heritage. The purpose of this column is to talk about ancient prose and discuss the present. Whether it is a poem, a poem, a poem or a song, we always believe that under the agitation of modern civilization, there is always some ancient wisdom and spirit in everyone's heart.

"Go to the river ..." Donkey shouted loudly, breaking through the silence in the suburbs and bringing people into the Riverside Scene at Qingming Festival written by Zhang Zeduan in the Northern Song Dynasty. The hoofbeat of the donkey is getting closer and closer, birds are singing and dogs are barking, and Niu Jiao is coming from the depths of Yuan Ye. The old woman called the chicken to feed, which kicked off a hard day. Up the river, the rushing sound of water, the boatman's paddle, the porter's horn, the yo-yo of carrying laborers and the noise of hotels by the river constitute a multi-movement symphony around the Bianhe River. ...

The above scene is not the dream of modern people returning to the capital of song dynasty, but a wonderful fragment of the immersive digital audio-visual exhibition project of Riverside Scene at Qingming Festival. On June 23rd, the Palace Museum, Microsoft Research Asia and Peking University held a release ceremony in the Palace Museum, announcing the official completion of the immersive digital audio-visual exhibition project Riverside Scene at Qingming Festival jointly developed by the three parties. In the future, with the help of this innovative multimedia display platform, the audience can watch and listen to the Qingming Riverside Map in the Painting and Calligraphy Museum of the Palace Museum and appreciate the life of the people in the capital of the Northern Song Dynasty more than 900 years ago.

Digital technology reproduces rare treasures

What is "immersion"? According to Xu Yingqing, a researcher in charge of Microsoft Research Asia, the word "immersion" not only represents a way of artistic appreciation, but also summarizes the digital technology contained in the project.

The immersive digital audio-visual exhibition project of Riverside Scene at Qingming Festival uses gigabit high-resolution clear digital images to reproduce all the details of the original work to the greatest extent on a 63-inch screen that basically covers the audience's perspective. According to the plot of the scroll, 54 scenes were arranged, and more than 700 dialogues were simulated and designed according to the research results of cultural relics experts. 5. 1 channel outputs real-time synthesized scene sound effects and beautiful music, which accurately reproduces the spatial relationship of the picture. Through the most natural human-computer interaction, the audience can operate on the multi-touch screen according to their own interests and watch any details of the picture. With the change of the position of the picture, all kinds of sounds smoothly transition, and the realistic three-dimensional environment makes the audience feel as if they are in a picture scroll, rubbing arms with the Song people, listening to the noise of the streets and people's stories, enjoying the magnificent scenery of the ancient capital and experiencing the feeling of "painting people".

"In fact, virtual reality is also a kind of immersion, but audiences often need to wear special helmets and gloves to experience it, including the movie Avatar. Our immersive digital audio-visual exhibition project hopes not to add any burden to users and try to make them feel in the most natural way. " Xu Yingqing said.

When the audience clicks on the touch screen, the scrolling of the system display will slowly unfold from right to left, and the concert of Riverside Scene at Qingming Festival will begin gradually ... With the support of Microsoft Research Asia and Peking University's advanced digital technology, it is essential to create such an "immersive" painting viewing scene. At the project conference, Li Ji, executive vice president of the Palace Museum, pointed out that the technical team of the project developed an original three-dimensional layout restoration algorithm and virtual environment organization method according to the spatial modeling characteristics of scattered perspective of Riverside Scene at Qingming Festival, which created a new idea for the digital reproduction of traditional paintings in China.

Xu Yingqing is quite proud of this research result. "As far as I know, we should be the first to try this method on the subject of geometric reconstruction based on scattering perspective." Xu Yingqing said, "Moreover, such a system is not only designed for the riverside scene at Qingming Festival, but also can be used in Chinese painting. At the same time, this kind of thinking and method of solving problems is also very enlightening for interpreting some modernist art that also does not follow the traditional geometric perspective law, such as Picasso's works. "

Cultural heritage inheritance opens a new chapter

"What is the difference between the immersive digital audio-visual exhibition project of Riverside Scene at Qingming Festival and the electronic dynamic version of Riverside Scene at Qingming Festival at Shanghai World Expo?" A reporter asked during a system demonstration at the Chonglou Digital Experience Hall in the southwest of the Forbidden City.

Hu Chui, director of the data and information center of the Palace Museum, explained: "The Shanghai World Expo used the creativity of modern people to make the ancient scene of the Riverside Scene at Qingming Festival move. This is a modern interpretation. Our project is to create a virtual environment on the basis of the audience browsing the digital images completely faithful to the original painting, so that the audience can understand the cultural connotation conveyed by The Riverside Scene at Qingming Festival while reading the original painting. We museum people will not use digital technology to change the original appearance of cultural relics, nor will we impose the feelings of modern people on the audience, which is in line with the significance of the museum itself. "

In addition to the newly released immersive digital audio-visual exhibition project of The Riverside Scene at Qingming Festival, the Palace Museum has put more than ten digital achievements of cultural heritage into operation, including the series of immersive virtual reality programs of The Palace of the Imperial Palace in cooperation with Japan Relief Co., Ltd., the electronic gallery with precious paintings in the courtyard, and the digital display system of ancient ceramics research achievements.

"After all, the form of the museum was formed more than 100 years ago, and children born in the information age grew up in front of electronic screens and have become accustomed to acquiring knowledge in a digital way." Hu Chui said that in order to let more young people visit and study, they tried to build a digital platform for cultural display, just to adapt to the appreciation way of these "digital aborigines". "If such digital projects can stimulate their impulse to learn traditional culture, maybe they can turn an ordinary audience into a Chinese painting lover and a lover into a scholar who studies cultural heritage." Hu Chui said with a smile.

Xu Yingqing from Microsoft feels that he has benefited a lot: "It is actually very interesting for people who study engineering to cooperate with people who study art. Through this project, we not only achieved technical breakthroughs such as geometric reconstruction based on scattered perspective, but also learned a lot about artistic presentation. For example, I know now that there is actually a so-called' Riverside Scene at Qingming Festival' in academic circles. I only knew that there was a dream of red mansions. "

Insiders also said that the ancient cultural heritage not only needs to be protected and passed down, but also should serve the audience with novel exhibition forms and brand-new technical means. The digital platform for the cultural display of the Forbidden City, represented by the immersive digital audio-visual exhibition of The Riverside Scene at Qingming Festival, is such a beneficial attempt, which also opens a new chapter for the future protection of cultural heritage in China and even the world.

Thank you. I hope to get this ticket.