Talking about VR input technology, what are the local dynamic capture solutions?

Beijing Sheng Di Digital Entertainment Technology Co., Ltd. (hereinafter referred to as Sheng Di Company) and British Vicon Company jointly held a new product launch conference in Beijing, and the two sides jointly released a brand-new motion capture software shogun.

There are many cases of cooperation between the two parties, such as: 1999, the first set of Vicon 8 system was introduced into China market; In 2000, the world's first megapixel motion capture camera was released, and Weikang Mcam was selected by CCTV and Shanghai TV. 20 16 released Weikang Broadcasting to provide an optical tracking solution for the virtual studio, and Hunan Radio and Television led the technological innovation of China Radio and Television Virtual Studio.

At the subsequent press conference, Ding Qiongqiong introduced the company's existing services: motion capture, whole body capture, hand and finger capture, props capture, animal capture, high-precision facial expression capture, On location capture spatial positioning tracking, virtual camera system tracking and preview, virtual camera tracking and real-time preview, optical tracking of virtual studio tracking, virtual stage Pre-Viz digital virtual studio, virtual human interaction, R & Custom development.

The most important part of the conference was the release of the new shogunate software, and a comprehensive demonstration was also conducted on the spot.

Alexander Muir, Asia-Pacific manager of Weikang Company, first made a ROM, and the system automatically recognized his body and bones. Then he made a set of motion range (the maximum range that all parts of a limb can move) system to calibrate joint motion in real time. In this process, you can see that all joints are changing their positions in real time. There are also two live cameras Vue, which can combine the real scene with the character animation calculated by other motion capture cameras.

At the scene, martial arts instructor He Yajie also had a simulated fight with Alexander, the Asia-Pacific manager of Weikang. Weikang experts said that in the simulated fighting action capture just seen, in the previous action capture workflow, it is necessary to reconstruct a data before you can see the actual body and bone effect. In the new shogunate, the software is divided into two parts: live broadcast and later stage.

Weikang experts mentioned at the scene that the camera had been moved. If it is necessary to recalibrate all cameras in the previous software workflow to correct this problem, the shogunate can correct this problem. As long as you press the recalibrate camera button, someone will go to the camera to recalibrate. Shogun generals can convert data into unreal systems in real time.

Subsequently, Weikang's expert team made a game scene in advance, and then Sheng Di entertained Han Mukun, and martial arts instructor He Yajie gave a fighting demonstration in this game scene. After putting the just-recorded fighting process into shogunate Live, the mcp file is recorded in real time, and Max directly imports the modified file into shogunate Post to review the actor's performance animation just captured. In other words, there is no need to stop real-time recording and reconstruct the original data of the captured clip.

Weikang experts said that this function can save a lot of time for directors and actors in a complex studio environment.

Before the fight demonstration, Weikang experts took out a virtual camera with several reflective points attached to it, which could be captured by the camera moving on the spot. The virtual camera can convert the captured real scene into a virtual scene and project it onto the shield.

At this time, Weikang made a solution to what the shogunate could do if it was blocked by a big object. A table was prepared at the scene. He Yajie, an expert in Weikang and a martial arts instructor, got out from under the table, and when most of the reflective spots on his body were blocked, the plan of the shogunate was still very stable, and then the plan of adding a tablecloth to the table was still very stable, just like the situation of drilling a table and blocking it with a tablecloth, the bones would not go wrong.

Weikang experts instantly stood up, and martial arts coach He Yajie, in such a close situation, would have countless reflection points in an invisible state and remained stable. In this case, other motion capture products will definitely lead to bone dislocation and abnormal limb display.

Later, experts from Weikang took a large number of reflection points from Alexander Muir, and after removing the reflection points from his feet and head, his bone solution was still very stable.

After that, Weikang experts put all the reflection points they got on Dixintong Digital Entertainment Han Mukun. When the reflection points increase, they will exceed the previous calibration. When the reflection points are increased, the integrity of the character skeleton can still be maintained, and the integrity of the real-time actor skeleton can still be guaranteed after removing about 70% of the reflection points.

At the end of the meeting, Xiao Yang, product director of Sheng Di Company, and Xia Zipeng, manager of technical service department came to the stage to share the experience of Sheng Di technical team. First of all, Xiao Yang, product technical director, and Xia Zipeng, manager of technical service department, said that common technical point analysis, inter-departmental jitter data processing, Cara combined with pointless face image analysis software, and more accurate finger capture Vicon combined with engine.

Xiao Yang said that China Augmented Reality Industry Alliance (hereinafter referred to as AR Alliance or ARA) needs to consider the key factors in choosing a motion capture system, such as sensor resolution, camera capture speed, data processing software, active calibration stick for calibrating video reference cameras, simple field calibration steps for signal synchronization and triggering, open data interface, development based on practical application feedback from first-line commercial customers, local after-sales technical services and actual project support.