Samsung mobile phone AR

Recently, the popularity of Samsung S9 has climbed, and the biggest selling point of this annual Android flagship is the camera. On the one hand, the front camera adds AR support; On the other hand, the rear camera adds a slow video shooting function of 960 frames per second and supports the adjustable aperture function of F1.5/F2.4..

When it comes to AR, people will naturally compare Samsung S9 with Apple's iPhone X flagship. So in this case, what's the difference between Samsung S9 and Apple iPhone X in AR? Does Samsung S9 also have a built-in depth sensor like iPhone X? Wait a minute, we will know today.

The focus of this comparison is AR. It is undeniable that Samsung S9 has made a heavy upgrade on the rear camera, but this article is more about the ar level of the front camera.

Left: Samsung S9, right: Apple iPhone X.

Let's take a look at the AR function and experience brought by Samsung S9 front camera.

When I first experienced AR emoji on Samsung S9, I was so curious. It turns out that S9 only took a 2D photo when scanning the face. You can also think of it as generating a virtual 3D image through 2D image combination algorithm, instead of directly collecting 3D information from all angles around the scanned face like Apple iPhone X.

Press the shutter, select the gender, and then simply decorate the characters, including facial details, costumes and so on. The whole virtual image creation process can be completed within 10 second at the earliest.

As the author expected, the virtual characters created only by collecting 2D facial photos always feel quite different from their real selves. I asked two friends around me, and they all said they didn't look like themselves.

According to the observation of Qingting. com, the difference between the virtual image presented by S9 and the original character image is due to the limitation of 2D scanning, which is mainly reflected in whether the face is facing the camera, whether it is in the middle, whether it is a little inclined and so on. Otherwise the face will be deformed. In addition, the beard of the character is not ideal to handle.

However, fortunately, it can be made up by later details. Samsung S9 can adjust facial details, face shape, hairstyle, hair color and accessories. For its AR emoji, you can also change clothes. Is a complete virtual big head, similar to the "ego" application.

Disassembly of Samsung S9 front lens, Figure /iFixit

In other words, Samsung S9 basically realizes face tracking through algorithms, which was confirmed after seeing iFixit dismantled. According to iFixit, the front lens module in Samsung S9 mobile phone is composed of iris scanner, front lens, infrared transmitter and distance sensor, and the hardware components are basically the same as the previous generation S8. In other words, Samsung decided to add the front AR function to S9 without updating the hardware of the front module, and naturally did not want to miss this wave.

In terms of gameplay, Samsung S9 has added a series of third-party avatars to its AR emoji, including some Disney IPS. The advantage of this is that it not only increases the interest, but also reduces the problem of big difference between virtual images.

In addition, AR emoji can also be directly made into emoji, which can be shared in information, and can also be directly used for video calls with virtual images. The adaptation of third-party apps is still unclear.

After communicating with the staff of Samsung S9 booth, the author learned that the AR emoji of Samsung S9 focuses on tracking people's eyes, and other details are not disclosed too much.

Apple iPhone X realizes Animoji through the original affectionate lens. It should be noted that the original affectionate lens in iPhone X is not only used for Animoji, but also for Face ID unlocking and portrait mode photography.

The original depth lens consists of infrared lens, floodlight sensor, distance sensor, ambient light sensor, front camera and dot matrix projector. When the original lens works, it will project 30,000 laser spots like a human face and collect a receipt.

Animoji function in iPhone X captures and analyzes more than 50 different muscle movements through the original depth lens module. The tracking range is the whole face, so the natural image is more natural.

However, Apple is very smart. Instead of creating a personal avatar like Samsung ar emoji, it is directly replaced by a cartoon animal image of 12, which also avoids the problem of large deviation of virtual characters and makes the experience better.

If we only compare virtual animal images, in the test, I found that in most cases, S9 and iPhone X have little difference in slow motion, while iPhone X9 performs better in fast motion, and iPhone X moves more smoothly when the side face rotates and the face moves greatly, and the overall details are more in place.

Functionally, Animoji in iPhone X can also be used for information exchange, and even directly record the video of the avatar for sharing. The gameplay is roughly the same as S9.

However, after playing two mobile phones, I actually think that the front AR provided by Samsung S9 is more fun. It feels more like integrating the functions of various third-party apps into the system functions to make the gameplay more interesting. As an ordinary consumer, I am not so concerned about the accuracy of facial recognition. However, if Apple opens a third-party app in front of AR in the future, Animoji believes that it will also form a transcendence situation and the tracking effect will be better.

Front AR without depth camera is not a long-term solution. I believe Samsung has realized this. It is speculated that S 10 will add relevant sensor hardware (let's put it this way for the time being).

In the long run, the development of the mobile phone rear lens ar is much hotter than that of the front lens, and as the mobile phone market is about to enter the era of full screen, the space left for the top frame of the mobile phone is getting smaller and smaller, which also brings great challenges to the hardware design of the mobile phone. On the road of moving AR, there is a long way to go.

Related Q&A: Related Q&A: Is there a particularly fun mobile APP? Nowadays, mobile phones are really becoming more and more practical. Chatting, taking photos, buying food and booking tickets are simply omnipotent. Since we spend most of the day playing mobile phones, let the little cute people collected in this issue accompany you through the long years of playing mobile phones. (16G users said they were upset? )

So let's share some interesting mobile apps with you today. Let's take a look ~

Study hard and make progress every day;

APP name: Netease snail reading

Installation platform: I use Apple system. It's also on Android.

Experience: This mobile phone reading software is really good. All books in the software are read for one hour every day for free. Remember that all types of reading are free for one hour, which is the biggest highlight compared with the same type of software. The software is full of published books, without any messy online novels. APP name: English funny dubbing

Installation platform: Both Apple and Android can be used.

Experience: You can dub movies, speeches, songs, etc. Every time is very short and interesting, so you can practice your spoken English. There are also videos in Chinese. Application name: drops

Installation platform: APP store, free download, paid membership. There is no Android store, so downloading from messy websites is not recommended.

Experience: It is very convenient to recite words and get started in small languages. You can remember words in bits and pieces, but the free version of 10 can only take 5 minutes, and you can only pay if you want to use it at any time? Suitable for beginners of small languages who have no exam requirements and are only interested. APP name: light reading

Installation platform: both Android and Apple.

Experience: A collection of popular content, such as Douban Zhihu Shell, can save a lot of memory space. There is a "photographer" in my heart:

Application name: Snapseed

Installation platform: IOS system. Android also has it.

Experience: As a Photoshop user for many years, it is the first time for me to introduce this software. The reason is very simple, it is convenient and fast to use, and its function is very close to ps. There are many adjustable parameters, and the interaction is very good, and the use experience is very good.

At the same time, the page is concise, with few advertisements, which is very refreshing. For the little princess who likes to use filters, there are many choices of filters, especially the push film series and the black and white series, which are very unique and rich in colors.

This software can also brighten the face alone, and it is also very friendly to beautiful girls who like to repair portraits. Basically, the software for retouching can be done at ordinary times, and it is the first one. Before and after retouching

Application name: PicsArt

Installation platform: I use the IOS system. Android can also be downloaded.

Experience: It's amazing just to watch. Better than the first snapseed upstairs. The function is very complete. Stickers, filters and photo frames are all available, and the parameters can be carefully adjusted. It is rare that these functions are still very easy to use.

The reason why it was not promoted first is mainly because there are too many functions. In fact, it feels a bit complicated, not as simple as snapseed, and there will be advertisements. This is not good.

But there are two things I particularly like. One is its magic filter series, which is particularly magical and has a good effect. In addition, this software can draw pictures. Like drawing software, it is very convenient to simply record and draw pictures at will.

In short, if you are not afraid of trouble, you can actually do everything with this software. Lazy people like me prefer snapseed retouching PicsArt and reprocessing. Application name: Prisma

Installation platform: both IOS and Android can be used.

Experience: The software of artificial intelligence recognizing pictures that once swept the network has many wonderful effects and accurate recognition. I find it interesting to look at my personal preferences, and I have a good grasp of many topics. Application name: ENLIGHT

Installation platform: IOS, the price is as follows. The Android use store is not available for the time being, so it is not recommended that you download it from a messy website.

Experience: Very powerful picture editing software, tall filters, many kinds. P picture looks comfortable and has the ability to turn decay into magic.

It can select the target and adjust the intensity of the filter locally, so that you can filter half the picture deeper, half the picture lighter, and even use different filters for a picture.

Especially suitable for processing landscape photos. Different filters have been added to the landscape photos, and even there is a feeling of seasonal change, and the picture looks natural. I already feel that it is a bit lacking to describe its powerful functions in words. 25 yuan is worth it.

You may need to explore it yourself in the early stage, and it has many functions. Some filters are suitable for portraits, while others are more suitable for landscapes. You also need to adjust your own practice, and it is easy to have a sense of blockbuster after you are familiar with it. Application name: black

Installation platform: IOS, free of charge. The Android Store is temporarily unavailable, so it is not recommended that you download and install it from a messy website.

Experience: photo editor, dedicated to editing black and white photos. The edited black and white photos all look very advanced and textured.

It's full of black and white filters. A * * * has 1 1 filters. I think it is a must-have filter APP.

You can also adjust the scope and degree of adding filters by yourself. But there is a charge. APP name: a word

Installation platform: iOS system, free of charge. The Android use store is not available for the time being, so it is not recommended that you download it from a messy website.

Experience: You can choose a picture, add the title author and content, and then you can generate a bookmark-like picture. It can be used to record your epiphany and your daily life. Especially suitable for sending friends, or making mobile phone wallpaper or something. APP name: VSCO

Installation platform: Android and ios systems are available, free of charge, and there are several tiger balm filters, but there is a charge for extending the filters inside.

Experience: an APP that adds filters to pictures. I just use it to add filters to adjust the tone of pictures, and other functions have not been developed. I basically send pictures, take photos, fix portraits with Meitu software, then add filters with VSCO, and then release them. ...

I just downloaded several filters and found them very useful. I can buy more filters if necessary. There are 120+ different filters, and I have to try them all every time I change them. It's very tiring for me.