visionOS’s major update, the “space character image” in the promotional video is finally here!

As early as last year, Apple announced to the media that it was developing a “Spatial Persona” feature. Today, the sci-fi and cool-looking "Space Character" beta version finally comes to Vision Pro through visionOS 1.1.

▲(Video source: Apple official website)

To use this function, you only need to use its Lidar sensor to scan your head to quickly generate your avatar. Of course, the premise is that you need to have a Vision Pro device.

Then, when using this function, Vision Pro will detect your eyes, facial expressions and hand movements in real time, and make synchronous mapping on the avatar.

(Source: Apple official website)

The previous "Persona" function could only display the expressions of the shoulders, neck and face. Although the characters it shows have a certain depth and volume, and occasionally feel like they are talking face to face, because the characters' images are limited to a window, the sense of alienation is actually quite obvious.

(Source: Apple official website)

The current "space character image" can further display more body parts and reflect richer gestures, movements and body language. And the characters it displays do not have any window restrictions. The new "space characters" are presented in a three-dimensional form. Through spatial calculation, the characters appear in the space in front of you in a more realistic form.

▲ (Source: Apple official website)

In the past, making a video call through Vision Pro was more like a regular 3D video chat. Now, with the arrival of "space characters", this process is more like chatting with friends in the same room, and the sense of presence is greatly enhanced.

Apple also released a "Spatial Character" development guide on its official website, providing developers with three "Spatial Character" positioning templates: Side-By-Side, Surround, and Conversational. ), can support 2-5 people.

(Source: Apple Developer Official Website)

"Spatial Characters" also supports context sharing to achieve spatial consistency and visual consistency. In a spatial conversation scenario, everyone can share their relative position to each other instead of static communication.

For example, in a spatial session, if User A points with his left hand to User B, who is to his left, everyone else will see this action. Of course, User B can also see User A's pointing from his right side, and the whole process is very realistic and natural.

(Source: Apple Developer Official Website)

Regarding sharing, the actions taken by each user and the content they see are synchronized. Both visually and audibly, everyone can hear the same sounds from the same direction and see the same objects from their own perspectives. Through the simulcast sharing function, we can use many applications with friends for an immersive experience.

▲(Picture source: Apple developer official website)

Apple mentioned that the team is currently actively optimizing this feature, and in future visionOS updates, “character images” will become more realistic. In the latest VisionOS 1.1 version, the system requires users to rescan the character image. Some users have reported that the "character image" effect has been significantly improved after the update.

▲ (visionOS 1.0 version “character image” effect. Source: X user Zach Smith)

▲ (visionOS 1.1 version “character image” effect. Source: X user Zach Smith)

The "Spatial Character" function takes the Vision Pro spatial computing experience a step further. As the first batch of Vision Pro users to try it out, they will also get a "commonly used and always new" experience with the continuous improvement of visionOS.

# Welcome to follow the official WeChat public account of Aifaner: Aifaner (WeChat ID: ifanr). More exciting content will be provided to you as soon as possible.

Ai Faner | Original link · View comments · Sina Weibo