After spending an afternoon browsing Taobao with Vision Pro, I discovered a very new way of online shopping.

What will online shopping look like in the future?

You can see the 3D display of the product without leaving home; not only can you enlarge the product to see the details, but you can also restore the 1:1 real ratio and place it in any corner of the room to see if the size is suitable; you can even use the virtual model of the rough house With piles of furniture, you can determine the decoration style of your new home before decorating it.

This all looks cool, but it always feels far away from us.

Now, Taobao has settled on the visionOS platform, bringing these distant scenes into reality.

Taobao × AVP, the second way out for spatial computing

When we previously experienced Apple Vision Pro, we believed that only imaging apps for watching games, movies, and concerts could revitalize the visionOS application ecosystem and allow consumers to pay for this unique experience and long-term use.

Now, Vision Pro has a new partner – Taobao has entered Vision Pro, which is likely to become the selling point of the next Vision Pro, and may even open up a very detailed and avant-garde online shopping method.

After the Taobao Vision Pro version came online, I downloaded it immediately and spent the whole afternoon trying it. Rather than shopping online, I would rather say "I spent the whole afternoon playing Taobao in Vision Pro."

Coming to the main interface, compared with the mobile/web version of Taobao, the interface on Vision Pro is very simple: the "navigation bar" on the left, the "product area" in the middle, the "storage dock" and the "refresh button" in the lower right corner are all clearly visible.

There are no redundant advertising pop-ups, categories and search bars. This is also related to the early version of Taobao Vision Pro. What we experience now is similar to the laboratory version: the functions are not complete and orders cannot be placed.

However, the "light version" of Taobao also brings a long-lost comfort, allowing people to focus more on browsing products.

There are four options in the navigation bar. I clicked on them one by one and looked at them, and found that each one had its highlights.

Inside the "Homepage", it looks unremarkable from the front. Once you switch the perspective, you will find that the drone in the upper right corner is not a plan view, but a suspended 3D model, which breaks through the limitations of a flat web page and is very realistic.

This is the biggest and most core highlight of Taobao Vision Pro – the 3D display and interaction of products.

Yes, as long as "3D" is marked in the lower left corner of the product information column, you can manipulate the product at will through spatial operations.

Take the drone displayed on the homepage as an example. After clicking the 3D display button, you can place it anywhere in the space.

Zoom in or out, or place it on the desktop.

When you place an object on the table, Vision Pro will display the placeable surface as a white surface and prompt you to let go. After you separate your pinched fingers, the 3D model will fall on the recognition surface. After actual measurement, the table and the ground Even palms, etc. can be recognized.

There are several amazing details in this:

When you place the item on a flat surface, you will see a shadow corresponding to the shape of the product appear on the ground/table. As the item rises and falls, the size and depth of the shadow will also change accordingly.

The reflection of the metallic luster on the surface of Iron Man's helmet will be consistent with the reflection of real objects in the room according to the light source reflection in the room, thus blending into the environment and making the virtual model look just like the real thing.

Place a virtual mirror on the table, and you can see that what is reflected in the mirror is the real environment, such as the restoration of the windows and TV in the conference room in the picture below.

Where does the realism of Vision Pro's representation of the world come from? In fact, it is to reproduce the common sense of "this is how it should be".

Moreover, some products with mechanical structures can also be opened in Vision Pro's Taobao.

After the oven is turned on, put it in the kitchen to see if there is enough space:

Open Iron Man's helmet to see the internal structure and see if the workmanship is exquisite:

In order to better display products, Vision Pro has customized four extended functions for each product that can be displayed in 3D.

  • 360° rotation
  • Dimensional visualization
  • 1:1 size restoration
  • Comparison of similar products

After selecting the target, you can rotate it freely. First, you can see the product details from all angles, with a high degree of restoration, and the patterns and trademarks on the GoPro can be displayed;

Secondly, you can experience the feeling of having "the force", such as playing with this refrigerator that you can't push at ordinary times.

Compared with the previous cool functions, size visualization is the most practical, especially when it comes to large items such as beds, sofas, and chairs. You can't confirm what they will look like at home? Is it the right size? Do the colors match?

Restore the object to 1:1 size and display the length, width and height, which can save you a lot of detours before placing an order.

IKEA has moved your home into a shopping mall, allowing you to enjoy what your future home will look like while shopping; Taobao Vision Pro has moved the shopping mall into your home, and you can keep trying various combinations until you find the most suitable one.

For example, the wooden bed I'm interested in is longer than the steps below. I don't need a ruler to know that I need to change the size.

The 1:1 restoration actually has a wonderful effect: put the shoes online next to your feet and compare them with the styles you currently wear on your feet.

Unfortunately, space dressing is not currently supported. If these clothes, shoes and hats can be worn directly on the body in Vision Pro in the future, the spatial computing version of "Miracle Nuannuan" will have a dimensionality reduction impact on AR dress-up technology, and with With Vision Pro’s hardware and computing power, it’s just a matter of time.

Another surprising function is the comparison of similar products. Products of different styles and colors are put together for comparison and selection, which is very similar to the real shopping scene. In addition, the products can be restored in 3D, so the comparison results are more valuable for reference.

I'm not sure about the size of the chair, and I'm a little confused about the color and appearance, so let's put it together with the real one.

Internet pictures always fail to show the true size of the bag. After restoring the model 1:1, compare it with the one on hand and you can see clearly at a glance.

As long as it supports 3D and has similar products, you can get a product display that is closest to reality.

Since the products on the homepage are not categorized, if you want to find a specific product, you can find it through "Search" in the navigation bar.

Currently, the search function supports typing, voice and image input.

After actual testing, the recognition accuracy of the voice and image recognition functions is very high, and the products found are also very close to what you want.

It should be noted that the searched products may not be displayed in 3D, and there is a high probability that they will be downgraded to the web version of Taobao, which is slightly different from the one displayed on the homepage.

The effect is amazing, the future is promising, now…

I have experienced the above functions for a whole afternoon.

On the one hand, the most familiar software has a new way to open it, and the effect is lifelike.

Taobao Vision Pro makes all two-dimensional pictures three-dimensional. Through the powerful spatial computing power of Vision Pro, these items that do not exist before can be truly mapped in the room where I am.

Moreover, Vision Pro pays great attention to "details" and "quantification" when restoring objects. In addition to marking specific size values ​​to reflect the light and shadow effects in the environment, it will also tell you how big the object is in an easy-to-understand way, such as The refrigerator that opened the door was not empty, but filled with drinks and ingredients.

On the other hand, it is actually very difficult to use spatial operations on Taobao. I spent at least 1/3 of the time jumping repeatedly between the "accidental touch-restart model".

After finally arranging the position and adjusting the size of the 3D model, I had to start all over again just because my hands and eyes didn't cooperate well.

The first ten minutes I put on Vision Pro and opened Taobao were very exciting. I have to admit one thing: Vision Pro and Taobao are very consistent in definition.

It is suitable for use at home and is not convenient to take out. It requires a certain amount of time to experience it immersively. The usage scenarios of the two are highly integrated.

I thought the same way at first, thinking that Vision Pro had finally found one of the few "killer applications": building a bridge between online shopping and physical goods.

But after two or three hours of browsing, this idea was completely dispelled. Vision Pro is still the concept product, and Taobao on visionOS is just a laboratory function.

From a user's perspective, Vision Pro is still not suitable for long-term wear. After about an hour, I developed symptoms of swollen eyes and headache. This is not consistent with immersive online shopping that requires a certain amount of time to browse.

In addition, the action of "swiping Taobao" has many meanings for many people. It is not only a software that will be opened when necessary, browsing products itself is a way to relax and have fun, just like scrolling through Douyin or reading Weibo. : You can lie down, sit up, or sit in any position. Only your eyeballs and fingers are moving all over your body.

But Vision Pro is not good. The eyes, neck, arms, and even legs are almost all involved. The immersion is full, and so is the physical strength and energy.

And don't forget, this is an expensive device worth $3,499 (approximately RMB 25,330).

For ordinary consumers, the cost (price + usage) of using Vision Pro to browse Taobao is too high.

At the same time, for merchants, adapting to Taobao Vision Pro version is also a big "project".

Currently, the products that are adapted to 3D display on the homepage are expensive and well-known brands and big-name products. They have more ability and capital to make such attempts. But for many small and medium-sized merchants, how to adapt? Or why adapt? They are all unresolved problems.

3D displays are cool, and immersive shopping is novel, but it’s only a “privilege” for some products. You can indeed see the most intuitive comparison of large furniture and home appliances, but if you just buy tea or stationery, I can't find any reason to buy it with Vision Pro.

Therefore, it is difficult for Taobao to become Vision Pro's killer app until it finds the reason why it is "easier to use than a mobile phone."

In August 2020, Samsung Galaxy Z Fold2 was launched. Since then, folding screen mobile phones have begun a period of rapid growth. Although sales and market share have been mediocre, each company has launched its own high-end folding series since then.

Nearly four years have passed, and we have seen that folding screens are getting thinner and lighter, taking pictures is getting clearer and clearer, and the creases are getting more and more hidden. However, software adaptation is the "last question" that no one can answer correctly.

Take the Taobao App on the folding screen as an example. All manufacturers have adopted two solutions: "violent stretching" and "brainless parallel vision". Taobao has hardly done any real adaptation optimization for any manufacturer, while other software providers Businessmen are the same.

In April 2010, the first-generation iPad was launched, and what immediately became popular was the HD version of the app specifically designed for the tablet. From the layout to the page functions, everything was designed to be suitable for the tablet.

Now, there are very few HD version apps left, and even if they still exist, they cannot be compared with the functions of PC and mobile terminals; on the folding screen, application manufacturers have even given up on adaptation, copying everything from the original and simplifying it.

There is a complete imbalance between early investment and later returns such as development costs, audience size, and maintenance costs. Tablet OS and folding screen OS have also gradually declined from being independent projects to stopping updates, removing applications, and even no longer being developed.

The same is true for Taobao Vision Pro version. Compared with the user scale of tablets and folding screens, Vision Pro is even more miserable.

Just like the launch of "China Merchants Bank App" on visionOS, can you expect space payment and space repayment to bring any qualitative changes to your life?

When adapting to visionOS, application manufacturers are more concerned about showing off their muscles, showing off their attitude, and demonstrating their technical strength.

This is true for China Merchants Bank with "space payment", and the same is true with Taobao for "space shopping" – the symbolic significance is greater than the actual significance.

The arrival of new technologies is always exciting, and in this mood we are used to overestimating short-term benefits and underestimating long-term benefits.

In 2008, Nokia's first touch-screen mobile phone, the 5800 XpressMusic, was launched. Due to the technical limitations of single-touch and resistive screens, no one thought that a full-screen phone would be better to use than a button phone.

The visionOS version of Taobao brings a brand new interactive experience that challenges usage habits. In the short term, it is inevitable that gimmicks outweigh practicality, but its long-term value and the exploration of future human-computer interaction paradigms may not be underestimated.

# Welcome to follow the official WeChat public account of Aifaner: Aifaner (WeChat ID: ifanr). More exciting content will be provided to you as soon as possible.

Ai Faner | Original link · View comments · Sina Weibo