Snap wants to light up shopping on Snapchat, especially for fashion, and it just took a big step forward.
The social media platform kicked off its Partner Summit on Thursday by dropping a load of announcements covering shopping features — online and in-store — new ways to use the Snapchat camera and a variety of partnership news with Prada, Farfetch, Poshmark, American Eagle and others.
One of the most notable reveals amid the sea of noteworthy debuts is augmented reality try-ons for fashion, which the company is launching with Prada and Farfetch.
The latter will allow Virgil Abloh fans to virtually try Off-White’s Melange Tomboy Jacket or Maize & Camou Windbreakers, while Prada devotees can pretend they’re Hunter Schafer and digitally don one of its marquee Galleria bags.
Even better, Snapchat users won’t have to fumble with their devices to switch colors or styles.
Thanks to natural language processing, the Farfetch integration comes with 40 built-in voice commands, such as “Can you show me a windbreaker jacket?“ or “Maybe something with a pattern?”
From there, users can continue trying on items, share it with followers or jump right to purchasing.
Prada’s AR experience brings gesture control to the equation. Now people can go from a magenta Galleria to an emerald by just waving a hand in the air.
The intuitive nature of such human-to-computer interactions, along with advances in mobile camera technology, amplifies the sense of magic that’s crucial to fashion, in general, and luxury brands, in particular.
For Farfetch, that lines up with its own path forward and vision.
“We’ve been very focused on Farfetch’s Luxury New Retail strategy,” explained Gareth Jones, chief marketing officer. “Jose, our chief executive officer, always says that the key question we think about every day is ‘How will people shop in five to 10 years’ time?’ This is what we are thinking about — we see Luxury New Retail as our strategy to drive how luxury retailing will look both now, but in the future.”
For the luxury fashion retailer, the camera is one of the keys to this journey. “What Snap provides with its camera strategy is an amazing pathway to bring fashion to the end user, which is incredibly exciting,” he added. “Snap’s technology is helping us to bring the immersive experience of fashion to customers in a really compelling way, which hasn’t really been done before.”
Where sectors like beauty, footwear and furniture have nailed virtual try-ons for fun or shopping, fashion has struggled. Turns out, mapping virtual clothes to a human form in any believable or realistic way is incredibly complicated.
The tech has to understand how fabrics move, the effect of gravity and how a piece of clothing would lay on different body shapes, among many variables.
But there’s plenty of reason for Snap to tackle the challenge. More than 200 million people use its AR features and nearly one-third of total spend among teenagers is on apparel and accessories, the company said, prompting Snap to dig down and try to crack the problem.
The tech company leaned on machine learning for the two key developments making AR try-ons for clothing possible in Snapchat: Cloth simulation and 3D body mesh.
Its machine learning/AI teams have been working on some of these cutting-edge developments for years, said Arguelles. Earlier stages of 3D body mesh development began with fun AR lenses, but that led to a deeper, more detailed understanding of things like where joints are on the body and the width, depth and dimension of the full body.
The tech applies to the AR lens, but also fuels the gesture control feature since it understands how the body moves.
For now, the company is more focused on its current spate of announcements — among them, a new scanning feature for clothing.
More than 170 million Snapchatters scan the world around them monthly, according to the company’s data, and they’ve already identified millions of objects, from wine bottles to dog breeds, plants and many more objects. Now apparel joins the fray with Screenshop.
Screenshop is exactly what it sounds like: IOS users in the U.S. will be the first to be able to scan friends’ physical outfits in real life, so the Screenshop’s catalogue can pull similar looks and relevant recommendations from hundreds of brands. Eventually, the tool will let people dig up camera roll screenshots taken in the past, so those pics will do more than just clutter up their photo storage.
The company is also focused on making shopping in the Snapchat universe more social.
Social shopping is Poshmark’s specialty. So perhaps it’s no surprise that the peer-to-peer resale marketplace, which was the first retail partner to adopt Snap Kit in 2018, is joining forces with Snap again on Poshmark Minis.
Now, after three to four months of development on Poshmark Mini, the marketplace is expanding its “party architecture” to extend social shopping outside the bounds of its own app.
Indeed, it may pull in a universe of Snapchatters, which numbers more than 500 million monthly active users now. Snap newly reports that it captures nearly one of every two smartphone users in the U.S. and overseas, roughly 40 percent of its community now comes from outside North America and Europe. In India, for instance, it’s grown daily active users more than 100 percent year-over-year in each of the last five quarters.
Snap’s Connected Lenses lets users invite friends into a shared Lens experience that takes them to a virtual — but realistic — AE store location, so pals can live chat, pick or compare outfits and build looks together on a virtual mannequin.
Considering shopping has always been a social activity in the real world, it’s taken a ridiculously long time for it to really land in e-commerce, especially for a social media app that’s hyper-focused on online shopping.
In other news, the company revealed AR partnerships with Swiss luxury watchmaker and jeweler Piaget and online eyeglass company Zenni, as well as new tech features like wrist-tracking technology for AR watch and jewelry try-ons.
Don't forget to drop us a line if your brand is looking to explore the potential of future immersive digital campaigns, let's leap into the future one digital campaign at a time.