One of the biggest touted use cases for augmented reality is shopping and commerce. With a sense of depth and scale, buyers can virtually place objects in their living space before purchasing. Google is now working on a feature called “AR Shopping,” according to Google Lens 1.3.
About APK Insight: In this ‘APK Insight’ post, we’ve decompiled the latest version of an application that Google uploaded to the Play Store. When we decompile these files (called APKs, in the case of Android apps), we’re able to see various lines of code within that hint at possible future features. Keep in mind that Google may or may not ever ship these features, and our interpretation of what they are may be imperfect. We’ll try to enable those that are closer to being finished, however, to show you how they’ll look in the case that they do ship. With that in mind, read on.
Back in June, Google released a standalone Google Lens app on the Play Store. In addition to acting as an app shortcut to quickly open visual search, past updates have introduced a number of features. Version 1.1 added Lens to the Share menu and replicated the Art Selfies feature found in Google Arts & Culture.
Similar to that latter development, Google Lens 1.3 includes an “AR Shopping” app referred to as “google_ar_furniture.” Introductory text details how users can “Preview furniture in your space,” as well as take and share pictures of pieces in AR.
<string name=”welcome_dialog_google_ar_furniture_text”>Preview furniture in your space</string>
<string name=”welcome_dialog_use_camera”>”The perfect piece awaits. See which items fit or match your room. Plus, take photos & share them.
To start, give access to your camera and photos.”</string>
Strings provide a brief glimpse into the interface of placing an object in the real word, as well as the initial setup of pointing your device to the ground and moving it around.
<string name=”tap_to_place_shopping_hint”>Tap to place item</string>
<string name=”horizontal_translation_onboarding_shopping_hint”>Drag to move</string>
<string name=”choose_initial_furniture_hint”>Choose an item to place in your room</string>
<string name=”rotation_onboarding_shopping_hint”>To rotate, use two fingers and move clockwise or counter-clockwise</string>
<string name=”scale_onboarding_shopping_hint”>This piece is true-to-life, no need to resize. To adjust placement, move it.</string>
<string name=”searching_for_plane_hint”>First, let’s find the floor. Stay still, point your phone down, and move it around.</string>
<string name=”shopping_app_name”>AR Shopping</string>
<string name=”shopping_recovery_snackbar”>Restoring furniture. Point your phone where you last placed the item.</string>
Objects will be organized by categories, with Google Lens noting the price, merchant, and other pertinent details. At this stage, it is unclear what backend is being using for this service. It’s not clear whether Google is partnering with an existing retailer that provides scanned objects, or whether Google is doing itself.
Additionally, it’s all not clear how this “app” within Google Lens works or is activated by users when available. The current model for Google is placing AR features in other apps — like Camera for Playground AR Stickers — rather than right in Google Lens, which is primarily for search.
For example, Art Selfies was already available in the standalone Arts & Culture app, with those strings since removed in Google Lens 1.3. “Apps” within Google Lens could be part of an upcoming AR application model for Google. Alternately, AR Shopping could be part of an existing service like Google Shopping.
<string name=”product_list_heading”>Browse %1$s</string>
How to update?
Google Lens 1.3 is rolling out now via the Play Store. We do not post APKs to download directly given the legal challenges associated with copyright and possibility of removal. Meanwhile, that model is perilous given Android App Bundles and Google Play’s Dynamic Delivery.
Thanks to JEB Decompiler, which some APK Insight teardowns benefit from.
Dylan contributed to this article