Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method involving an on-screen display of differently-oriented views of a 3D product captured by a camera of a user's mobile device, the method comprising the acts: receiving a first camera-captured view of the 3D product, captured when the product has a first pose relative to the camera, said first camera-captured view depicting the 3D product at a first orientation; and augmenting display of said first view on a screen of the user's mobile device with an annotation, the annotation being associated with a first anchoring feature on the 3D product, the anchoring feature being a particular location within a face of the product depicted in the first view, the annotation being positioned to the right of the displayed 3D product on said screen; receiving a second camera-captured view of the 3D product, captured when the product has a second pose relative to the camera, said second camera-captured view depicting the 3D product at a second orientation and again depicting said first anchoring feature; and augmenting display of said second view on the screen of the user's mobile device with said annotation, said annotation still being associated with said first anchoring feature, but being positioned to the left of the displayed 3D product on said screen, the annotation thus moving from the right side of the displayed 3D product to the left side; and receiving a third camera-captured view of the 3D product, captured when the product has a third pose relative to the camera, said third camera-captured view depicting the 3D product at a third orientation and again depicting said first anchoring feature; and displaying the third view on the screen of the user's mobile device without said annotation, despite depiction of said first anchoring feature in said third camera-captured view; wherein varying presentation of the annotation with variations in product-camera pose helps serve the function of drawing the user's attention to the annotation.
A mobile app displays a 3D product on screen using the phone's camera. The app shows the product from different angles as the user moves the phone. When a specific feature on the product is visible, an annotation (like a text box) appears. Initially, the annotation might be to the right of the product. As the user rotates the product, the annotation moves to the left. At a certain angle, the annotation disappears completely, even though the feature it relates to is still visible. This changing annotation position draws the user's attention to it.
2. The method of claim 1 that includes sensing said first and second orientations by analyzing image data depicting said product, using a hardware processor configured to perform such act.
This involves a mobile app displaying a 3D product on screen using the phone's camera and adding annotations as described in the previous description. The app determines the orientation or angle of the product by analyzing the images captured by the camera, using a processor. Specifically, this orientation detection is done using image data from the camera and a hardware processor configured to perform this analysis.
3. The method of claim 1 in which the annotation is spatially associated with the first anchoring feature on the product.
This involves a mobile app displaying a 3D product on screen using the phone's camera and adding annotations as described in the first description. Here, the annotation's position is tied to the specific location (anchoring feature) on the product's surface. The annotation is displayed spatially associated with the anchoring feature on the product.
4. The method of claim 1 in which the product includes a first face comprising said first anchoring feature, and the method includes: when the product is displayed with the first face oriented within a threshold angular value of a viewpoint, augmenting the on-screen display with said annotation; and when the product is displayed with the first face oriented outside said threshold angular value, displaying the product without said annotation; wherein the annotation disappears when the first face is turned away from the viewpoint.
In a mobile app displaying a 3D product with annotations (as previously described), the app only shows an annotation when a specific side (face) of the product is facing the user within a certain angle. If the user turns the product so that the face is angled away beyond that threshold, the annotation disappears. The product includes a first face comprising said first anchoring feature. When the product is displayed with the first face oriented within a threshold angular value of a viewpoint, augmenting the on-screen display with said annotation. When the product is displayed with the first face oriented outside said threshold angular value, displaying the product without said annotation. The annotation disappears when the first face is turned away from the viewpoint.
5. The method of claim 1 wherein the product comprises a retail package box.
This refers to the previous description where a mobile app displays a 3D product with annotations, using the phone's camera. In this specific case, the 3D product being viewed is a retail package box.
6. A method involving an on-screen display of differently-oriented views of a 3D object that includes first and second anchoring features on a common planar face, each of said anchoring features being a particular location within said face of the 3D object, the method comprising the acts: augmenting the on-screen display with a first annotation associated with the first anchoring feature, and with a second annotation associated with the second anchoring feature, while the orientation of the 3D object relative to the camera is varied between first, second and third orientations, wherein: when the object is displayed at the first orientation, presenting both the first and second annotations to the right of the displayed 3D object; when the object is displayed at the second orientation, presenting both the first and second annotations to the left of the displayed object, the annotations thus moving from the right side of the displayed 3D product to the left side; and when the object is displayed at the third orientation, which is between the first and second orientations, presenting the first annotation to the right of the displayed object, and presenting the second annotation to the left of the displayed object; wherein varying presentation of the first and second annotations with variations in object-camera orientation helps serve the function of drawing the user's attention to the annotations.
An application displays a 3D object with two specific locations (anchoring features) on one side of the object and shows annotations for each. As the user rotates the object, the annotations move. Initially, both annotations are on the right side. After rotation, they are both on the left. In a middle orientation, one annotation is on the right, and the other is on the left. This dynamic movement of the annotations is designed to attract the user's attention.
7. The method of claim 6 wherein the object comprises a retail package box.
This refers to the previous method involving a 3D object with two annotations that move as the object is rotated. Here, the 3D object being viewed is a retail package box.
8. The method of claim 6 that includes sensing said first and second orientations by analyzing image data depicting said object, using a hardware processor configured to perform such act.
This relates to the method where a 3D object with two annotations is displayed and the annotations move as the object rotates (as described previously). The app uses image analysis to determine the object's orientation, using a processor. Specifically, the first and second orientations are sensed by analyzing image data depicting said object, using a hardware processor configured to perform such act.
9. A method involving an on-screen display of differently-oriented views of a 3D object having a planar face, the method comprising the acts: determining orientation information indicating an orientation at which said face of the displayed 3D object is viewed; comparing said determined orientation information with stored reference information, using a hardware processor configured to perform such act, the stored reference information serving to specify a threshold angular value datum, said datum defining orientations at which an annotation should be rendered; and when said comparing has a first outcome, augmenting the on-screen display by presenting the annotation, and when said comparing has a second outcome, not augmenting the on-screen display with the annotation; wherein presentation of the annotation varies depending both on said determined orientation information, and on said threshold angular value datum, wherein such varying presentation helps serve the function of drawing a user's attention to the annotation; and wherein the annotation is associated with an anchoring feature on said planar face.
A system displays a 3D object on a screen. The system determines how the object's face is oriented. It compares this orientation to a stored value (threshold). If the orientation is within the threshold, an annotation is shown. If it's outside the threshold, the annotation is hidden. The annotation is linked to a specific feature on the object's face. Varying the annotation display is to draw user attention to it.
10. The method of claim 9 in which the object includes first and second features on a common planar face of the object, and the method includes: determining information indicating viewing orientations of the first and second features; comparing said determined information with stored first information for the first feature, and with stored second information for the second feature; and at a first time, based on a result of said comparing, augmenting the on-screen display by presenting a first annotation corresponding to the first feature, but not augmenting the on-screen display by presenting a second annotation corresponding to the second feature.
Building upon the previous 3D object display system, the object now has two features on its face. The system determines the viewing orientation of each feature. It compares these orientations with stored information for each feature. At a certain point in time, only the annotation for the first feature is displayed, while the annotation for the second feature is not.
11. The method of claim 10 that includes, at a different time, with a differently-oriented view of the object: based on a result of said comparing, augmenting the on-screen display by presenting a first annotation corresponding to the first feature, and also augmenting the on-screen display by presenting a second annotation corresponding to the second feature.
Building upon the previous method of displaying a 3D object with feature-specific annotations, the system, at a later time with a different object orientation, displays both the annotation for the first feature and the annotation for the second feature. This display of both annotations occurs based on the comparison of determined information and stored reference information.
12. The method of claim 9 wherein the object comprises a retail package box.
This refers to the previous system for displaying 3D objects with annotations that appear/disappear based on orientation. In this case, the 3D object being displayed is a retail package box.
13. The method of claim 9 that includes sensing said first and second orientations by analyzing image data depicting said object, using a hardware processor configured to perform such act.
Expanding on the 3D object display system where annotations appear/disappear based on orientation, the system determines the object's orientation through image analysis using a processor. Specifically, the first and second orientations are sensed by analyzing image data depicting said object, using a hardware processor configured to perform such act.
14. The method of claim 9 in which the object comprises a packaged food item, and the method further includes responding to user selection of the annotation by rendering a nutrition facts graphic on the screen, said rendering including a visual transition in which the annotation expands out from one of the corners of the display screen.
Building on the system that shows annotations based on the orientation of a 3D food package, when the user clicks on the annotation, a nutrition facts label appears on the screen. The label appears with a visual transition, expanding from a corner of the screen.
15. The method of claim 9 in which the object comprises a packaged food item that includes first and second features on a common planar face thereof, the first and second features having first and second annotations respectively associated therewith, the method further including: when said face is viewed at a first orientation, presenting neither the first nor second annotations as augmentations on the display; when said face is viewed at a second orientation, presenting the first but not the second annotation as an augmentation on the display; and when said face is viewed at a third orientation, presenting both the first and second annotations on the display.
This refers to displaying a 3D food package with two features on its face, each with an annotation. The system controls which annotations are displayed based on the viewing angle: At one angle, neither annotation is shown. At another, only the first annotation is shown. Finally, at a third angle, both annotations are visible.
16. The method of claim 9 in which the object comprises a packaged food item that includes first and second features on a common planar face thereof, the first and second features having first and second annotations respectively associated therewith, the method further including: when said face is viewed at a first orientation, presenting both the first and second annotations on a same side of the displayed object on the display screen; and when said face is viewed at a second orientation, presenting the first annotation to the right side of the displayed object on the display screen, and presenting the second annotation to the left side of the displayed object on the display screen.
This expands on the 3D food package display system with two features and annotations. The display changes depending on the viewing angle. From one viewpoint, both annotations are displayed on the same side of the object. From another, one annotation is on the right, and the other is on the left.
17. The method of claim 9 in which the object comprises a packaged food item having a planar face, and the annotation is associated with an anchoring feature on said planar face, the anchoring feature being defined using a steganographic reference system comprising plural tiles.
This is the method of displaying a 3D object and its annotations on the planar face, where the specific location or "anchoring feature" used for the annotation is defined using a special code system comprised of multiple tiles to hide the reference point within the image.
18. The method of claim 9 that further includes capturing imagery of said object with differently-oriented views with a head-mounted camera system worn by the user.
In addition to the 3D object display system that manages annotations, the user captures the imagery using a camera mounted on a headset.
19. The method of claim 9 that further includes the acts: recognizing the object from imagery thereof captured by a camera conveyed by the user; obtaining different images of the recognized object from a remote computer system, said different images of the recognized object having been authored by a third party different than said user; and presenting different of said images to the user in response to user input.
Expanding on the 3D object annotation system, the application recognizes the object from a user's camera input. It then fetches alternative images of the object from a remote server (these images created by someone else), and shows different images based on user input.
20. The method of claim 9 that further includes the acts: recognizing the object from imagery thereof captured by a camera conveyed by the user; obtaining 3D model information for the recognized product from a remote computer system, said 3D model having been authored by a third party different than said user; and presenting a rendering of the 3D model to the user on the screen.
Continuing from the core 3D object display system, the app recognizes the 3D object using the camera. It then gets a 3D model of the object from a remote server (the model was created by someone else) and displays the rendered 3D model on the screen.
Unknown
November 14, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.