System, Method and Program for Managing and Displaying Product Information

1. An information processing system in which an augmented reality presenting device having a transmissive or non-transmissive display and a managing device managing product information related to respective products posted on a flier are connected via a network, wherein the augmented reality presenting device comprises: an imaging unit obtaining image data of the flier captured in an angle of view in response to a unit detecting a user of the augmented reality presenting device identifying a product posted on the flier based at least on captured image data initiated by one or more finger shape patterns indicating a direction and distance relationship between a user finger and the product; a first obtaining unit obtaining image data related to the product; and a first transmitting unit transmitting the image data related to the product to the managing device, wherein the managing device comprises: a flier information storage unit storing image data related to the respective products posted on the flier; a determining unit receiving the image data related to the product from the first transmitting unit of the augmented reality presenting device, determining the product specified by the user by comparing the image data related to the product with the image data related to the respective products and stored in the flier information storage unit; a second obtaining unit obtaining the product information related to the product correlated with the user; and a second transmitting unit transmitting the product information obtained by the second obtaining unit to the augmented reality presenting device, and wherein the augmented reality presenting device further comprises a presenting unit displaying, on the display, computer-graphics image data indicating the product information transmitted from the second transmitting unit of the managing device by combining with an image in real space.

2. The information processing system according to claim 1 , wherein, upon detecting that the products posted on the flier are associated with markers, the imaging unit of the augmented reality presenting device is configured to obtain image data of a marker associated wit the product, and wherein the managing device is further configured to determined and store a correlation between the markers and the products posted on the flier, and the determining unit of the managing device is configured to identify the product specified by the user by analyzing the image data of the marker associated with the product received from the augmented reality presenting device.

3. The information processing system according to claim 1 , wherein the second obtaining unit of the managing device is configured to obtains updated information related to the product.

4. The information processing system according to claim 1 , wherein the second obtaining unit of the managing device is configured to obtains updated product information, and the second transmitting unit of the managing device transmits the product information to the augmented reality presenting device.

5. The information processing system according to claim 1 , wherein the second obtaining unit of the managing device is configured to select a product according to personal information of the user and obtain the product information related to the product, and the second transmitting unit of the managing device is configured to transmit the product information related to the product to the augmented reality presenting device.

6. The information processing system according to claim 1 , wherein the managing device is configured to obtain address information of a shop selling the product, obtain map information including a position indicated by current location information received from the augmented reality presenting device and a position indicated by the address information, using the map information to determine and generate a route from a current location of the augmented reality presenting device to the shop selling the product based on a predetermined rule.

7. The information processing system according to claim 6 , wherein the predetermined rule is selected from a plurality of rules.

8. The information processing system according to claim 7 , wherein the plural rules include a rule related to a distance from the current location of the augmented reality presenting device to a shop selling the product and a rule related to inventory of the product.

9. An information processing method executed by an information processing system in which an augmented reality presenting device having a transmissive or non-transmissive display and a managing device managing product information related to respective products posted on a flier are connected via a network, wherein the augmented reality presenting device is configured to: obtain image data of the flier captured in an angle of view in response to a detecting unit detecting a user of the augmented reality presenting device identifying a product posted on the flier based at least on captured image data initiated by one or more finger shape patterns indicating a direction and distance between relationship between a user finger and the product; obtain image data related to the product; and transmit the image data related to the product to the managing device, and wherein the managing device is configured to: receive the image data related to the product from the augmented reality resenting device, determined the product specified by the user by comparing the image data related to the product with image data related to the respective products posted on the flier and stored in flier information storage unit; obtain the product information related to the product correlated with the user; and transmit the product information to the augmented reality presenting device.

10. A non-transitory computer readable storage medium storing thereon a program causing a computer to execute an information processing method executed by an information processing system in which an augmented reality presenting device having a transmissive or non-transmissive display and a managing device managing product information related to respective products posted on a flier are connected via a network, wherein a computer of the augmented reality presenting device is configured to: obtain image data of the flier captured in an angle of view in response to a detecting unit detecting a user of the augmented reality presenting device identifying a product posted on the flier based at least on captured image data initiated by one or more finger shape patterns indicating a direction and distance relationship between a user finger and the product; obtain image data related to the product; and transmit the image data related to the product to the managing device, and wherein a computer of the managing device is configured: receive the image data related to the product from the augmented reality presenting device, determine the product specified by the user by comparing the image data related to the product with image data related to the respective products posted on the flier and stored in a flier information storage unit; obtain the product information related to the product correlated with the user; and transmit the product information to the augmented reality presenting device.

11. The information processing system according to claim 1 , wherein the determining unit is further configured to: correlate the user and the product in response to determining the image data related to the product matching the image data related to the respective products stored in the flier information storage unit, and provide the product correlated with the user to the second obtaining unit.

12. The information processing system according to claim 11 , wherein the determining unit of the managing device is further configured to register a correlation of the user and the product in the flier information storage unit, and when receiving the image data related to the product posted on the flier form the augmented reality presenting device, analyze header information of the image data to obtain user information of the user, analyze the product information and the user information based on the correlation, and obtain the product information related to the product correlated with the user.

13. The information processing system according to claim 12 , wherein the second transmitting unit of the managing device is further configured to transmit to the augmented reality presenting device information for notifying that the product posted on the flier is a product registered in the flier information storage unit.