The system and method disclosed herein relate to the establishment of both the location and identity of individual items in pictures or videos and delivering of related information thereto. Initially, images in video source content are scanned and individual elements in the images are dynamically compared with digital images stored in a database to identify individual items in the image that match the digital images stored in the database. Upon detecting a match, information is accessed in the database that is related to the digital image that matches the identified individual item. The accessed information is then transmitted to a secondary system that is in communication with a display device, such that the accessed information is displayed on the secondary system in coordination with the video source content being displayed on the display device.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A system for recognizing individual items in images contained in video source content interpreted by a viewing device and creating metadata relating to the recognized items, the system comprising: at least one electronic database configured to store a plurality of digital images and information related to each of the plurality of digital images; at least one processor communicatively coupled to the at least one electronic database, the at least one processor configured to: (1) scan at least one image contained in the video source content and dynamically compare individual elements in the scanned at least one image with the plurality of digital images stored in the at least one electronic database to identify at least one individual item in the scanned at least one image that matches at least one of the plurality of digital images stored in the at least one electronic database, (2) access the information stored in the at least one electronic database that is related to the at least one digital image that matches the identified at least one individual item; and (3) create metadata that links the accessed information related to the matched and identified at least one individual item with the video source content; and a server configured to transmit the metadata toward the viewing device, with the metadata being configured to make active the identified at least one individual item when the video source content is interpreted by the viewing device, such that at least a portion of the accessed information is rendered by the viewing device when the identified at least one individual item is active.
2. The system according to claim 1 , wherein the active and identified at least one individual item is configured to be selected by a user selection using at least one of a mouse pointer and a touch screen.
3. The system according to claim 1 , wherein the active and identified at least one individual item is configured to be interpreted and selected automatically by the viewing device.
4. The system according to claim 1 , wherein the video source content is one of live video content or prerecorded video content.
5. The system according to claim 1 , wherein the at least one processor is configured to create the metadata to include coordinate position data indicating a position of the identified at least one individual item in the at least one image contained in the video source content, and wherein the server is further configured to transmit the metadata with the coordinate position data toward the viewing device that displays the at least one image with at least one electronic indicator, which is based on the coordinate position data, for the identified at least one individual item such that the identified at least one individual item is rendered active.
6. The system according to claim 1 , wherein the at least one processor is configured to create the metadata that includes identification information of the identified at least one individual item, such that at least a portion of the identification information is displayed on the viewing device when the active and identified at least one individual item is selected.
7. The system according to claim 1 , wherein the server is configured to transmit the metadata, which links the accessed information related to the matched and identified at least one individual item with the video source content, toward the viewing device that receives the video source content as a separate data stream from the metadata.
8. The system of claim 1 , wherein the at least one processor is further configured to initiate an electronic shopping interaction in response to a selection of the active and identified at least one individual item.
9. The system of claim 1 , wherein the viewing device is at least one of a computer, a smartphone, a tablet, a PDA, a television, a display with a set-top box type processor, a Blu-ray player, and a video game console.
10. The system of claim 1 , wherein the metadata is configured to make active the identified at least one individual item with either a visible or an invisible indicator when the portion of the accessed information is rendered by the viewing device.
11. A system for recognizing individual items in images contained in video source content configured to be received and interpreted by a viewing device and creating metadata relating to the recognized items, the system comprising: at least one electronic database configured to store a plurality of digital images and information related to each of the plurality of digital images; at least one processor communicatively coupled to the at least one electronic database, the at least one processor configured to: scan at least one image contained in the video source content and dynamically compare individual elements in the scanned at least one image with the plurality of digital images stored in the at least one electronic database to identify at least one individual item in the scanned at least one image that matches at least one of the plurality of digital images stored in the at least one electronic database, and create metadata that links the information stored in the at least one electronic database and that is related to the matched and identified at least one individual item with the video source content, wherein the created metadata is configured to be interpreted by the viewing device when the video source content is received by the viewing device.
12. The system of claim 11 , wherein the created metadata is configured to make active the identified at least one individual item when the video source content is interpreted by the viewing device, such that at least a portion of the accessed information is rendered by the viewing device when the identified at least one individual item is active.
13. The system of claim 12 , wherein the metadata is configured to make active the identified at least one individual item with either a visible or an invisible indicator when the portion of the accessed information is rendered by the viewing device.
14. The system of claim 12 , further comprising a server communicatively coupled at least one processor and configured to transmit the metadata toward the viewing device.
15. The system according to claim 11 , wherein the active and identified at least one individual item is configured to be selected by a user selection using at least one of a mouse pointer and a touch screen.
16. The system according to claim 11 , wherein the active and identified at least one individual item is configured to be interpreted and selected automatically by the viewing device.
17. The system according to claim 11 , wherein the video source content is one of live video content or prerecorded video content.
18. The system according to claim 14 , wherein the at least one processor is configured to create the metadata to include coordinate position data indicating a position of the identified at least one individual item in the at least one image contained in the video source content, and wherein the server is further configured to transmit the metadata with the coordinate position data toward the viewing device that displays the at least one image with at least one electronic indicator, which is based on the coordinate position data, for the identified at least one individual item such that the identified at least one individual item is rendered active.
19. The system according to claim 12 , wherein the at least one processor is configured to create the metadata that includes identification information of the identified at least one individual item, such that at least a portion of the identification information is displayed on the viewing device when the active and identified at least one individual item is selected.
20. The system according to claim 12 , wherein the server is configured to transmit the metadata, which links the accessed information related to the matched and identified at least one individual item with the video source content, toward the viewing device that receives the video source content as a separate data stream from the metadata.
21. The system of claim 11 , wherein the at least one processor is further configured to initiate an electronic shopping interaction in response to a selection of the active and identified at least one individual item.
22. The system of claim 11 , wherein the viewing device is at least one of a computer, a smartphone, a tablet, a PDA, a television, a display with a set-top box type processor, a Blu-ray player, and a video game console.
23. A method for recognizing individual items in images contained in video source content interpreted by a viewing device and creating metadata relating to the recognized items, the method comprising: storing, in at least one electronic database, a plurality of digital images and information related to each of the plurality of digital images; scanning, by at least one processor communicatively coupled to the at least one electronic database, at least one image contained in the video source content; dynamically comparing, by the at least one processor, individual elements in the scanned at least one image with the plurality of digital images stored in the at least one electronic database to identify at least one individual item in the scanned at least one image that matches at least one of the plurality of digital images stored in the at least one electronic database; accessing, by at least one processor, the information stored in the at least one electronic database that is related to the at least one digital image that matches the identified at least one individual item; creating, by at least one processor, metadata that links the accessed information related to the matched and identified at least one individual item with the video source content; and transmitting, by a server, the metadata toward the viewing device, with the metadata being configured to make active the identified at least one individual item when the video source content is interpreted by the viewing device, such that at least a portion of the accessed information is rendered by the viewing device when the identified at least one individual item is active.
24. The method according to claim 23 , further comprising transmitting, by the server, the metadata, which links the accessed information related to the matched and identified at least one individual item with the video source content, toward the viewing device that receives the video source content as a separate data stream from the metadata.
25. The method of claim 23 , further comprising configuring, by at least one processor, the metadata to make active the identified at least one individual item with either a visible or an invisible indicator when the portion of the accessed information is rendered by the viewing device.
26. A method for recognizing individual items in images contained in video source content configured to be received and interpreted by a viewing device and creating metadata relating to the recognized items, the method comprising: storing, in at least one electronic database, a plurality of digital images and information related to each of the plurality of digital images; scanning, by at least one processor communicatively coupled to the at least one electronic database, at least one image contained in the video source content; dynamically comparing, by at least one processor, individual elements in the scanned at least one image with the plurality of digital images stored in the at least one electronic database to identify at least one individual item in the scanned at least one image that matches at least one of the plurality of digital images stored in the at least one electronic database; creating, by at least one processor, metadata that links the information stored in the at least one electronic database and that is related to the matched and identified at least one individual item with the video source content; and configuring, by at least one processor, the created metadata to be interpreted by the viewing device when the video source content is received by the viewing device.
27. The method of claim 26 , further comprising configuring, by at least one processor, the created metadata to make active the identified at least one individual item when the video source content is interpreted by the viewing device, such that at least a portion of the accessed information is rendered by the viewing device when the identified at least one individual item is active.
28. The method of claim 27 , further comprising configuring, by at least one processor, the metadata to make active the identified at least one individual item with either a visible or an invisible indicator when the portion of the accessed information is rendered by the viewing device.
29. The method according to claim 26 , further comprising transmitting, by the server, the metadata, which links the accessed information related to the matched and identified at least one individual item with the video source content, toward the viewing device that receives the video source content as a separate data stream from the metadata.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
June 4, 2018
November 20, 2018
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.