Legal claims defining the scope of protection, as filed with the USPTO.
1. A system comprising: a memory; and a hardware processor that, when executing computer-executable instructions stored in the memory, is configured to: receive an image that was selected from a plurality of images of a video content item; store the received image in the memory; determine that the image includes a plurality of items displayed within the image; transmit a plurality of image queries to one or more sources that search for known items that each correspond to one of the plurality of items displayed in the image while concurrently providing an initial search indication, for each of the plurality of items displayed in the image, indicating a search status for that item, wherein the initial search indication is modified from an initial visual state indicating that the search for the corresponding known item using one or more of the plurality of image queries is ongoing to a modified visual state indicating that the search for the corresponding known item using one or more of the plurality of image queries has been completed; determine, based on search results from the plurality of image queries, that the plurality of items displayed in the image includes a first item having a known identity and a second item having a plurality of known identities; and update display data, on a display device, to concurrently display the image from the video content item and an overlay that includes an identification indication for each of the plurality of items displayed in the image, wherein the identification indication associated with the first item is different than the identification indication associated with the second item.
2. The system of claim 1 , wherein: the identification indication associated with the first item includes a first highlight region positioned in connection with the first item; the identification indication associated with the second item includes a second highlight region positioned in connection with the second item; the first highlight region is associated with a first color to signify that the first item has the known identity; and the second highlight region is associated with a second color to signify that the second item has the plurality of known identities.
3. The system of claim 1 , wherein the hardware processor is further configured to determine, based on the search, that the plurality of items displayed in the image includes a third item having an unknown identity, wherein: the identification indication associated with the third item includes a third highlight region positioned in connection with the third item; and the third highlight region is associated with a third color to signify that the third item has the unknown identity.
4. The system of claim 1 , wherein the hardware processor is further configured to: receive a selection of the first item or the second item; retrieve information relating to the selected item; and provide the display data, on the display device, in the overlay of the image of the video content item based on the retrieved information, wherein the display data includes a link that directs the display device to supplemental information relating to the selected item.
5. The system of claim 1 , wherein the hardware processor is further configured to determine that the video content item includes predetermined item identifier data within the video content item received from a media source.
6. The system of claim 1 , wherein the plurality of items displayed in the image comprise at least one of a human face, an object, and a scene.
7. The system of claim 1 , wherein the hardware processor is further configured to identify a text region within the image by dividing the image into a plurality of regions, detecting features in each region of the plurality of regions, analyzing detected features in each region, and determining whether the detected features comprise textual information.
8. A method comprising: receiving, using a hardware processor, an image that was selected from a plurality of images of a video content item; storing, using the hardware processor, the received image in a memory; determining, using the hardware processor, that the image includes a plurality of items displayed within the image; transmitting, using the hardware processor, a plurality of image queries to one or more sources that search for known items that each correspond to one of the plurality of items displayed in the image while concurrently providing an initial search indication, for each of the plurality of items displayed in the image, indicating a search status for that item, wherein the initial search indication is modified from an initial visual state indicating that the search for the corresponding known item using one or more of the plurality of image queries is ongoing to a modified visual state indicating that the search for the corresponding known item using one or more of the plurality of image queries has been completed; determining, using the hardware processor, based on search results from the plurality of image queries, that the plurality of items displayed in the image includes a first item having a known identity and a second item having a plurality of known identities; and updating, using the hardware processor, display data, on a display device, to concurrently display the image from the video content item and an overlay that includes an identification indication for each of the plurality of items displayed in the image, wherein the identification indication associated with the first item is different than the identification indication associated with the second item.
9. The method of claim 8 , wherein: the identification indication associated with the first item includes a first highlight region positioned in connection with the first item; the identification indication associated with the second item includes a second highlight region positioned in connection with the second item; the first highlight region is associated with a first color to signify that the first item has the known identity; and the second highlight region is associated with a second color to signify that the second item has the plurality of known identities.
10. The method of claim 8 , further comprising determining, based on the search, that the plurality of items displayed in the image includes a third item having an unknown identity, wherein: the identification indication associated with the third item includes a third highlight region positioned in connection with the third item; and the third highlight region is associated with a third color to signify that the third item has the unknown identity.
11. The method of claim 8 , further comprising: receiving a selection of the first item or the second item; retrieving information relating to the selected item; and providing the display data, on the display device, in the overlay of the image of the video content item based on the retrieved information, wherein the display data includes a link that directs the display device to supplemental information relating to the selected item.
12. The method of claim 8 , further comprising determining that the video content item includes predetermined item identifier data within the video content item received from a media source.
13. The method of claim 8 , wherein the plurality of items displayed in the image comprise at least one of a human face, an object, and a scene.
14. The method of claim 8 , further comprising identifying a text region within the image by dividing the image into a plurality of regions, detecting features in each region of the plurality of regions, analyzing detected features in each region, and determining whether the detected features comprise textual information.
15. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method, the method comprising: receiving an image that was selected from a plurality of images of a video content item; storing the received image in a memory; determining that the image includes a plurality of items displayed within the image; transmitting a plurality of image queries to one or more sources that search for known items that each correspond to one of the plurality of items displayed in the image while concurrently providing an initial search indication, for each of the plurality of items displayed in the image, indicating a search status for that item, wherein the initial search indication is modified from an initial visual state indicating that the search for the corresponding known item using one or more of the plurality of image queries is ongoing to a modified visual state indicating that the search for the corresponding known item using one or more of the plurality of image queries has been completed; determining, based on search results from the plurality of image queries, that the plurality of items displayed in the image includes a first item having a known identity and a second item having a plurality of known identities; and updating display data, on a display device, to concurrently display the image from the video content item and an overlay that includes an identification indication for each of the plurality of items displayed in the image, wherein the identification indication associated with the first item is different than the identification indication associated with the second item.
16. The non-transitory computer-readable medium of claim 15 , wherein: the identification indication associated with the first item includes a first highlight region positioned in connection with the first item; the identification indication associated with the second item includes a second highlight region positioned in connection with the second item; the first highlight region is associated with a first color to signify that the first item has the known identity; and the second highlight region is associated with a second color to signify that the second item has the plurality of known identities.
17. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises determining, based on the search, that the plurality of items displayed in the image includes a third item having an unknown identity, wherein: the identification indication associated with the third item includes a third highlight region positioned in connection with the third item; and the third highlight region is associated with a third color to signify that the third item has the unknown identity.
18. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises: receiving a selection of the first item or the second item; retrieving information relating to the selected item; and providing the display data, on the display device, in the overlay of the image of the video content item based on the retrieved information, wherein the display data includes a link that directs the display device to supplemental information relating to the selected item.
19. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises determining that the video content item includes predetermined item identifier data within the video content item received from a media source.
20. The non-transitory computer-readable medium of claim 15 , wherein the plurality of items displayed in the image comprise at least one of a human face, an object, and a scene.
21. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises identifying a text region within the image by dividing the image into a plurality of regions, detecting features in each region of the plurality of regions, analyzing detected features in each region, and determining whether the detected features comprise textual information.
Unknown
January 29, 2019
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.