The present application discloses an information observation method and an information observation apparatus, and relates to the field of multimedia information processing technologies. The method comprises: detecting a position of a sightline focusing point of an observer; in response to that it is detected that the sightline focusing point of the observer moves away from an observed object, judging whether the observer has observed all important information on the observed object; and in response to that it is judged that the observer has not observed all important information on the observed object, reminding the observer. For the method and the apparatus in embodiments of the present application, from the perspective of an actual observation behavior of an observer, a position of a sightline focusing point of the observer is detected to determine an observation behavior of the observer for important information, so as to radically prevent missing of important information.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An information observation apparatus comprising a processor, the apparatus comprising: a detection module, configured to detect a position of a sightline focusing point of an observer, wherein the sightline focusing point is a clearest imaging point on a retina of the observer, wherein the detection module comprises: an image capture device configured to capture at least one image presented by a fundus of an eye of the observer; an image adjusting device configured to adjust at least one imaging parameter of an optical path between the eye of the observer and the image capture device, to cause the image capture device to capture at least one image that meets at least one predetermined definition standard; and an image processing device embodied with the processor configured to calculate a position of the sightline focusing point, according to an optical parameter of the eye and the at least one imaging parameter of the optical path between the eye of the observer and the image capture device in response to that the image capture device captures the at least one image that meets the predetermined definition standard; a judgment module embodied with the processor, configured to: in response to that the detection module detects that the sightline focusing point of the observer moves away from an observed object, judge whether the observer has observed important information on the observed object; and a reminding module embodied with the processor, configured to: in response to that the judgment module judges that the observer has not observed important information on the observed object, remind the observer.
2. The apparatus according to claim 1 , wherein the image adjusting device comprises: an adjustable lens unit, located in the optical path between the eye of the observer and the image capture device, wherein the focal length of the adjustable lens unit is adjustable and/or a position of the adjustable lens unit in the optical path is adjustable.
3. The apparatus according to claim 1 , wherein the image adjusting device comprises: a beam splitting unit, configured to transfer the at least one image presented by the fundus to the image capture device according to positions of a pupil associated with different eye optical axis directions of the eye of the observer.
4. The apparatus according to claim 1 , wherein the detection module further comprises: a casting device, configured to cast a light spot pattern to the fundus of the observer.
5. The apparatus according to claim 1 , wherein the detection module detects the position of the sightline focusing point of the observer according to a pupil-corneal reflection vector method, an electrooculography (EOG) method, an iris-sclera border method, a corneal reflection method, a dual Purkinje image method, or a contact lens method.
6. The apparatus according to claim 1 , wherein when the detection module detects that the sightline focusing point of the observer moves out of an area corresponding to the observed object for a first preset period of time, the judgment module judges that the sightline focusing point of the observer moves away from the observed object.
7. The apparatus according to claim 1 , wherein when the detection module detects that the observed object changed, the judgment module judges that the sightline focusing point of the observer moves away from the observed object.
8. The apparatus according to claim 1 , wherein when the detection module detects that the position of the sightline focusing point of the observer falls within an area corresponding to important information for a second preset period of time, the judgment module judges that the observer has observed the corresponding important information.
9. The apparatus according to claim 1 , wherein when the detection module detects that the position of the sightline focusing point of the observer falls within an area corresponding to important information a preset number of times, the judgment module judges that the observer has observed the corresponding important information.
10. The apparatus according to claim 1 , further comprising: an identification module, configured to identify important information on the observed object.
11. The apparatus according to claim 10 , wherein the identification module identifies important information on the observed object according to content of the observed object.
12. The apparatus according to claim 10 , wherein the identification module identifies important information on the observed object according to metadata of the observed object.
13. The apparatus according to claim 10 , further comprising: a marking module, configured to mark important information on the observed object.
14. The apparatus according to claim 13 , wherein the marking module visually marks the important information on the observed object and/or an area corresponding to the important information.
15. The apparatus according to claim 1 , further comprising: a labeling module, configured to label important information that has been observed by the observer and/or an area corresponding to the important information.
16. The apparatus according to claim 15 , wherein when the important information and/or the area corresponding to the important information has been observed, the labeling module removes an original mark.
17. The apparatus according to claim 15 , wherein when the important information and/or the area corresponding to the important information has been observed, the labeling module performs labeling of the important information by using a visual mark different from an original mark.
18. The apparatus according to claim 15 , wherein when no mark exists at the important information that has been observed and/or the area corresponding to the important information, the labeling module performs labeling of the important information by using a visual mark.
19. The apparatus according to claim 1 , wherein the reminding module performs reminding in at least one of the following manners: an audio manner, a visual manner, a touch manner, a vibration manner, and a manner of restricting an operation of the observer.
20. The apparatus according to claim 1 , wherein the reminding module performs visual reminding for important information that has not been observed by the observer and/or at an area corresponding to the important information.
21. The apparatus according to claim 1 , wherein the apparatus includes eye glasses.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
April 17, 2017
June 16, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.