Health notifications from eye measurements

This disclosure relates generally to optics, and in particular to head mounted devices.

A head mounted device is a wearable electronic device, typically worn on the head of a user. Head mounted devices may include one or more electronic components for use in a variety of applications, such as gaming, aviation, engineering, medicine, entertainment, activity tracking, and so on. Head mounted devices may include display to present virtual images to a wearer of the head mounted device. When a head mounted device includes a display, it may be referred to as a head mounted display (HMD). Head mounted devices may include sensors to capture data from an eyebox region.

Embodiments of generating health notifications from eye measurements are described herein. In the following description, numerous specific details are set forth to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.

Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

In some implementations of the disclosure, the term “near-eye” may be defined as including an element that is configured to be placed within 50 mm of an eye of a user while a near-eye device is being utilized. Therefore, a “near-eye optical element” or a “near-eye system” would include one or more elements configured to be placed within 50 mm of the eye of the user.

In aspects of this disclosure, visible light may be defined as having a wavelength range of approximately 380 nm-700 nm. Non-visible light may be defined as light having wavelengths that are outside the visible light range, such as ultraviolet light and infrared light. Infrared light having a wavelength range of approximately 700 nm-1,000,000 nm includes near-infrared light. In aspects of this disclosure, near-infrared light may be defined as having a wavelength range of approximately 700 nm-1600 nm.

In aspects of this disclosure, the term “transparent” may be defined as having greater than 90% transmission of light. In some aspects, the term “transparent” may be defined as a material having greater than 90% transmission of visible light.

1 8 FIGS.- Implementations of devices, systems, and methods of operating a head mounted device in response to eye data are disclosed herein. Eye data of a user of a head mounted device may be captured by sensors of the head mounted device. The sensors may include image sensors, photodiodes, micro-electro-mechanical systems (MEMS) mirrors, ultrasound, or LIDAR units, for example. The eye data may include one or more images of the eye, a position of the eye, a measurement of the eye (e.g. pupil size), and/or a measurement of the eye over time (e.g. speed of pupil dilation). If the eye data reaches an outlier threshold value, a user notification is generated. In a specific illustration, a pupil size of an eye of a user is measured using an eye-tracking system. If the pupil size of the eye is much larger than previous pupil sizes (previous eye data) of the same user for an extended period of time, a concussion notification is generated. The notification may be included in a virtual image presented to the user by the head mounted device. In other implementations, the concussion notification may be sent to a third party such as a coach, parent, and/or medical provider. These and other embodiments are described in more detail in connection with.

1 FIG. 100 100 102 104 104 110 110 108 108 104 104 108 108 108 108 110 110 108 108 108 108 108 108 illustrates an example head mounted device, in accordance with aspects of the present disclosure. The illustrated example of head mounted deviceis shown as including a frame, temple armsA andB, and near-eye optical elementsA andB. CamerasA andB are shown as coupled to temple armsA andB, respectively. CamerasA andB may be configured to image an eyebox region to image the eye of the user to capture eye data of the user. CamerasA andB may image the eyebox region directly or indirectly. For example, optical elementsA and/orB may have an optical combiner that is configured to redirect light from the eyebox to the camerasA and/orB. In some implementations, near-infrared light sources (e.g. LEDs or vertical-cavity side emitting lasers) illuminate the eyebox region with near-infrared illumination light and camerasA and/orB are configured to capture infrared images. CamerasA and/orB may include complementary metal-oxide semiconductor (CMOS) image sensor. A near-infrared filter that receives a narrow-band near-infrared wavelength may be placed over the image sensor so it is sensitive to the narrow-band near-infrared wavelength while rejecting visible light and wavelengths outside the narrow-band. The near-infrared light sources may emit the narrow-band wavelength that is passed by the near-infrared filters.

100 102 102 110 110 In addition to image sensors, various other sensors of head mounted devicemay be configured to capture eye data. Ultrasound or LIDAR chips may be configured in frameto detect a position of an eye of the user by detecting the position of the cornea of the eye, for example. Discrete photodiodes included in frameor optical elementsA and/orB may also be used to detect a position of the eye of the user. Discrete photodiodes may be used to detect “glints” of light reflecting off of the eye, for example. Eye data generated by various sensors may not necessarily be considered “images” of the eye.

1 FIG. 110 110 120 130 140 140 148 141 100 100 140 102 100 141 also illustrates an exploded view of an example of near-eye optical elementA. Near-eye optical elementA is shown as including an optically transparent layerA, an illumination layerA, and a display layerA. Display layerA may include a waveguidethat is configured to direct virtual images included in visible image lightto an eye of a user of head mounted devicethat is in an eyebox region of head mounted device. In some implementations, at least a portion of the electronic display of display layerA is included in the frameof head mounted device. The electronic display may include an LCD, an organic light emitting diode (OLED) display, micro-LED display, pico-projector, or liquid crystal on silicon (LCOS) display for generating the image light.

100 100 100 1 FIG. When head mounted deviceincludes a display, it may be considered a head mounted display. Head mounted devicemay be considered an augmented reality (AR) head mounted display. Whileillustrates a head mounted deviceconfigured for augmented reality (AR) or mixed reality (MR) contexts, the disclosed embodiments may also be used in other implementations of a head mounted display such as virtual reality head mounted displays. Additionally, some implementations of the disclosure may be used in a head mounted device that do not include a display.

130 126 126 100 126 100 126 110 126 100 126 109 110 126 126 126 126 Illumination layerA is shown as including a plurality of in-field illuminators. In-field illuminatorsare described as “in-field” because they are in a field of view (FOV) of a user of the head mounted device. In-field illuminatorsmay be in a same FOV that a user views a display of the head mounted device, in an embodiment. While in-field illuminatorsmay introduce minor occlusions into the near-eye optical elementA, the in-field illuminators, as well as their corresponding electrical routing may be so small as to be unnoticeable or insignificant to a wearer of head mounted device. Each in-field illuminatormay be disposed on a transparent substrate and may be configured to emit light to an eyebox region on an eyeward sideof the near-eye optical elementA. In some aspects of the disclosure, the in-field illuminatorsare configured to emit near infrared light (e.g. 750 nm-1.6 μm). Each in-field illuminatormay be a micro light emitting diode (micro-LED), an edge emitting LED, a vertical cavity surface emitting laser (VCSEL) diode, or a Superluminescent diode (SLED). In some implementations, illuminatorsare not in-field. Rather, illuminatorscould be out-of-field in some implementations.

1 FIG. 102 104 104 100 100 102 104 104 100 100 100 As shown in, frameis coupled to temple armsA andB for securing the head mounted deviceto the head of a user. Example head mounted devicemay also include supporting hardware incorporated into the frameand/or temple armsA andB. The hardware of head mounted devicemay include any of processing logic, wired and/or wireless data interface for sending and receiving data, graphic processors, and one or more memories for storing data and computer-executable instructions. In one example, head mounted devicemay be configured to receive wired power and/or may be configured to be powered by one or more batteries. In addition, head mounted devicemay be configured to receive wired and/or wireless data including video data.

1 FIG. 110 110 102 110 110 141 140 110 110 110 110 illustrates near-eye optical elementsA andB that are configured to be mounted to the frame. In some examples, near-eye optical elementsA andB may appear transparent or semi-transparent to the user to facilitate augmented reality or mixed reality such that the user can view visible scene light from the environment while also receiving image lightdirected to their eye(s) by way of display layerA. In further examples, some or all of near-eye optical elementsA andB may be incorporated into a virtual reality headset where the transparent nature of the near-eye optical elementsA andB allows the user to view an electronic display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED) display, or micro-LED display, etc.) incorporated in the virtual reality headset.

120 130 109 110 120 130 120 141 140 120 120 120 120 120 Optically transparent layerA is shown as being disposed between the illumination layerA and the eyeward sideof the near-eye optical elementA. The optically transparent layerA may receive the infrared illumination light emitted by the illumination layerA and pass the infrared illumination light to illuminate the eye of the user. As mentioned above, the optically transparent layerA may also be transparent to visible light such as scene light received from the environment and/or image lightreceived from the display layerA. In some examples, the optically transparent layerA has a curvature for focusing light (e.g., display light and/or scene light) to the eye of the user. Thus, the optically transparent layerA may, in some examples, may be referred to as a lens. In some aspects, the optically transparent layerA has a thickness and/or curvature that corresponds to the specifications of a user. In other words, the optically transparent layerA may be a prescription lens. However, in other examples, the optically transparent layerA may be a non-prescription lens.

2 2 FIGS.A andB 2 FIG.A 2 FIG.B 203 201 203 203 203 203 203 262 261 203 203 illustrate an eyein an eyebox region, in accordance with implementations of the disclosure.illustrates eyethat is open andillustrates eyeshut. Eye data of eyemay include a position of eye, a measurement of the eye(e.g. pupil size), and/or a measurement of the eye over time (e.g. speed of pupil dilation). The eye data may also include a movement and/or shape of eyebrows, movement and/or shape of eyelid, and/or facial micro gestures associate with skin lines for example. Eyemay be wide open, shut, or any variation in between. In some contexts, eyemay be squinting.

2 FIG.A 2 FIG.B 2 FIG.A 2 FIG.B 2 FIG.A 2 FIG.B 2 FIG.A 2 FIG.B 2 FIG.A 205 207 203 205 207 205 207 262 262 203 264 264 263 263 263 201 In, most of the irisand large portions of the scleraare visible. When eyeis squinting, less of irisand sclerawill be visible. In, neither irisnor scleraare visible. In, eyebrowis arched. In, eyebrowis flattened and closer to eyethan in. Similarly, smile lineis flattened incompared to the more arched smile linein.also illustrates an increased number of lines in corner regioncompared to the lines in corner regionof. The shape and or number of lines in corner regionmay correspond to micro gestures, squinting, cringing, eye strain, and/or user discomfort, for example. Therefore, detecting the size, shape, or quantity of various eye features in eyebox regionprovides eye data that can be indicative of a user reaction or adaptation to a particular environmental context.

2 FIG.C 2 FIG.D 203 266 291 203 266 292 291 266 266 266 illustrates eyehaving a pupilwith a diameter of dimension.illustrates eyehaving a pupilwith a diameter of dimensionthat is larger than dimension. In some implementations of the disclosure, eye data may include the size (e.g. diameter) of pupil. In some implementations of the disclosure, eye data may include the size (e.g. diameter) of pupilover a particular time period. Thus, when the size of pupilis captured over a plurality of time periods, the speed of pupil dilation may be determined.

2 2 FIGS.E andF 2 FIG.E 2 FIG.F 203 293 205 261 265 294 205 203 illustrate another example measurement of eyethat may be included in eye data, in accordance with implementations of the disclosure. For example, the dimensionof irisbetween top eyelidand bottom eye lidis larger inwhen compared to the dimensionof iriswhen eyeis squinting in.

3 3 FIGS.A-C 3 FIG.A 3 FIG.B 3 FIG.C 203 203 381 381 203 203 382 203 383 203 266 205 203 203 203 203 381 382 203 203 203 1 2 3 illustrates different positions of eyeat different times, in accordance with implementations of the disclosure.illustrates eyein a centered positionat a time t. Centered positionmay be associated with eyelooking straight forward at an object in the far field (e.g. focus distance of infinity).illustrates eyein a right-of-center positionat a time t.illustrates eyein a slightly-left-of-center positionat a time t. The position of eyemay be determined by tracking the position of pupil, iris, tracking the cornea (not specifically illustrated), and/or other suitable eye-tracking techniques. Thus, eye data may include a position of eyeand/or positions of eyeover time. The speed of a position change of eyemay be included in eye data. For example, if eyegoes from positionto positionvery quickly (e.g. within 200 ms), this movement may be considered a saccade. Smaller movements of eyein short time periods may be considered micro-saccades. The number of saccades or micro-saccades in a particular time period may be counted using image processing techniques or other suitable pupil position techniques. The number of saccades or micro-saccades in a particular time period may be included in eye data, in various implementations of the disclosure. The position changes of eyemay be considered gaze flickering where eyechanges position often but does not change position rapidly enough to be considered a saccade or micro-saccade. Gaze flickering may be a sign of discomfort due to ambient light brightness or display brightness. Squinting or squinting in combination with pupil dilation and gaze flicking may also be a sign of discomfort.

4 FIG. 4 FIG. 400 400 400 440 430 440 456 203 441 410 410 456 441 440 illustrates a top view of a portion of an example head mounted device, in accordance with implementations of the disclosure. The illustration ofillustrates a schematic for capturing eye data from a left eyebox region. Of course, a second half of the head mounted devicemay include a similar system to image a right eyebox region. Head mounted devicemay include a display layerand an illumination layer. All or a portion of display layermay be transparent or semi-transparent to allow scene lightfrom an external environment to become incident on eyeso that a user can view their external environment in addition to viewing virtual images presented in image light. Additional optical layers (not specifically illustrated) may also be included in example optical element. For example, a focusing lens layer may optionally be included in optical elementto focus scene lightand/or virtual images included in image lightgenerated by display layer.

430 426 201 427 430 426 427 477 203 477 203 410 427 201 477 477 410 4 FIG. Illumination layerincludes light sourcesconfigured to illuminate an eyebox regionwith infrared illumination light. Illumination layermay include a transparent refractive material that functions as a substrate for light sources. Infrared illumination lightmay be near-infrared illumination light. Camerais configured to image (directly) eye, in the illustrated example of. In other implementations, cameramay (indirectly) image eyeby receiving reflected infrared illumination light from an optical combiner layer (not illustrated) included in optical element. The optical combiner layer may be configured to receive reflected infrared illumination light (the infrared illumination lightreflected from eyebox region) and redirect the reflected infrared illumination light to camera. In this implementation, camerawould be oriented to receive the reflected infrared illumination light from the optical combiner layer of optical element.

477 426 203 477 201 Cameramay include a CMOS image sensor, in some implementations. An infrared filter that receives a narrow-band infrared wavelength may be placed over the image sensor so it is sensitive to the narrow-band infrared wavelength while rejecting visible light and wavelengths outside the narrow-band. Infrared light sources (e.g. light sources) such as infrared LEDs or infrared VCSELS that emit the narrow-band wavelength may be oriented to illuminate eyewith the narrow-band infrared wavelength. Cameramay capture eye-tracking images of eyebox region.

426 477 201 203 Light sourcesand cameraare merely an example eye-tracking system configuration and other suitable eye-tracking systems and techniques may also be used to capture eye data, in implementations of the disclosure. In an implementation, a MEMS mirror-based RGB laser system is used for capturing eye data. Other sensors of a head mounted device (not specifically illustrated) for capturing eye data may include photodiodes, ultrasound, or LIDAR units, for example. Eyebox regionmay include eyeas well as surrounding features in an ocular area such as eyebrows, eyelids, eye lines, etc.

470 477 477 479 470 470 201 470 470 266 470 2 3 FIGS.A-C 5 7 FIGS.and Processing logicmay initiate one or more image captures with cameraand cameramay provide eye data(that may include eye-tracking images) to processing logic. Processing logicmay perform image processing to determine the size and/or position of various features of the eyebox region. For example, processing logicmay be configured to determine size and/or position of the features described in association with. Processing logicmay perform image processing to determine a pupil position or pupil size of pupil. Processing logicmay perform image processing to determine saccade and/or micro-saccade events over a fixed time period. Additional techniques are described below with respect to.

4 FIG. 475 470 475 470 475 470 470 441 475 470 400 In the illustrated implementation of, a memoryis included in processing logic. In other implementations, memorymay be external to processing logic. In some implementations, memoryis located remotely from processing logic. In implementations, virtual image(s) are provided to processing logicfor presentation in image light. In some implementations, virtual images are stored in memory. Processing logicmay be configured to receive virtual images from a local memory or the virtual images may be wirelessly transmitted to the head mounted deviceand received by a wireless interface (not illustrated) of the head mounted device.

440 441 201 203 470 440 441 201 470 477 479 479 203 201 470 479 470 440 443 470 481 481 400 481 Display layerpresents virtual images in image lightto an eyebox regionfor viewing by an eye. Processing logicis configured to drive virtual images onto display layerto present image lightto eyebox region. Processing logicmay be configured to drive one or more sensors (e.g. camera) of an eye-tracking system to capture eye-tracking data such as eye data. Eye datamay include images of an eyeoccupying eyebox region. Processing logicmay be configured to generate a user notification in response to eye data. In an implementation, processing logicdrives near-eye displayto present the user notification to the eyebox region in a virtual image. In an implementation, processing logiccauses the user notification to be wirelessly transmitted to a wireless network in a wireless message. Wireless messagemay be wirelessly transmitted by a wireless radio (not specifically illustrated) of head mounted device. The user notification of wireless messagemay be transmitted to a computing device such as a smartwatch, smartphone, tablet, or otherwise.

5 FIG. 500 500 500 500 illustrates a flow chart illustrating an example process, in accordance with implementations of the disclosure. The order in which some or all of the process blocks appear in processshould not be deemed limiting. Rather, one of ordinary skill in the art having the benefit of the present disclosure will understand that some of the process blocks may be executed in a variety of orders not illustrated, or even in parallel. All or a portion of processmay be executed by processing logic of a head mounted device. In some implementations, at least a portion of processis executed by processing logic that is remote from the head mounted device (e.g. cloud processing).

505 201 In process block, eye data is captured with one or more sensors of a head mounted device. The one or more sensors are configured to sense an eyebox region (e.g. eyebox region). The sensors may include a camera (including an image sensor), photodiodes, ultrasound, and/or LIDAR units, for example.

470 The eye data may include one or more images of the eyebox region. The eye data may include at least one of a pupil size of an eye, speed of pupil dilation of the eye, a gaze direction of the eye, or eye-movement data. In some implementations, the eye data may be generated by performing image processing on one or more images of an eye. Processing logicmay perform image processing, in some implementations.

510 In process block, a differential value is generated by comparing the eye data to previous data. The previous data may include previous eye data from a specific user. The previous eye data may include at least one of a previous pupil size of an eye, previous speed of pupil dilation of the eye, a previous gaze direction of the eye, or previous eye-movement data. The previous eye data may be stored in a memory of the head mounted device or stored in a memory remote from the head mounted device. The previous data may be user-specific or aggregate health data that is not user-specific (e.g. data that is crowd-sourced). For example, user-specific data may be a previous pupil diameter measured by the head mounted device whereas aggregate health data may be an average pupil size of a given user group or demographic.

515 481 440 881 810 500 505 515 4 FIG. 4 FIG. 8 FIG. In process block, a user notification is generated in response to the differential value reaching an outlier threshold value. In an implementation, generating the user notification includes wirelessly transmitting the user notification (e.g. user notification in wireless messagein) to a wireless network. The user notification may be a message to a user account, a doctor, or a parent, for example. In an implementation, generating the user notification includes driving a near-eye display (e.g. displayof) of the head mounted device to present the user notification to the user in a virtual image.illustrates an example user notificationincluded in a virtual image that is presented to a user in a near-eye optical elementthat includes a near-eye display. Processmay return to process blockafter executing process block.

500 477 203 201 In an example implementation of process, cameracaptures images of an eyein eyebox region. Image processing is performed on the one or more images of the eye to determine a heart rate of a user of the head mounted device and the eye data includes the heart rate. The heart rate of a user can be generated by performing image processing on a series of images of an eye by analyzing the pupil diameter over time, for example. In another implementations, the heart rate of a user can be generated by performing image processing on a series of images of an eye by analyzing the size of blood vessels of the eye over time. In this technique, the expansion and contraction of the blood vessels corresponds to the heart rate. After the heart rate of the user is determined, it may be compared to a previous heart rate of the user stored in a memory. The previous heart rate of the user may have previously been determined by the head mounted device (or other wearable device) and stored in the memory. The differential value is generated by comparing the determined heart rate from the previously stored heart rate. Hence, if the determined heart rate was 200 beats-per-minute (bpm) and the previously stored heart rate was 160 bpm, the differential value may be 40 bpm. If the outlier threshold value is 20 bpm above 160 bpm, then the user notification may be generated since the 40 bpm differential value reaches the 20 bpm outlier threshold value. A heart rate of 200 bpm may be an indication of a health event or of hyper-aerobic activity, for example.

500 477 203 201 In another example implementation of process, cameracaptures images of an eyein eyebox region. Image processing is performed on the one or more images of the eye to determine a number of saccades in a fixed time period (e.g. in one minute) of a user of the head mounted device and the eye data includes the number of saccades in the fixed time period as eye-movement data. After the number of saccades in the fixed time period is determined, it may be compared to a previous number of saccades over the same fixed time period of the user stored in a memory. If the number of saccades over the same fixed time period exceeds an expected number of saccades in the fixed time period by the outlier threshold value, a user notification may be generated. Or, if the number of saccades over the same fixed time period is below an expected number of saccades in the fixed time period by the outlier threshold value, a user notification may be generated. An increase or decrease of saccades over a particular time period compared to an average amount of saccades or “normal” number of saccades may be indicative of a condition or a traumatic event (e.g. a concussion).

500 477 201 Processmay further include increasing a capture-rate of capturing the eye data in response to the differential value reaching the outlier threshold value. For example, a frame-rate of images captured by cameramay be increased in order to capture more frequent images of eyebox regionfor further analysis.

500 477 477 In implementations of process, an eye brightness value of the eyebox region may be relevant to the eye data being captured. For example, in bright sunlight conditions, an eye brightness value of the eyebox region may be quite high and result in a smaller pupil diameter. The eye brightness value represents an intensity of light that is incident on the eyebox region. Cameramay output an eye brightness value based on pixel values of an image sensor in camera. In other implementations, one or more photodiodes included in a head mounted device may be directed to receive light from the eyebox region to measure the eye brightness value of the eyebox region. Comparing the captured eye data to previous eye data may be best when the eye data is captured under similar illumination levels (e.g. dark environments or bright environments).

6 FIG. 675 613 611 623 621 675 693 691 675 611 613 611 621 621 623 613 illustrates example previous eye brightness values paired with previous eye data in a memory, in accordance with implementations of the disclosure. In particular, a first previous eye brightness valueis paired with first previous eye dataand a second previous eye brightness valueis paired with second previous eye data. Memorymay include integer n number of previous eye brightness valuespaired with n number of previous eye data. Thus, given a measured eye brightness value, previous eye data can be selected from memoryfor a similar eye brightness value. By way of example illustration, a pupil diameter of eye datamay correspond with a very low eye brightness value. For example, a pupil diameter in eye datamay be large when the user is using the head mounted device in a darker environment. A pupil diameter in eye datamay be slightly smaller than the pupil diameter in eye datawhen the eye brightness valueis higher than the darker environment of eye brightness value.

500 675 611 613 675 An implementation of processmay utilize a memory such as memoryto execute further operations including determining an eye brightness value of the eyebox region at approximately a same time as the eye data is captured where the eye brightness value represents a brightness of visible light on the eyebox region. In this case, generating the differential value may include comparing the eye data paired with the eye brightness value to previous eye data (e.g. data) paired with a previous eye brightness value (e.g. value) in a same range as the eye brightness value measured at the same time the eye data is captured. By way of example, the measured eye brightness value may be associated with the numerically closest previous eye brightness value stored in memory. The previous eye data paired with the numerically closest previous eye brightness value then becomes the previous eye data for the generating the differential value.

7 FIG. 700 700 illustrates a flow chart illustrating an example concussion notification process, in accordance with implementations of the disclosure. The order in which some or all of the process blocks appear in processshould not be deemed limiting. Rather, one of ordinary skill in the art having the benefit of the present disclosure will understand that some of the process blocks may be executed in a variety of orders not illustrated, or even in parallel.

Concussions may result from sports or other activities. Pupils that are larger than normal (dilated pupils) may indicate a possible concussion. Or, pupils of different sized (e.g. the right pupil and the left pupil are different diameters) may indicate a possible concussion. Thus, a concussion of a user may be detected from measuring eye pupil size.

705 479 In process block, pupil-size data is captured with one or more sensors of a head mounted device. The one or more sensors are configured to sense the eyebox region. The pupil-size data may be determined by performing image processing techniques on images of eye data, for example.

710 In process block, differential values are generated by comparing the pupil-size data to baseline pupil data. The baseline pupil data may be specific to the user under certain light conditions or the baseline pupil data may be a crowd-sourced average pupil data, for example.

715 881 8 FIG. In process block, a concussion notification is generated in response to the differential values remaining outside an outlier threshold value for an extended time period. The outlier threshold value may be a larger pupil diameter or be expressed as a percentage increase of the baseline pupil data for a particular light condition. If the pupil remains much larger than expected for an extended period of time, the user may have experienced a concussion. The concussion notification may be delivered in a virtual image such as notificationinor may be delivered via a message transmitted with a wireless radio of the head mounted device. The concussion notification may be transmitted to a computing device such as a smartwatch, smartphone, tablet, or otherwise.

In some implementations, both the right and left pupil diameter over a time period may be logged. A difference in pupil diameter between the right and left pupil (over a certain time period) may also generate a concussion notification.

Embodiments of the invention may include or be implemented in conjunction with an artificial reality system. Artificial reality is a form of reality that has been adjusted in some manner before presentation to a user, which may include, e.g., a virtual reality (VR), an augmented reality (AR), a mixed reality (MR), a hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include completely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, haptic feedback, or some combination thereof, and any of which may be presented in a single channel or in multiple channels (such as stereo video that produces a three-dimensional effect to the viewer). Additionally, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, e.g., create content in an artificial reality and/or are otherwise used in (e.g., perform activities in) an artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a head-mounted display (HMD) connected to a host computer system, a standalone HMD, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.

470 The term “processing logic” (e.g. processing logic) in this disclosure may include one or more processors, microprocessors, multi-core processors, Application-specific integrated circuits (ASIC), and/or Field Programmable Gate Arrays (FPGAs) to execute operations disclosed herein. In some embodiments, memories (not illustrated) are integrated into the processing logic to store instructions to execute operations and/or store data. Processing logic may also include analog or digital circuitry to perform the operations in accordance with embodiments of the disclosure.

475 675 A “memory” or “memories” (e.g. memoryand/or memory) described in this disclosure may include one or more volatile or non-volatile memory architectures. The “memory” or “memories” may be removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data. Example memory technologies may include RAM, ROM, EEPROM, flash memory, CD-ROM, digital versatile disks (DVD), high-definition multimedia/data storage disks, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by a computing device.

Networks may include any network or network system such as, but not limited to, the following: a peer-to-peer network; a Local Area Network (LAN); a Wide Area Network (WAN); a public network, such as the Internet; a private network; a cellular network; a wireless network; a wired network; a wireless and wired combination network; and a satellite network.

2 Communication channels may include or be routed through one or more wired or wireless communication utilizing IEEE 802.11 protocols, BlueTooth, SPI (Serial Peripheral Interface), IC (Inter-Integrated Circuit), USB (Universal Serial Port), CAN (Controller Area Network), cellular data protocols (e.g. 3G, 4G, LTE, 5G), optical communication networks, Internet Service Providers (ISPs), a peer-to-peer network, a Local Area Network (LAN), a Wide Area Network (WAN), a public network (e.g. “the Internet”), a private network, a satellite network, or otherwise.

A computing device may include a desktop computer, a laptop computer, a tablet, a phablet, a smartphone, a feature phone, a server computer, or otherwise. A server computer may be located remotely in a data center or be stored locally.

The processes explained above are described in terms of computer software and hardware. The techniques described may constitute machine-executable instructions embodied within a tangible or non-transitory machine (e.g., computer) readable storage medium, that when executed by a machine will cause the machine to perform the operations described. Additionally, the processes may be embodied within hardware, such as an application specific integrated circuit (“ASIC”) or otherwise.

A tangible non-transitory machine-readable storage medium includes any mechanism that provides (i.e., stores) information in a form accessible by a machine (e.g., a computer, network device, personal digital assistant, manufacturing tool, any device with a set of one or more processors, etc.). For example, a machine-readable storage medium includes recordable/non-recordable media (e.g., read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).

The above description of illustrated embodiments of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific embodiments of, and examples for, the invention are described herein for illustrative purposes, various modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.

These modifications can be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.