Non-Contact Variable Sensor System for Key Point Temperature Evaulation in Animals

This non-provisional patent application is based on and claims priority to U.S. Provisional Patent Application Number 63/691,789, filed on Sep. 6, 2024, the disclosure of which is incorporated by reference as if fully recited herein.

The present invention relates generally to medical systems, and more particularly to a variable sensor system for non-contact temperature monitoring of animals. Non-contact temperature detection may involve detecting a subject's temperature at various key points on the subject. One embodiment of the invention uses key point detection for thermal images for temperature detection.

Measurement of a subject's physiological health through temperature monitoring is commonly used, and is useful, in medical diagnostics. Traditionally, animal temperature measurements have been accomplished by direct contact with an animal subject through the use of temperature sensors, primarily hand-held thermometers. For example, veterinarians have tracked the health of animal patients by placing a thermometer directly on one or more of various locations on an animal.

An issue with known techniques for tracking the health of animal patients by monitoring their temperature includes that the direct contact with an animal may make the animal uncomfortable, especially where there are repeated instances of direct contact. Also, in cases where the subject is a potentially aggressive animal, it may not be safe to the medical provider to come in contact with or even come close to the animal. Moreover, in cases where vitals are routinely monitored on a moving object (e.g., a moving animal, such as an animal in a herd), the use of contact sensors may be frustrated by the constant movement. In other instances where a subject animal may be violent, or is contaminated with a pathogen (e.g., a virus) or another substance, being close to the subject may pose a health threat to the medical practitioner.

Another issue with known techniques is that it may be time consuming and/or cumbersome for a veterinarian or other health specialist to employ multiple separate temperature measurements to gather data about the temperature of a subject at various key points (e.g., various points across the face of a subject). An example of why this may be problematic is that the longer an animal undergoes medical testing, the more uncomfortable or distressed the animal may become. Where the subject is a potentially aggressive animal, this may pose a threat to the veterinarian or other health specialist.

The aforementioned shortcomings speak to the need for a system that quickly and remotely obtains and organizes temperature data for a number of key points in a variety of settings. In view of this, it is beneficial to have a non-contact variable sensor system for key point temperature evaluation in animals, and a corresponding method of obtaining and organizing key point temperature information about an animal involving the non-contact variable sensor system.

According to the present invention in one aspect, a first camera and a second camera are provided. The first camera may be configured to capture a first image of an animal. The second camera may be configured to capture a second image of the animal. A processor may be configured to map information from the first image onto the second image to allow for temperature to be evaluated at one or more key points of interest. The first camera may be an RGB imaging device, and the first image may be an RGB image. The second camera may be a thermal imaging device, and the second image may be a thermal image.

Advantages of the present invention, may include, promoting comfort of animal patients, reducing effort required of animal health specialists to gather and organize medical information about animal patients, reducing the length of a veterinary appointment, eliminating dangers to animal health specialists related to getting too close to an animal subject, monitoring mobile subjects in a herd, promoting accuracy of animal health data, and the like.

Various embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In the following description, specific details such as detailed configuration and components are merely provided to assist the overall understanding of these embodiments of the present invention. Therefore, it should be apparent to those skilled in the art that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present invention. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness.

1 FIG. 10 10 10 Referring now to, an exemplary non-contact variable sensor system for key point temperature evaluation in animalsis shown. The systemmay be configured to perform temperature detection, temperature data organization, temperature data communication to a user, some combination thereof, or the like steps automatically, in real time. Animal temperature data may be stored in a temporary or permanent database and may be electronically transmitted to a medical chart for an animal, to update a pre-existing chart in the case of a known patient to a veterinarian (or a first chart for the animal may be established in the case of a new patient). Any number of different electronic communication channels may be employed without departing from the scope of the present invention. Furthermore, the present invention is not limited to any particular type of camera, other sensor device, computing device, and/or database software. The systemmay be integrated into one or more variable sensing devices, such as those described in U.S. Pat. Nos. 7,903,020, 7,848,896, 8,721,554, 8,814,805, 9,200,945, 11,813,043, and U.S. Pat. Pub. No. US20100204587, although such is not required.

10 An exemplary computing device for the systemmay have a monitor display that may permit user interaction with an exemplary medical record database (patient record system for various different animals) by way of a system interface. A user may interact with the interface to access medically relevant information about one or more animals. Each data point stored to a patient record system may include a date and time label. The user may be permitted to toggle between different unit types (e.g., metric system versus imperial system/U.S. standard) for certain datasets. Any number of different software modules may be employed to promote user interaction with data stored to a medical record database. Infrared filters and/or other filters may be used with exemplary audio and/or imaging systems to assist in vital sign adjudication (e.g., temperature detection), although such is not required.

10 10 10 One or more algorithms may be implemented as part of the thermal detection systemto compare and improve data obtained by the thermal detection system. The thermal detection systemmay be used to determine if an animal or other subject has a fever. Additionally, or alternatively, the thermal detection system may be used to determine if an animal or other subject is present proximate to a sensing device (e.g., by comparing the temperature of the subject to the temperature of the subject's surroundings). Any type and/or number of different sensors (and data acquisition or comparison algorithms related to the sensors) may be provided to analyze subject vitals and/or physiological signals without departing from the scope of the present invention.

10 10 10 Different computing devices of the systemmay be dedicated to different methods of measurement, although such is not required. A computing system may be configured to operate in parallel or sequentially in regard to reading from various sensors. Collected data may be directed to the processor P for additional processing and/or application of one or more algorithms to be applied on the data/information. To promote real-time display of data measured by the system, computing devices linked to and/or integrated with the systemmay be in electronic communication with any number of different electronic display screens. An exemplary electronic display may display measured, resolved, and/or adjudicated data related to a subject. A computer readable medium may be provided to store an executable sequence of steps, that when executed performs the desired combination of steps. For example, a CPU may be provided to execute a sequential workflow, a GPU may be provided to execute a parallel computing workflow, an FPGA or ASIC may be implemented in hardware, or a hybrid approach such as FPGA+CPU hardware-software co-design implementation.

1 3 FIGS.- 1 FIG. 10 14 16 12 16 10 Referring now to, an exemplary non-contact variable sensor systemmay involve key point detection of thermal images for animal temperature detection. In this particular embodiment, a first cameraA of a variable sensor deviceis configured to capture a first image (an RGB color model—as show in) of an animal(e.g., a dog in a kennel). The devicemay include a processor P and/or may be in electronic communication with a processor configured to implement software providing a machine learning/artificial intelligence (AI) model M. The software may be implemented using MATLAB, JAVA, CGI script, Python, some combination thereof, or the like. Systemsoftware may be stored on an electronic storage medium, and may be executed with the cooperation of a controller and memory.

14 16 14 12 2 FIG. 2 FIG. After an RGB color image is captured by the first cameraA of device, the processor P, by way of model M, may be configured to detect and/or identify key points or areas of interest (e.g., face, eyes, ears, nose, some combination thereof, or the like) in the image. A second camera (thermal imaging cameraB—as shown in) may be configured to capture a second image (a thermal image) of the animal. The first and second images may be captured at the same time. The key points or areas of interest captured from the RGB color image may be mapped to the second/thermal image (as shown in). The first and second cameras may provide different image pixels, fields of view, some combination thereof, or the like with respect to one another. An exemplary variable sensor device is not limited to any particular type and/or number of cameras.

12 10 3 FIG. 2 FIG. After the second image is mapped with key points or areas of interest identified from the first image, temperature may be extracted from the second/thermal image to determine the temperature for each identified key point/area of interest. As a non-limiting example, where an eye of the animalis detected from the first image (RGB color image), and pixels from the identified eye are mapped to the second image (thermal image), systemsoftware may be configured to determine and communicate a temperature of the eye based on thermal image data (e.g., by comparing thermograms from the identified key point in the second image with a temperature known to correspond to the thermograms). Referring to, key points of interest may be output in a text format (e.g., a computer readable format) for conversion and identification of the key points of interest in the thermal image. Probabilities of the features detected may also be provided. Referring to, key points and/or areas of interest may be visually represented on a thermal image, but such is not required.

10 Advantages of the systeminclude, for example, speed and accuracy of key point detection. Detecting key points or areas from a thermal image (as opposed to an RGB image) is time consuming and not reliable. Key features (e.g., eyes, nose) are generally difficult to detect and identify from a thermal image. Based on this difficulty, known methods for training data on a thermal image are problematic (e.g., there may be inaccuracies with training data, and/or large amounts of data may be required for training, leading to long analysis periods). Known methods for detecting maximum and minimum temperature from a thermal image alone are also problematic because, e.g., various sources of hot or cold objects may negatively impact a temperature evaluation algorithm.

16 16 As a non-limiting example, data from an RGB image taken by an RGB camera of a sensing devicemay be overlaid to a thermal image taken by a thermal imaging camera of the deviceto permit the processor to evaluate thermograms in an overlaid image to determine temperature of an animal's eye. As another non-limiting example, a camera may track whether any atypical substances are present at and/or discharged from an animal's eye(s). Examples of atypical substances include but are not limited to abnormal ocular discharge and/or foreign material. As another non-limiting example, a camera may track movement of an animal's eye(s) to determine if there are any abnormalities.

16 16 16 16 16 16 16 16 The processor P may be provided separate from an exemplary non-contact variable sensor device, or may be integrated with the device. The devicemay be positioned over or otherwise proximate to a stall (e.g., a horse stall), crate, or kennel. A transducer may cause transmission and/or receiving of device signals. The information communicated to the processor may be stored in the cloud (e.g., so that the information may be accessed by a computing device at any number of different locations). Information about a subject's eyes stored to the cloud may be communicated to the device, an electronic display thereof, or the like. The devicemay be placed in the range of internet connection to ensure information from the cloud may be communicated to the device. Data acquisition and processing related to the subject's eyes may be improved upon by artificial intelligence/machine learning. For example, data about the subject's eyes may be displayed on an electronic display position at the deviceand/or in electronic communication with the device.

10 10 10 Aspects of the systemmay be communicated and/or displayed to system users and/or administrators by way of any number of different computer readable mediums implemented according to one or more software modules. Software instructions of the systemmay be executed by the processor P. Systemsoftware may be implemented using MATLAB, JAVA, CGI script, Python, some combination thereof, or the like. The present invention is not limited to any particular computing and/or display device, nor is it limited to any particular shape, size, component arrangement and/or design. The present invention is further not limited to the use of an exemplary cloud module with only eye information. An exemplary cloud module may be used to store and communicate information about any number of different features of a subject.

10 The systemmay include a transmitter configured to transmit data from a non-contact variable sensor to a medical record database. Medically useful information may be detected by an exemplary sensor automatically, and may be communicated to a medical record database automatically (by way of a processor linked to a sensor of a sensing device). Any embodiment described herein may include a processor configured to communicate (e.g., by way of a Bluetooth signal) medically useful information detected by a non-contact variable sensor to an interface of a software application.

The exemplary embodiments herein disclosed are not intended to be exhaustive or to unnecessarily limit the scope of the invention. The exemplary embodiments were chosen and described in order to explain the principles of the present invention so that others skilled in the art may practice the invention. Although embodiments described herein were described with reference to obtaining and organizing medical information about an animal, it will be apparent to one of ordinary skill in the art that an exemplary embodiment of the present invention may also be useful for other purposes.

Any embodiment of the present invention may include any of the features of the other embodiments of the present invention. Furthermore, certain operations described herein may be performed by one or more electronic devices. Each electronic device may comprise one or more processors, electronic storage devices, executable software instructions, and the like configured to perform the operations described herein. The electronic devices may be general purpose computers or specialized computing devices. The electronic devices may comprise personal computers, smartphone, tablets, databases, servers, or the like. The electronic connections and transmissions described herein may be accomplished by wired or wireless means. The computerized hardware, software, components, systems, steps, methods, and/or processes described herein may serve to improve the speed of the computerized hardware, software, systems, steps, methods, and/or processes described herein.

Having shown and described exemplary embodiments of the present invention, those skilled in the art will realize that many variations and modifications may be made to the described invention. Many of those variations and modifications will provide the same result and fall within the spirit of the claimed invention. It is the intention, therefore, to limit the invention only as indicated by the scope of the claims.