10733774

Device and Method of Displaying Heat Map on Perspective Drawing

PublishedAugust 4, 2020
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
17 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. An apparatus for displaying a heat map on a perspective drawing, the apparatus comprising: at least one processor configured to: detect an object from images captured by a plurality of cameras having different orientations; and calculate a horizontal distance between the detected object and each of the cameras; an object display configured to display the detected object on the perspective drawing based on the calculated horizontal distance; and a heat-map display configured to display the heat map according to a trace density of at least one object including the object displayed on the perspective drawing, wherein the at least one processor is further configured to adjust a size of the detected object using the horizontal distance, and generate the perspective drawing on which the detected object, of which the size is adjusted, is shown, wherein the at least one processor is further configured to calculate a horizontal distance between the detected object and a camera among the cameras based on a height of the detected object on a ground surface, a height of the detected object in an image captured by the camera and a focal length of the camera, wherein an optical axis of the camera is parallel with the ground surface, wherein the perspective drawing highlights a dead zone which is included in a particular area but is not included in photographing areas of the cameras, and wherein the cameras are configured to exchange live view video signals between each other, and generate a perspective drawing based on the exchanged live view video signals.

Plain English Translation

An apparatus for displaying a heat map on a perspective drawing uses a processor to detect objects from images captured by multiple cameras with different orientations. The processor calculates the horizontal distance between each detected object and each camera, then adjusts the object's size using this distance to generate a perspective drawing. This drawing highlights 'dead zones' (areas not covered by cameras within a particular region). An object display shows the detected objects on the perspective drawing based on their calculated horizontal distances. A heat-map display then shows a heat map according to the density of object traces on this drawing. The horizontal distance calculation specifically uses the object's height on the ground, its height in the camera image, and the camera's focal length, assuming the camera's optical axis is parallel to the ground. The cameras exchange live video signals to collaboratively generate the perspective drawing.

Claim 2

Original Legal Text

2. The apparatus of claim 1 , wherein the perspective drawing comprises preset information about a map indicating the particular area, and wherein the cameras are installed at the particular area, and the perspective drawing further displays placement of the cameras.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing by detecting objects with multiple cameras, calculating their horizontal distance (using object height, image height, focal length, with a parallel camera optical axis) to adjust object size and generate the drawing, and displaying a heat map based on object trace density (as described in Claim 1), further specifies the perspective drawing. The drawing incorporates preset map information for a particular area where the cameras are installed and visually displays the placement of these cameras within that area. The system also highlights dead zones not covered by cameras and cameras exchange live video to generate the drawing.

Claim 3

Original Legal Text

3. The apparatus of claim 2 , wherein the perspective drawing indicates a photographing range of each of the cameras, and wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing (as described in Claim 2, which involves object detection, distance calculation, size adjustment for display, heat map generation from trace density, horizontal distance based on object/image height and focal length with parallel optical axis, dead zone highlighting, camera placement on a preset map, and live video exchange for drawing generation), further enhances the perspective drawing. The drawing indicates the photographing range of each camera. Additionally, if the photographing areas of two or more cameras overlap, the perspective drawing clearly highlights these overlapping regions.

Claim 4

Original Legal Text

4. The apparatus of claim 1 , wherein the perspective drawing is two-dimensional or three-dimensional.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing by detecting objects with multiple cameras, calculating their horizontal distance (using object height, image height, focal length, with a parallel camera optical axis) to adjust object size and generate the drawing, and displaying a heat map based on object trace density (as described in Claim 1), specifies that the perspective drawing can be either two-dimensional (2D) or three-dimensional (3D). The system also highlights dead zones not covered by cameras and cameras exchange live video to generate the drawing.

Claim 5

Original Legal Text

5. The apparatus of claim 2 , wherein, if the perspective drawing is three-dimensional, a height of the object is indicated on the perspective drawing based on the calculated horizontal distance.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing (as described in Claim 2, which involves object detection, distance calculation, size adjustment for display, heat map generation from trace density, horizontal distance based on object/image height and focal length with parallel optical axis, dead zone highlighting, camera placement on a preset map, and live video exchange for drawing generation), if the perspective drawing is three-dimensional (3D), further indicates the object's height on the perspective drawing based on its calculated horizontal distance from the cameras.

Claim 6

Original Legal Text

6. The apparatus of claim 1 , the at least one processor further configured to: track eyes or hands of the detected object; and generate the perspective drawing based on the images captured by the cameras, wherein the heat-map display is further configured to display on the perspective drawing a path via which eye or hand tracking is performed on the detected object, or the heat map according to a trace density of the detected object which is obtained by performing the eye or hand tracking.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing by detecting objects with multiple cameras, calculating their horizontal distance (using object height, image height, focal length, with a parallel camera optical axis) to adjust object size and generate the drawing, and displaying a heat map based on object trace density (as described in Claim 1), further enhances object tracking and heat map display. The processor is configured to track the eyes or hands of the detected object and generates the perspective drawing from camera images. The heat-map display shows either the path of this eye/hand tracking, or a heat map representing the trace density derived from the eye or hand tracking data. The system also highlights dead zones not covered by cameras and cameras exchange live video to generate the drawing.

Claim 7

Original Legal Text

7. The apparatus of claim 6 , wherein the cameras are configured to exchange information with one another via a wired or wireless communication.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing (as described in Claim 6, which involves object detection, distance calculation, size adjustment for display, heat map generation from trace density, horizontal distance based on object/image height and focal length with parallel optical axis, dead zone highlighting, live video exchange for drawing, and tracking of object's eyes/hands to show tracking path or derived heat map), further specifies that the cameras are configured to exchange information with one another using either a wired or wireless communication method.

Claim 8

Original Legal Text

8. The apparatus of claim 6 , the heat-map display is further configured to display on the perspective drawing the heat map indicating the trace density of the detected object.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing (as described in Claim 6, which involves object detection, distance calculation, size adjustment for display, heat map generation from trace density, horizontal distance based on object/image height and focal length with parallel optical axis, dead zone highlighting, live video exchange for drawing, and tracking of object's eyes/hands to show tracking path or derived heat map), specifies that the heat-map display is configured to specifically show on the perspective drawing the heat map that indicates the trace density of the tracked detected object.

Claim 9

Original Legal Text

9. The apparatus of claim 6 , wherein the perspective drawing indicates information about the cameras.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing (as described in Claim 6, which involves object detection, distance calculation, size adjustment for display, heat map generation from trace density, horizontal distance based on object/image height and focal length with parallel optical axis, dead zone highlighting, live video exchange for drawing, and tracking of object's eyes/hands to show tracking path or derived heat map), additionally specifies that the perspective drawing indicates information about the cameras themselves.

Claim 10

Original Legal Text

10. The apparatus of claim 9 , wherein the perspective view indicates a photographing range of each of the cameras, and wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area.

Plain English Translation

This apparatus, for displaying a heat map on a perspective drawing (as described in Claim 9, which involves object detection, distance calculation, size adjustment for display, heat map generation from trace density, horizontal distance based on object/image height and focal length with parallel optical axis, dead zone highlighting, live video exchange for drawing, tracking of object's eyes/hands to show tracking path or derived heat map, and display of camera information on the drawing), further specifies the camera information. The perspective drawing indicates the photographing range of each camera and highlights any overlapping areas where the photographing ranges of two or more cameras intersect.

Claim 11

Original Legal Text

11. An apparatus for displaying a heat map on a perspective drawing, the apparatus comprising: at least one processor configured to: detect an object from images captured by a plurality of cameras having different orientations; and calculate a horizontal distance between the detected object and each of the cameras; an object display configured to display the detected object on the perspective drawing based on the calculated horizontal distance; and a heat-map display configured to display the heat map according to a trace density of at least one object including the object displayed on the perspective drawing, wherein the at least one processor is further configured to adjust a size of the detected object using the horizontal distance, and generate the perspective drawing on which the detected object, of which the size is adjusted, is shown, and configured to calculate a horizontal distance between the detected object and a camera among the cameras based on a height of a center of a lens of the camera on a ground surface and an angle between a virtual line connecting a bottommost end of the detected object and the center of the lens of the camera and an optical axis of the camera, wherein the optical axis of the camera is not parallel with the ground surface, and wherein the cameras are configured to exchange live view video signals between each other, and generate a perspective drawing based on the exchanged live view video signals.

Plain English Translation

An apparatus for displaying a heat map on a perspective drawing uses a processor to detect objects from images captured by multiple cameras with different orientations. The processor calculates the horizontal distance between each detected object and each camera. This distance is used to adjust the object's size and generate a perspective drawing where the adjusted object is shown. An object display shows the detected object on this drawing. A heat-map display shows a heat map according to the trace density of objects displayed. Crucially, the horizontal distance is calculated based on the camera lens's center height on the ground, and the angle between a virtual line from the object's bottommost end to the lens center, relative to the camera's optical axis, where the optical axis is *not* parallel to the ground. Cameras exchange live video signals to generate the perspective drawing.

Claim 12

Original Legal Text

12. A method of displaying a heat map on a perspective drawing, the method comprising: detecting an object from images captured by a plurality of cameras having different orientations; calculating a horizontal distance between the detected object and each of the cameras; displaying the detected object on the perspective drawing based on the calculated horizontal distance; and displaying the heat map according to a trace density of at least one object including the object displayed on the perspective drawing, wherein the displaying the detected object comprises adjusting a size of the detected object using the horizontal distance, and generating the perspective drawing on which the detected object, of which the size is adjusted, is shown, wherein the horizontal distance between the detected object and a camera among the cameras is calculated based on a height of a center of a lens of the camera on a ground surface and an angle between a virtual line connecting a bottommost end of the detected object and the center of the lens of the camera and an optical axis of the camera, and wherein the optical axis of the camera is not parallel with the ground surface, and wherein the cameras are configured to exchange live view video signals between each other, and generate a perspective drawing based on the exchanged live view video signals.

Plain English Translation

A method for displaying a heat map on a perspective drawing involves detecting an object from images captured by multiple cameras with different orientations. It then calculates the horizontal distance between the detected object and each camera. The detected object is displayed on the perspective drawing based on this distance, which includes adjusting the object's size and generating the drawing with the size-adjusted object. A heat map is then displayed according to the trace density of objects on the drawing. The horizontal distance calculation is based on the camera lens's center height on the ground and the angle between a virtual line from the object's bottommost end to the lens center and the camera's optical axis, where this optical axis is *not* parallel to the ground. Cameras exchange live video signals to generate the perspective drawing.

Claim 13

Original Legal Text

13. The method of claim 12 , wherein the perspective drawing indicates a particular area where the cameras are installed, and the perspective drawing comprises information about the cameras.

Plain English Translation

This method, for displaying a heat map on a perspective drawing (as described in Claim 12, which involves detecting objects from multiple cameras, calculating their horizontal distance using lens center height, an angle to the optical axis which is not parallel to the ground, adjusting object size for display, generating the drawing, and displaying a heat map based on object trace density, with cameras exchanging live video for drawing generation), specifies that the perspective drawing indicates a particular area where the cameras are installed and includes information about the cameras themselves.

Claim 14

Original Legal Text

14. The apparatus of claim 13 , wherein the perspective drawing indicates a photographing range of each of the cameras, wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area, and wherein the perspective drawing indicates a dead zone which is included in the particular area but is not included in photographing areas of the cameras.

Plain English Translation

This method, for displaying a heat map on a perspective drawing (as described in Claim 13, which involves object detection, distance calculation using lens center height/angle with non-parallel optical axis, size adjustment, heat map generation from trace density, live video exchange for drawing, and displaying the camera installation area and camera information), further enhances the perspective drawing. The drawing indicates the photographing range of each camera, highlights any overlapping areas where two or more cameras' photographing areas intersect, and also highlights a "dead zone" within the particular area that is not covered by the cameras' photographing areas.

Claim 15

Original Legal Text

15. The method of claim 12 further comprising: tracking eyes or hands of the detected object; generating the perspective drawing based on the images captured by the cameras; and displaying on the perspective drawing a path via which eye or hand tracking is performed on the detected object, or displaying the heat map according to a trace density of the detected object which is obtained by performing the eye or hand tracking.

Plain English Translation

This method, for displaying a heat map on a perspective drawing (as described in Claim 12, which involves detecting objects from multiple cameras, calculating their horizontal distance using lens center height, an angle to the optical axis which is not parallel to the ground, adjusting object size for display, generating the drawing, and displaying a heat map based on object trace density, with cameras exchanging live video for drawing generation), further comprises tracking the eyes or hands of the detected object. The perspective drawing is generated based on the images from the cameras, and either a path showing the eye or hand tracking is displayed on the drawing, or the heat map is displayed according to the trace density obtained by this eye or hand tracking.

Claim 16

Original Legal Text

16. The method of claim 15 , wherein the perspective view shows a photographing area of the cameras, wherein if photographing areas of two or more of the cameras overlap with one another, the perspective drawing indicates the overlapping area.

Plain English Translation

This method, for displaying a heat map on a perspective drawing (as described in Claim 15, which involves object detection, distance calculation using lens center height/angle with non-parallel optical axis, size adjustment, heat map generation from trace density, live video exchange for drawing, and tracking of object's eyes/hands to show tracking path or derived heat map), further specifies details for the perspective drawing. The perspective drawing shows the photographing area of the cameras, and if photographing areas of two or more cameras overlap, the drawing indicates these overlapping areas.

Claim 17

Original Legal Text

17. A non-transitory computer readable recording medium having recorded thereon a program for executing the method of claim 12 .

Plain English Translation

A non-transitory computer readable recording medium stores a program for executing a method of displaying a heat map on a perspective drawing. This method (as described in Claim 12) involves detecting an object from images captured by multiple cameras with different orientations, calculating the horizontal distance between the object and each camera using lens center height, an angle to the optical axis (which is not parallel to the ground), adjusting the object's size for display, generating the drawing with the size-adjusted object, and displaying a heat map based on object trace density. The cameras also exchange live video signals to generate the perspective drawing.

Patent Metadata

Filing Date

Unknown

Publication Date

August 4, 2020

Inventors

Soon Min BAE
Yeon Geol RYU

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “DEVICE AND METHOD OF DISPLAYING HEAT MAP ON PERSPECTIVE DRAWING” (10733774). https://patentable.app/patents/10733774

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/10733774. See llms.txt for full attribution policy.

DEVICE AND METHOD OF DISPLAYING HEAT MAP ON PERSPECTIVE DRAWING