Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. An image processing system comprising: an image input unit for inputting images photographed respectively by a plurality of cameras provided to photograph a photographing target region at a plurality of angles; a depth information calculating unit for calculating, every pixel, depth information representing distances from the cameras of moving objects included in a plurality of photographed images input by the image input unit; a 3D information generating unit for setting a plurality of projection planes in adaptation to a relative angular relationship between the cameras and projecting values of each of pixels of the moving objects included in the photographed images input by the image input unit in directions of the projection planes corresponding to the respective photographed images in accordance with the depth information, thereby generating 3D information obtained by synthesizing, into one, the moving objects included in the photographed images; an overlooking image generating unit for synthesizing the 3D information of the moving object generated by the 3D information generating unit with a space image representing a space of the photographing target region, thereby generating an overlooking image of the photographing target region; and a display control unit for displaying, on a display, the overlooking image generated by the overlooking image generating unit.
An image processing system uses multiple cameras to create a 3D overview of a target region. The system inputs images from cameras positioned at different angles. For each pixel in these images, it calculates depth information (distance from the camera). Based on the depth, the system projects pixel values onto corresponding projection planes, synthesizing the moving objects in the images into a single 3D representation. This 3D information is combined with a space image of the target region to create an "overlooking" image, which is then displayed. This provides a comprehensive view of the target area and moving objects within it.
2. The image processing system according to claim 1 further comprising a relevant information generating unit for generating relevant information relating positions of respective pixels configuring the 3D information to a photographed image serving as projection sources of values of the pixels, thereby storing the relevant information in a relevant information storing unit, wherein when a position on the 3D information is designated, the display control unit displays, on the display, a photographed image related to the designated position by referring to the relevant information stored in the relevant information storing unit.
The image processing system described in Claim 1 also tracks the origin of each pixel in the 3D representation. It generates "relevant information" that links pixel positions in the 3D data back to the original camera image they came from and stores this information. If a user selects a point in the 3D "overlooking" image, the system refers to the stored relevant information and displays the original camera image associated with that point, providing a way to see the source image for any selected detail in the overview.
3. The image processing system according to claim 1 , wherein the display is configured from a portable type display or a display provided in a portable terminal, and further includes: a position and azimuth detecting unit for detecting a current position of the portable type display or the portable terminal and a current azimuth where the display is turned; and a display target region specifying unit for specifying, as a display target region, any of the photographing target regions which is to be displayed as the overlooking image based on the current position and the current azimuth detected by the position and azimuth detecting unit, the 3D information generating unit generates the 3D information for the photographing target region included in the display target region specified by the display target region specifying unit, the overlooking image generating unit generates the overlooking image for the display target region specified by the display target region specifying unit, and the display control unit displays, on the display, the gird's-eye view image of the display target region specified by the display target region specifying unit.
In the image processing system described in Claim 1, the display is part of a portable device. The system also includes a position and orientation sensor to determine the device's location and viewing direction. Based on this location and direction, the system selects a specific region within the overall target area to display. It then generates the 3D information and overlooking image specifically for that selected region. This means the portable device only shows the "overlooking" image relevant to where the user is and what they are looking at.
4. The image processing system according to claim 1 further comprising: a motion detecting unit for analyzing a change on a time base of the 3D information generated by the 3D information generating unit, thereby detecting a motion of the moving object represented by the 3D information; a motion pattern storing unit for storing data on a predetermined motion pattern related to the moving object; a motion deciding unit for deciding whether or not the motion of the moving object detected by the motion detecting unit is coincident with a motion pattern stored in the motion pattern storing unit; and an alarm generating unit for generating an alarm when it is decided that the motion of the moving object is coincident with the motion pattern by the motion deciding unit.
The image processing system described in Claim 1 also analyzes motion within the 3D representation over time to detect the movement of objects. It compares the detected motion to predefined motion patterns stored in a database. If the detected motion matches a known pattern, the system generates an alarm. For example, if a moving object follows a path defined as a security breach pattern, the alarm will trigger, indicating a potential issue.
5. The image processing system according to claim 4 further comprising a moving object tracking unit for tracking a motion on a time base of the moving object decided to be coincident with the motion pattern by the motion deciding unit.
The image processing system from Claim 4 further includes a tracking feature. When the system identifies a motion pattern match and triggers an alarm, it also starts tracking the moving object. It follows the object's movement over time, allowing operators to monitor its path and behavior after the alarm has been raised. This facilitates a better understanding of the situation and enables a more effective response to the alarm event.
Unknown
November 28, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.