10535113

Image Processing Apparatus, Image Processing Method, and Storage Medium for Generating a Mask Image

PublishedJanuary 14, 2020
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
16 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. An image processing apparatus, comprising: a computer executing instructions that, when executed by the computer, cause the computer to function as: an acquiring unit configured to acquire a background image and a captured image; an extraction unit configured to extract, from the captured image, an object region corresponding to a predetermined object; a first generation unit configured to generate a mask image for privacy protection on the object region; and a second generation unit configured to generate a composite image by combining the mask image generated by the first generation unit and the background image acquired by the acquiring unit, wherein the first generation unit extracts a plurality of pieces of color information from the background image, sets color information indicating single color based on the plurality of pieces of color information, and generates the mask image based on the set color information.

Plain English Translation

This invention relates to image processing for privacy protection, specifically in scenarios where an object (e.g., a person or sensitive information) must be obscured in a captured image while preserving the background. The problem addressed is ensuring privacy by dynamically generating a mask that blends seamlessly with the background, avoiding obvious obfuscation like pixelation or blurring. The apparatus includes a computer executing instructions to perform several functions. First, it acquires a background image and a captured image containing the object to be obscured. An extraction unit identifies the object region in the captured image. A first generation unit then creates a privacy mask for this region by analyzing multiple color samples from the background, determining a dominant or representative single color, and generating a mask image using this color. A second generation unit combines the mask with the background, replacing the object region while maintaining visual coherence. The mask’s color is derived from the background, ensuring it appears natural rather than artificially applied. This approach improves privacy protection by making the obscured region less noticeable compared to traditional methods like uniform black or white masks. The system is particularly useful in surveillance, medical imaging, or any application requiring selective privacy preservation.

Claim 2

Original Legal Text

2. The image processing apparatus according to claim 1 , wherein the first generation unit sets color information indicating a single color that is different from a color most used in a region of the background image corresponding to the object region from among colors indicated by the plurality of pieces of color information.

Plain English Translation

This invention relates to image processing techniques for enhancing object visibility in background images. The problem addressed is improving the clarity of objects in images where the object's color blends with the background, making it difficult to distinguish. The apparatus includes a first generation unit that processes an object region within a background image to enhance its visibility. Specifically, the first generation unit assigns color information to the object region that differs from the most dominant color in the corresponding background region. This ensures the object stands out against the background. The apparatus also includes a second generation unit that generates a composite image by combining the processed object region with the background image, ensuring seamless integration while maintaining visual distinction. The invention is particularly useful in applications like surveillance, medical imaging, or augmented reality, where object detection and recognition are critical. By dynamically adjusting the object's color based on the background, the system improves contrast and reduces visual clutter, enhancing user perception and analysis. The solution avoids manual adjustments, automating the process for real-time applications. The apparatus may also include a detection unit to identify the object region and a determination unit to analyze the background's color distribution, ensuring accurate color selection for optimal visibility.

Claim 3

Original Legal Text

3. The image processing apparatus according to claim 1 , further comprising an output unit configured to output the composite image.

Plain English Translation

The invention relates to image processing systems designed to enhance image quality by combining multiple images. The core problem addressed is the need to improve image clarity, resolution, or other visual attributes by merging data from multiple input images into a single composite image. The apparatus includes an image acquisition unit that captures or receives multiple images, which may be from different sources or perspectives. These images are processed by an image processing unit that aligns, registers, or otherwise combines them to generate a composite image with improved characteristics. The composite image may have higher resolution, reduced noise, or enhanced dynamic range compared to the individual input images. The apparatus further includes an output unit that provides the composite image to a display, storage device, or other destination for further use. The output unit ensures the processed image is delivered in a usable format, whether for real-time display, archival, or transmission. This system is particularly useful in applications requiring high-quality imaging, such as medical imaging, surveillance, or scientific research, where combining multiple images can yield superior results.

Claim 4

Original Legal Text

4. The image processing apparatus according to claim 1 , wherein the first generation unit generates the mask image by masking the object region based on the single color indicated by the set color information.

Plain English Translation

This invention relates to image processing, specifically improving object masking in images. The problem addressed is the difficulty of accurately isolating and masking objects in images, particularly when the object region needs to be highlighted or separated from the background using a single, user-defined color. The image processing apparatus includes a first generation unit that creates a mask image by applying a mask to an object region within an input image. The masking is performed based on color information provided by the user, which specifies a single color to be used for the mask. The apparatus ensures that the object region is clearly distinguished from the background by applying this single color uniformly across the masked area. This approach simplifies the masking process by reducing the need for complex color selection or gradient-based masking techniques, making it easier to isolate objects for further processing or editing. The apparatus may also include a second generation unit that generates a composite image by combining the mask image with the original image, allowing the masked object to be visually separated or highlighted. The system may further include a color setting unit that allows the user to define the single color used for masking, ensuring flexibility in how the object is presented. The invention is particularly useful in applications requiring precise object isolation, such as image editing, computer vision, and automated image analysis.

Claim 5

Original Legal Text

5. An image processing method, comprising: acquiring a background image and a captured image; extracting an object region corresponding to a predetermined object from the captured image; firstly generating a mask image for privacy protection on the object region; and secondly generating a composite image by combining the mask image and the background image, wherein the firstly generating extracts a plurality of pieces of color information from the background image, sets color information indicating single color based on the plurality of pieces of color information, and generates the mask image based on the set color information.

Plain English Translation

This invention relates to image processing techniques for privacy protection in captured images. The method addresses the problem of ensuring privacy by obscuring specific objects in images while maintaining visual coherence with the background. The process involves acquiring a background image and a captured image, then extracting an object region corresponding to a predetermined object from the captured image. A mask image is generated for privacy protection on the object region. The mask image is created by extracting multiple pieces of color information from the background image, setting a single color based on this extracted information, and generating the mask image using this color. Finally, a composite image is produced by combining the mask image with the background image, effectively obscuring the object while blending it naturally with the surroundings. This approach ensures that the masked region appears visually consistent with the background, enhancing privacy without disrupting the overall image composition. The method is particularly useful in applications requiring selective privacy protection, such as surveillance, social media, or public imaging systems.

Claim 6

Original Legal Text

6. A non-transitory computer-readable storage medium storing a program that causes a computer execute an image processing method, the image processing method comprising: acquiring a background image and a captured image; extracting an object region corresponding to a predetermined object from the captured image; firstly generating a mask image for privacy protection on the object region; and secondly generating a composite image by combining the mask image and the background image, wherein the firstly generating extracts a plurality of pieces of color information from the background image, sets color information indicating single color based on the plurality of pieces of color information, and generates the mask image based on the set color information.

Plain English Translation

This invention relates to image processing for privacy protection, specifically a method to obscure objects in captured images using background-derived color information. The system acquires a background image and a captured image, then extracts an object region (e.g., a person or sensitive item) from the captured image. A mask image is generated to cover this region, ensuring privacy by obscuring the object. The mask is created by analyzing multiple color samples from the background image, determining a representative single color, and applying this color to the mask. The final composite image combines the masked object region with the background, maintaining visual coherence while protecting privacy. The method ensures the mask blends naturally with the background by dynamically adapting its color to the surrounding environment, improving concealment effectiveness compared to fixed-color masks. This approach is useful in surveillance, photography, or any application requiring selective privacy protection in images.

Claim 7

Original Legal Text

7. An image processing apparatus, comprising: a computer executing instructions that, when executed by the computer, cause the computer to function as: an acquiring unit configured to acquire a background image and a target image which is captured by an imaging unit; an extraction unit configured to extract, from the target image, an object region corresponding to a predetermined object; a first generation unit configured to generate a mask image for privacy protection on the object region; and a second generation unit configured to generate a composite image by combining the mask image generated by the first generation unit and the background image acquired by the acquiring unit, wherein the first generation unit generates the mask image, for the privacy protection on the object region, based on first color information about the background image and second color information used for generating the mask image for the privacy protection on the object region extracted from a previous image of the target image.

Plain English Translation

This invention relates to image processing for privacy protection, specifically for obscuring objects in images while maintaining visual coherence with the background. The problem addressed is ensuring that privacy-masked regions in images blend naturally with the background, avoiding unnatural artifacts that may draw attention to the obscured content. The apparatus acquires a background image and a target image captured by an imaging unit. An extraction unit identifies an object region in the target image corresponding to a predetermined object, such as a person or sensitive information. A first generation unit creates a mask image for privacy protection over this region, using color information from both the background image and a previous image of the target image. This ensures the mask blends seamlessly with the background while maintaining consistent appearance across frames. A second generation unit combines the mask image with the background image to produce a composite image where the object is obscured but the overall scene remains visually coherent. The use of historical color information from previous images helps maintain temporal consistency in video sequences, reducing flickering or abrupt changes in the masked region. This approach improves privacy protection while minimizing visual disruption in the processed images.

Claim 8

Original Legal Text

8. The image processing apparatus according to claim 7 , wherein the first color information about the background image includes first color information about the background image corresponding to the object region extracted from the target image, wherein, if the first color information about the background image corresponding to the object region extracted from the target image is different from the second color information, the first generation unit generates the mask image, for the privacy protection on the object region extracted from the target image, by using the second color information, and wherein, if the first color information about the background image corresponding to the object region extracted from the target image is not different from the second color information, the first generation unit generates the mask image, for the privacy protection on the object region extracted from the target image, by using third color information different from the first color information about the background image corresponding to the object region extracted from the target image.

Plain English Translation

This invention relates to image processing for privacy protection, specifically in systems that generate mask images to obscure object regions in target images. The technology addresses the challenge of ensuring privacy by dynamically adjusting the color of the mask based on the background image's color properties. The apparatus extracts an object region from a target image and analyzes the background image's color information corresponding to that region. If the background color differs from a predefined second color, the mask is generated using the second color to obscure the object. If the background color matches the second color, the mask is generated using a third color, distinct from the background, to maintain visibility while still protecting privacy. This adaptive approach ensures the mask remains effective regardless of background color, enhancing privacy protection in various imaging applications. The system may also include additional features such as generating a composite image by combining the target image with the mask image, further refining the privacy protection process.

Claim 9

Original Legal Text

9. The image processing apparatus according to claim 8 , wherein, if the first color information about the background image corresponding to the object region extracted from the target image is different from the second color information, the first generation unit generates the mask image by masking the object region, extracted from the target image, based on the second color information, and wherein, if the first color information about the background image corresponding to the object region extracted from the target image is not different from the second color information, the first generation unit generates the mask image by masking the object region, extracted from the target image, based on the third color information.

Plain English Translation

This invention relates to image processing, specifically to techniques for generating mask images to isolate objects within a target image. The problem addressed is accurately masking an object region in an image when the background color information differs from the expected color information, ensuring precise object extraction for further processing or editing. The apparatus includes a first generation unit that creates a mask image by analyzing color information. The unit compares first color information of the background image corresponding to the extracted object region with second color information. If the first and second color information differ, the object region is masked based on the second color information. If they are the same, the object region is masked using third color information instead. This ensures accurate masking regardless of background variations, improving object isolation for applications like image editing, computer vision, or augmented reality. The system may also include additional units for extracting object regions and generating background images, which are used to determine the appropriate masking approach. The invention enhances the reliability of object extraction by dynamically adjusting the masking process based on color discrepancies.

Claim 10

Original Legal Text

10. An image processing apparatus, comprising: a computer executing instructions that, when executed by the computer, cause the computer to function as: an acquiring unit configured to acquire a background image and a target image which is captured by an imaging unit; an extraction unit configured to extract, from the target image, an object region corresponding to a predetermined object; a first generation unit configured to generate a mask image for privacy protection on the object region; a second generation unit configured to generate a composite image by combining the mask image generated by the first generation unit and the background image acquired by the acquiring unit; and an estimation unit configured to estimate a region corresponding to the predetermined object in a subsequent image of the target image, wherein the first generation unit generates the mask image, for the privacy protection on the object region, based on first color information about the background image corresponding to the object region and second color information about the background image corresponding to the estimated region estimated by the estimation unit.

Plain English Translation

This invention relates to image processing for privacy protection in surveillance or monitoring systems. The problem addressed is ensuring consistent privacy protection in sequential images where an object (e.g., a person) moves across a scene. The system acquires a background image and a target image from an imaging device. An extraction unit identifies an object region in the target image corresponding to a predetermined object (e.g., a person). A first generation unit creates a mask image for privacy protection over this object region, using color information from the background image that matches the object's location. A second generation unit combines this mask with the background image to produce a composite image where the object is obscured. An estimation unit predicts the object's position in subsequent images, allowing the system to dynamically adjust the mask based on updated background color data from the estimated region. This ensures seamless privacy protection as the object moves, maintaining visual continuity in the background. The approach improves over static masking by adapting to changes in the background behind the moving object.

Claim 11

Original Legal Text

11. The image processing apparatus according to claim 10 , wherein the first generation unit generates the mask image based on third color information which is different from the first color information and the second color information.

Plain English Translation

The invention relates to image processing, specifically to generating mask images for image editing or compositing. The problem addressed is improving the accuracy and flexibility of mask generation, particularly when working with images containing multiple color regions or complex edges. The apparatus includes a first generation unit that creates a mask image from an input image. The mask image is derived from first color information, which typically represents a specific color range or feature in the input image. A second generation unit further refines the mask by incorporating second color information, which may represent adjacent or complementary color regions. The mask is then used to isolate or modify specific areas of the image. In an advanced configuration, the first generation unit generates the mask image using third color information, distinct from the first and second color information. This allows the mask to incorporate additional color data, enhancing precision in separating or blending image regions. The third color information may be derived from a different color channel, a secondary image, or a user-defined selection. This approach improves mask accuracy in complex scenes with overlapping or ambiguous color boundaries. The invention is particularly useful in applications like photo editing, background removal, and image compositing, where precise mask generation is critical for high-quality results. By leveraging multiple color sources, the apparatus ensures more reliable segmentation and manipulation of image regions.

Claim 12

Original Legal Text

12. The image processing apparatus according to claim 11 , wherein the first generation unit generates the mask image by masking the object region, extracted from the target image, based on the third color information.

Plain English Translation

The invention relates to image processing techniques for enhancing or modifying object regions within digital images. The problem addressed is the need for precise and efficient masking of specific objects in an image while preserving background details. Traditional methods often struggle with accurate object segmentation or fail to maintain natural transitions between masked and unmasked areas. The apparatus includes a first generation unit that creates a mask image by selectively masking an object region extracted from a target image. The masking process is based on third color information, which likely refers to a predefined color scheme or gradient data that ensures smooth blending between the object and its surroundings. This approach improves visual coherence and reduces artifacts compared to binary masking techniques. The apparatus also includes a second generation unit that generates a modified image by combining the mask image with the target image. This step ensures that the object region is processed or altered while the rest of the image remains intact. The modified image may be used for further applications such as background replacement, object highlighting, or visual effects. The invention further includes a third generation unit that produces a final image by applying additional processing to the modified image. This may involve color correction, edge refinement, or other enhancements to ensure the final output meets desired quality standards. The system is designed to automate object masking, reducing manual effort and improving consistency in image editing workflows.

Claim 13

Original Legal Text

13. An image processing method, comprising: acquiring a background image and a target image which is captured by an imaging unit; extracting, from the target image, an object region corresponding to a predetermined object; firstly generating a mask image for privacy protection on the object region; and secondly generating a composite image by combining the mask image and the background image, wherein the firstly generating generates the mask image, for the privacy protection on the object region, based on first color information about the background image and second color information used for generating the mask image for the privacy protection on the object region extracted from a previous image of the target image.

Plain English Translation

This invention relates to image processing techniques for privacy protection in captured images. The method addresses the challenge of obscuring sensitive or private regions in images while maintaining visual coherence with the background. The process involves acquiring a background image and a target image captured by an imaging unit. From the target image, an object region corresponding to a predetermined object (e.g., a person or sensitive content) is identified and extracted. A mask image is then generated to obscure this region for privacy protection. The mask image is created based on color information from both the background image and a previous image of the target image. Specifically, the method uses first color information from the background image and second color information from the previous image to ensure the mask blends seamlessly with the background. Finally, the mask image is combined with the background image to produce a composite image where the object region is obscured while preserving the visual context. This approach enhances privacy by dynamically adapting the mask to the surrounding environment, reducing detection of the obscured content. The method is particularly useful in surveillance, social media, or any application requiring real-time privacy protection.

Claim 14

Original Legal Text

14. A non-transitory computer-readable storage medium storing a program that causes a computer execute an image processing method, the image processing method comprising: acquiring a background image and a target image which is captured by an imaging unit; extracting, from the target image, an object region corresponding to a predetermined object; firstly generating a mask image for privacy protection on the object region; and secondly generating a composite image by combining the mask image and the background image, wherein the firstly generating generates the mask image, for the privacy protection on the object region, based on first color information about the background image and second color information used for generating the mask image for the privacy protection on the object region extracted from a previous image of the target image.

Plain English Translation

This invention relates to image processing for privacy protection, specifically in scenarios where an object (e.g., a person or sensitive information) must be obscured in a captured image while preserving the background. The problem addressed is ensuring seamless integration of privacy masks into background images, avoiding unnatural or inconsistent visual artifacts. The solution involves dynamically generating a mask image for an object region in a target image, where the mask is tailored to match the background's color characteristics. The method acquires a background image and a target image, extracts the object region (e.g., a face or license plate), and generates a mask image for privacy protection. The mask is created using color information from both the background image and a previous image of the target, ensuring the mask blends naturally with the background. The final composite image combines the masked object region with the background, enhancing privacy while maintaining visual coherence. This approach improves upon static masking techniques by adapting to varying background conditions, reducing detection of the obscured region. The invention is implemented via a computer program stored on a non-transitory medium, executing the described steps to process images in real-time or post-capture.

Claim 15

Original Legal Text

15. An image processing method, comprising: acquiring a background image and a target image which is captured by an imaging unit; extracting, from the target image, an object region corresponding to a predetermined object; firstly generating a mask image for privacy protection on the object region; secondly generating a composite image by combining the mask image and the background image; and estimating a region corresponding to the predetermined object in a subsequent image of the target image; wherein the firstly generating generates the mask image, for the privacy protection on the object region, based on first color information about the background image corresponding to the object region and second color information about the background image corresponding to the estimated region estimated in the estimating.

Plain English Translation

This invention relates to image processing techniques for privacy protection in surveillance or monitoring systems. The problem addressed is the need to dynamically obscure or mask specific objects (e.g., individuals or sensitive items) in captured images while maintaining visual context from the background. Existing methods may fail to adapt to changing scenes or produce unnatural masking effects. The method involves acquiring a background image and a target image from an imaging unit. An object region corresponding to a predetermined object (e.g., a person) is extracted from the target image. A mask image is generated for privacy protection over this object region, using color information from the background image that corresponds to both the object region and an estimated region of the object in subsequent images. The mask image is then combined with the background image to produce a composite image where the object is obscured while preserving the background's visual integrity. The system continuously estimates the object's position in subsequent images to ensure consistent masking. This approach ensures seamless privacy protection by dynamically adapting the mask to background colors, reducing visual artifacts and improving realism. The technique is particularly useful in surveillance, security, and public monitoring applications where privacy compliance is required.

Claim 16

Original Legal Text

16. A non-transitory computer-readable storage medium storing a program that causes a computer execute an image processing method, the image processing method comprising: acquiring a background image and a target image which is captured by an imaging unit; extracting, from the target image, an object region corresponding to a predetermined object; firstly generating a mask image for privacy protection on the object region; secondly generating a composite image by combining the mask image and the background image; and estimating a region corresponding to the predetermined object in a subsequent image of the target image; wherein the firstly generating generates the mask image, for the privacy protection on the object region, based on first color information about the background image corresponding to the object region and second color information about the background image corresponding to the estimated region estimated in the estimating.

Plain English Translation

The invention relates to image processing techniques for privacy protection in captured images. The problem addressed is the need to dynamically obscure or mask specific objects in images, such as faces or sensitive information, while maintaining visual coherence with the background. The solution involves a method that processes images to identify and mask predetermined objects, such as individuals or sensitive regions, in a way that blends seamlessly with the background. The method begins by acquiring a background image and a target image captured by an imaging device. An object region corresponding to a predetermined object (e.g., a person's face) is extracted from the target image. A mask image is then generated to obscure this object region for privacy protection. The mask image is created using color information from both the background image and an estimated region of the object in subsequent images. This ensures the mask blends naturally with the background. The method also generates a composite image by combining the mask image with the background image, effectively replacing the object region with the mask. Additionally, the method estimates the object's region in subsequent images to maintain consistent masking across multiple frames. This approach improves privacy protection by dynamically adapting the mask to the background, reducing visual artifacts and ensuring seamless integration. The technique is particularly useful in surveillance, video conferencing, or any application requiring real-time privacy preservation.

Patent Metadata

Filing Date

Unknown

Publication Date

January 14, 2020

Inventors

Ichiko Mayuzumi

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM FOR GENERATING A MASK IMAGE” (10535113). https://patentable.app/patents/10535113

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/10535113. See llms.txt for full attribution policy.

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM FOR GENERATING A MASK IMAGE