An image processing method and apparatus, an image device, and a storage medium are provided. The method includes: detecting key points of a first face image; determining a target region for malar fat pad region adjustment based on the key points; determining an adjustment parameter for a malar fat pad region based on the key points; and adjusting the target region based on the adjustment parameter to form a second face image.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. An image processing method, comprising: detecting key points of a first face image; determining a target region for malar fat pad region adjustment based on the key points; determining an adjustment parameter for a malar fat pad region based on the key points; adjusting the target region based on the adjustment parameter to form a second face image; generating a mask image according to a position of the malar fat pad region in the second face image; and performing brightening processing on the malar fat pad region in the second face image based on the mask image to obtain a third face image.
The invention relates to image processing techniques for enhancing facial features, specifically focusing on the malar fat pad region. The malar fat pad is a prominent facial area that contributes to overall facial aesthetics, and adjustments to this region can improve perceived facial symmetry and brightness. The method addresses the challenge of automatically detecting and enhancing this specific facial area without manual intervention. The process begins by analyzing a first face image to detect key facial landmarks, which are used to identify the malar fat pad region. Based on these key points, a target region for adjustment is defined, and an adjustment parameter is determined to guide modifications. The target region is then adjusted according to the parameter, producing a second face image with refined malar fat pad contours. A mask image is generated to precisely locate the malar fat pad region in the second face image. Finally, brightening processing is applied to the malar fat pad region using the mask image, resulting in a third face image with enhanced brightness and improved visual appeal. The method automates facial enhancement by combining region detection, adjustment, and selective brightening, ensuring natural-looking results.
2. The method according to claim 1 , wherein before determining the target region for malar fat pad region adjustment based on the key points, the method further comprises: determining an orientation of a face in the first face image; and determining the target region for malar fat pad region adjustment based on the key points comprises: determining the target region for malar fat pad region adjustment based on the key points and the orientation.
The invention relates to facial image processing, specifically methods for adjusting the malar fat pad region in a face image. The malar fat pad is a key facial feature that contributes to perceived facial volume and contour. The problem addressed is accurately identifying and adjusting this region in a face image, particularly when the face is oriented at an angle, which can distort key facial landmarks. The method involves analyzing a first face image to detect key points that define the malar fat pad region. Before determining the target region for adjustment, the method first determines the orientation of the face in the image. This orientation data is then used alongside the key points to precisely define the target region for malar fat pad adjustment. By incorporating facial orientation, the method improves accuracy in identifying the malar fat pad region, even when the face is not perfectly frontal. This ensures that adjustments to the malar fat pad are applied correctly, maintaining natural facial proportions and avoiding distortions. The method is particularly useful in applications such as facial beautification, medical imaging, or virtual try-on systems where precise facial feature manipulation is required.
3. The method according to claim 2 , wherein the key points comprise: an outer eye corner key point, a first face contour key point, and a nosewing key point; and determining the target region for malar fat pad region adjustment based on the key points and the orientation comprises: if it is determined that the orientation indicates that the first face image is a frontal face image, determining a first intermediate point of the target region based on the first face contour key point and the nosewing key point; and determining the target region based on the first intermediate point and the outer eye corner key point.
This invention relates to facial image processing, specifically adjusting the malar fat pad region in a face image. The problem addressed is accurately identifying and modifying the malar fat pad area, which is crucial for facial beautification and medical applications. The method involves detecting key facial landmarks to define a target region for adjustment. The key points used include an outer eye corner key point, a first face contour key point, and a nosewing key point. These points are used to determine the target region for malar fat pad adjustment based on the face's orientation. If the face is frontal, a first intermediate point is calculated using the first face contour key point and the nosewing key point. The target region is then defined using this intermediate point and the outer eye corner key point. The method ensures precise localization of the malar fat pad region, enabling accurate adjustments for cosmetic or medical purposes. The use of specific facial landmarks ensures consistency and reliability in identifying the target area, regardless of minor variations in facial structure. This approach improves the accuracy of facial image processing techniques, particularly in applications requiring subtle or precise modifications to the malar fat pad region.
4. The method according to claim 2 , wherein the key points comprise an outer eye corner key point, a second face contour key point, and a nosewing key point; and determining the target region for malar fat pad region adjustment based on the key points and the orientation comprises: if it is determined that the orientation indicates that the first face image is a side face image, determining a second intermediate point of the target region based on the second face contour key point and the nosewing key point; and determining the target region based on the second intermediate point and the outer eye corner key point.
This invention relates to facial image processing, specifically adjusting the malar fat pad region in images to enhance facial features. The problem addressed is accurately identifying and modifying the malar fat pad area, which is challenging due to variations in facial orientation and key anatomical landmarks. The method involves analyzing a face image to identify key facial landmarks, including the outer eye corner, a second face contour point, and the nosewing. These points are used to define a target region for malar fat pad adjustment. If the image is a side face view, the method calculates an intermediate point based on the second face contour and nosewing landmarks. The target region is then determined using this intermediate point and the outer eye corner. This approach ensures precise localization of the malar fat pad area, even in side-profile images, enabling accurate adjustments for cosmetic or medical applications. The technique improves upon prior methods by leveraging specific key points to handle different facial orientations, ensuring consistent results across various image perspectives.
5. The method according to claim 2 , wherein determining the adjustment parameter for the malar fat pad region based on the key points comprises: determining one or more adjustment directions of the malar fat pad region based on the key points and the orientation.
This method adjusts the appearance of the cheek (malar fat pad region) by figuring out how to move or reshape it based on key points on the face and their position.
6. The method according to claim 5 , wherein determining the one or more adjustment directions of the malar fat pad region based on the key points and the orientation comprises: if the orientation indicates that the first face image is a frontal face image, determining that the one or more adjustment directions of the malar fat pad region are a first direction based on the key points.
This invention relates to facial image processing, specifically adjusting the malar fat pad region in facial images to enhance appearance. The problem addressed is accurately determining adjustment directions for the malar fat pad region based on facial orientation and key facial landmarks to achieve natural-looking modifications. The method involves analyzing a face image to identify key points and determine its orientation. If the face is frontal, the malar fat pad region is adjusted in a predefined first direction based on the key points. The key points are specific facial landmarks that define the boundaries and shape of the malar fat pad region. The orientation detection ensures the adjustment aligns with the natural facial structure, preventing unnatural distortions. The method may also include additional steps such as detecting facial landmarks, segmenting the malar fat pad region, and applying adjustments to other facial regions for a cohesive result. The adjustments are calculated to maintain proportional relationships between facial features, ensuring the modifications appear realistic. This technique is useful in applications like beauty filters, medical imaging, and facial recognition systems where accurate facial feature representation is critical.
7. The method according to claim 6 , wherein the first direction is a direction directing to an outer eye corner key point from a first intermediate point of the target region.
This invention relates to image processing techniques for facial feature analysis, specifically targeting the accurate detection and tracking of key points on the face, such as those used in eye tracking or facial recognition systems. The problem addressed is the precise localization of facial landmarks, particularly in regions like the eyes, where small deviations can significantly impact downstream applications like gaze estimation or expression analysis. The method involves determining a first direction within a target region of the face, such as the eye area, by identifying a first intermediate point in that region and then calculating a direction from this intermediate point toward an outer eye corner key point. This directional information helps refine the positioning of facial landmarks by leveraging spatial relationships between known reference points (like the outer eye corner) and intermediate points within the target region. The approach likely improves robustness against variations in lighting, pose, or occlusion by using relative positioning rather than absolute coordinates. The method may be part of a broader system for facial landmark detection, where multiple directional vectors or geometric relationships are computed to enhance accuracy. By focusing on directional relationships rather than fixed coordinates, the technique can adapt to different facial geometries and improve consistency in landmark placement. This is particularly useful in applications requiring high precision, such as medical diagnostics, augmented reality, or biometric authentication.
8. The method according to claim 5 , wherein determining the one or more adjustment directions of the malar fat pad region based on the key points and the orientation comprises: if the orientation indicates that the first face image is a side face image, determining that the one or more adjustment directions of the malar fat pad region are a second direction and a third direction based on the key points, wherein the third direction is different from the second direction.
This invention relates to facial image processing, specifically adjusting the malar fat pad region in facial images to enhance or modify appearance. The problem addressed is accurately determining adjustment directions for the malar fat pad region, particularly when the face is captured from a side angle, where traditional front-facing analysis methods may fail. The method involves analyzing key points and orientation data from a face image to determine optimal adjustment directions for the malar fat pad region. For side face images, the system identifies two distinct adjustment directions based on the key points. The first direction (second direction) and the second direction (third direction) are different, allowing for precise modifications tailored to the side profile. The key points define anatomical landmarks, while the orientation data indicates the face's angle relative to the camera. This approach ensures natural-looking adjustments by accounting for the three-dimensional structure of the face in side-view images, which is critical for applications like facial recognition, beauty filters, or medical imaging. The solution improves upon prior art by providing a context-aware adjustment mechanism that adapts to different face orientations, particularly side views, where malar fat pad modifications are traditionally challenging. The method ensures consistency and realism in facial image editing by dynamically selecting adjustment directions based on the face's pose.
9. The method according to claim 8 , wherein the second direction is a direction directing to an outer eye corner key point from a second intermediate point of the target region; and the third direction is a direction directing to a second face contour key point from a nosewing key point.
This invention relates to facial feature detection and alignment in image processing, specifically addressing the challenge of accurately identifying and mapping key facial landmarks for applications such as facial recognition, animation, or augmented reality. The method involves determining precise directions between specific facial key points to enhance the accuracy of facial feature localization. The process begins by identifying a target region on a face, such as an area around the eye or nose. A second intermediate point within this target region is then selected. The method calculates a second direction from this intermediate point toward an outer eye corner key point, which helps refine the position of the eye corner in the image. Additionally, the method determines a third direction from a nosewing key point to a second face contour key point, further improving the alignment of facial contours. By defining these directional relationships, the method ensures that key facial landmarks are accurately positioned relative to each other, reducing errors in facial feature detection. This approach is particularly useful in scenarios where lighting conditions or facial expressions may distort traditional landmark detection methods. The technique enhances the robustness of facial recognition systems and other applications requiring precise facial feature mapping.
10. The method according to claim 2 , wherein determining the adjustment parameter for the malar fat pad region based on the key points comprises: determining an adjustment amplitude of the malar fat pad region based on the key points and the orientation.
This invention relates to facial feature adjustment in digital image processing, specifically modifying the malar fat pad region of a face. The malar fat pad is a soft tissue area beneath the cheekbones that contributes to facial volume and contour. The problem addressed is accurately adjusting this region to enhance facial aesthetics or correct distortions in images or 3D models. The method involves analyzing key points on the face, which are specific anatomical landmarks such as the cheekbones, nasolabial folds, and jawline. These key points are used to determine the orientation of the malar fat pad relative to other facial features. Based on this orientation and the key points, an adjustment amplitude is calculated. This amplitude defines the extent and direction of modification needed to reshape the malar fat pad, such as increasing or decreasing volume, smoothing contours, or altering symmetry. The adjustment may involve techniques like soft tissue deformation, volume redistribution, or texture blending to ensure natural-looking results. The method ensures that modifications align with anatomical proportions and facial harmony, avoiding unnatural distortions. This approach is useful in applications like facial recognition, medical imaging, virtual try-on, and digital art.
11. The method according to claim 10 , wherein determining the adjustment amplitude of the malar fat pad region based on the key points and the orientation comprises: determining a maximum movement distance of the malar fat pad region based on an outer eye corner key point and an inner eye corner key point; and if the orientation indicates that the first face image is a side face image, determining an actual movement distance of the malar fat pad region in the first face image according to a face deflection angle and the maximum movement distance.
This invention relates to facial image processing, specifically adjusting the malar fat pad region in facial images to enhance visual appearance. The problem addressed is accurately modifying the malar fat pad area in different facial orientations, particularly when the face is captured from the side, to ensure natural-looking adjustments. The method involves analyzing key facial landmarks, such as the outer and inner eye corners, to determine the maximum possible movement distance for the malar fat pad region. For side-face images, the adjustment is further refined by considering the face's deflection angle relative to the camera. This ensures the malar fat pad modification aligns with the natural facial structure, avoiding unnatural distortions. The technique combines geometric analysis of key points with orientation-based scaling to achieve precise and context-aware adjustments. This approach is particularly useful in applications like facial beautification, medical imaging, or virtual avatars where realistic facial modifications are required.
12. The method according to claim 1 , wherein generating the mask image according to the position of the malar fat pad region in the second face image comprises: generating, according to a predetermined bright spot for brightening the malar fat pad region and the position of the malar fat pad region in the second face image, the mask image comprising the predetermined bright spot.
This invention relates to facial image processing, specifically techniques for enhancing the appearance of the malar fat pad region in a face image. The malar fat pad is a prominent facial feature that contributes to perceived youthfulness and attractiveness, but its appearance can be diminished in images due to lighting conditions or other factors. The invention addresses the problem of improving the visual prominence of the malar fat pad in a face image by generating a mask image that includes a predetermined bright spot aligned with the detected position of the malar fat pad region. The method involves analyzing a second face image to identify the location of the malar fat pad region. Once the position is determined, a mask image is generated with a bright spot specifically designed to brighten the malar fat pad region. This mask image can then be applied to the original face image to enhance the malar fat pad's appearance, making it more visually prominent. The technique leverages predefined bright spot parameters to ensure consistent and natural-looking enhancements. The invention is particularly useful in applications such as portrait photography, video conferencing, and beauty filters, where enhancing facial features is desirable.
13. The method according to claim 1 , wherein performing brightening processing on the malar fat pad region in the second face image based on the mask image to obtain the third face image comprises: mixing a pixel value of a pixel having a pixel value greater than a predetermined threshold in the mask image with a first pixel value of a pixel at a corresponding position in the second face image to obtain a mixed second pixel value; and generating the third face image based on the mixed second pixel value.
Facial image processing and editing. This invention addresses the problem of enhancing specific facial regions, such as the malar fat pad, in a digital image to achieve a desired aesthetic appearance. The method involves processing a second face image to create a third face image. This brightening processing is performed on the malar fat pad region. The process begins by using a mask image, which delineates the target region. For pixels within the mask image that exceed a predefined brightness threshold, their pixel values are combined with the corresponding pixel values in the second face image. This mixing generates a new, mixed second pixel value. The third face image is then generated using these mixed second pixel values, effectively brightening the specified malar fat pad region.
14. The method according to claim 13 , further comprising: acquiring a control parameter; wherein generating the third face image based on the mixed second pixel value comprises: performing linear mixing based on the control parameter, the mixed second pixel value, and the first pixel value to obtain a third pixel value; and generating the third face image based on the third pixel value.
This invention relates to image processing techniques for generating composite face images, particularly in applications like facial recognition, virtual avatars, or augmented reality. The problem addressed is the need to dynamically blend facial features from multiple images while maintaining control over the blending process to achieve desired visual effects or accuracy. The method involves generating a composite face image by combining pixel data from at least two input face images. A first face image is processed to extract a first pixel value, while a second face image is processed to extract a second pixel value. These values are then mixed to produce a mixed second pixel value, which is further refined using a control parameter. The control parameter allows for adjustable blending between the original and mixed pixel values, enabling precise control over the final appearance of the composite image. The refined pixel value, referred to as the third pixel value, is then used to generate the final composite face image. The control parameter can be adjusted to prioritize features from either the first or second face image, or to achieve a balanced blend. This technique is useful in applications requiring dynamic face synthesis, such as real-time facial recognition systems, virtual reality avatars, or facial expression transfer between images. The method ensures that the resulting composite image retains desired characteristics from both input images while allowing for fine-tuned adjustments.
15. An image device, comprising: a memory, configured to store computer executable instructions; and a processor, connected to the memory and when the computer executable instructions are executed by the processor, the processor is configured to: detect key points of a first face image; determine a target region for malar fat pad region adjustment based on the key points; determine an adjustment parameter for a malar fat pad region based on the key points; adjust the target region based on the adjustment parameter to form a second face image; generate a mask image according to a position of the malar fat pad region in the second face image; and perform brightening processing on the malar fat pad region in the second face image based on the mask image to obtain a third face image.
This invention relates to image processing, specifically to systems for adjusting and enhancing facial features in images, particularly focusing on the malar fat pad region. The problem addressed is the need for automated, precise adjustments to facial contours and brightness to improve aesthetic appearance in digital images. The system includes a memory storing executable instructions and a processor that, when executing these instructions, performs several steps. First, it detects key points of a first face image, which are critical landmarks used to identify and locate facial features. Using these key points, the system determines a target region for adjusting the malar fat pad, a facial area below the cheekbones. It then calculates an adjustment parameter to modify the shape or volume of this region, applying the adjustment to generate a second face image with altered malar fat pad contours. Next, the system generates a mask image that isolates the malar fat pad region in the second face image. This mask is used to apply brightening processing specifically to the adjusted malar fat pad, resulting in a third face image with enhanced brightness and contour definition. The process ensures that modifications are localized and precise, avoiding unintended alterations to other facial areas. This approach is useful in applications like beauty filters, medical imaging, or facial recognition where accurate facial feature representation is critical.
16. The image device according to claim 15 , wherein the processor is further configured to: determine an orientation of a face in the first face image; and the processor is specifically configured to: determine the target region for malar fat pad region adjustment based on the key points and the orientation.
This invention relates to image processing techniques for adjusting the malar fat pad region in facial images. The technology addresses the challenge of accurately modifying facial features, particularly the malar fat pad area, while maintaining natural appearance and alignment with facial structure. The system includes an image device with a processor that analyzes a first face image to identify key points and landmarks. The processor determines the orientation of the face in the image, then uses this orientation along with the key points to define a target region for malar fat pad adjustment. This ensures the modification is anatomically consistent with the face's natural contours and proportions. The system may also compare the first face image with a second face image to assess changes in the malar fat pad region over time, providing a basis for targeted adjustments. The processor's ability to account for facial orientation improves the precision of modifications, reducing unnatural distortions. This approach is particularly useful in applications like cosmetic analysis, medical imaging, and facial recognition, where accurate feature representation is critical. The invention enhances existing image processing methods by incorporating orientation-aware adjustments to maintain realism in facial modifications.
17. A non-transitory computer storage medium, storing computer executable instructions which are executed by a processor to implement the following operations: detecting key points of a first face image; determining a target region for malar fat pad region adjustment based on the key points; determining an adjustment parameter for a malar fat pad region based on the key points; adjusting the target region based on the adjustment parameter to form a second face image; generating a mask image according to a position of the malar fat pad region in the second face image; and performing brightening processing on the malar fat pad region in the second face image based on the mask image to obtain a third face image.
This invention relates to digital image processing, specifically techniques for enhancing facial features in images by adjusting the malar fat pad region. The malar fat pad is a prominent facial area that contributes to facial contours and overall appearance. The invention addresses the challenge of improving facial aesthetics by selectively modifying this region while maintaining natural-looking results. The method involves analyzing a first face image to detect key facial landmarks, which are used to identify the malar fat pad region. A target region for adjustment is then determined based on these key points, along with an adjustment parameter that defines the extent of modification. The target region is adjusted according to this parameter to generate a second face image with altered malar fat pad contours. A mask image is created to precisely delineate the adjusted malar fat pad region in the second face image. Finally, brightening processing is applied to this region using the mask image, resulting in a third face image with enhanced facial features. The technique ensures that modifications are localized to the malar fat pad while preserving the rest of the facial structure, providing a natural and aesthetically pleasing outcome. The invention is implemented via computer-executable instructions stored on a non-transitory medium, enabling automated facial enhancement in digital images.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
June 29, 2020
February 1, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.