A method includes receiving, by a processor, a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object. The processor receives an image of a barcode on the test object. The processor selects a region of interest in each of the plurality of images of the test object. The region of interest includes the test object having a background removed. For the plurality of regions of interest as selected, the processor compares each region of interest with a corresponding profile image and identifying defects in each region of interest. The corresponding profile image is determined from the image barcode on the test object. The method includes grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects. The method includes storing the grades of the cosmetic appearance for each region of interest.
Legal claims defining the scope of protection, as filed with the USPTO.
receiving, by a processor, a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object; receiving, by the processor, an image of a barcode on the test object; selecting, by the processor, a region of interest in each of the plurality of images of the test object, the region of interest comprising the test object having a background removed; wherein the corresponding profile image is determined from the image barcode on the test object; for the plurality of regions of interest as selected, comparing, by the processor, each region of interest with a corresponding profile image and identifying defects in each region of interest, grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects; and storing the grades of the cosmetic appearance for each region of interest. . A method, comprising:
claim 1 . The method of, comprising sending the grades of the cosmetic appearance for each region of interest to a remote device.
claim 1 . The method of, wherein the plurality of images of the test object are received from a remote device, wherein the remote device comprises a camera configured to capture the plurality of images.
claim 3 . The method of, wherein the remote device is a cosmetic inspection device.
claim 3 . The method of, wherein the remote device is a mobile device.
claim 1 . The method of, wherein the barcode is a QR code.
claim 1 . The method of, comprising aligning the plurality of images with the corresponding profile images.
claim 1 . The method of, wherein the test object is a mobile device; comprising determining a value of the mobile device based on the grades of the cosmetic appearance for each region of interest.
claim 1 . The method of, wherein the test object is a mobile device; wherein the barcode is a QR code displayed on a display of the mobile device.
receive a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object; receive an image of a barcode on the test object; select a region of interest in each of the plurality of images of the test object, the region of interest comprising the test object having a background removed; and wherein the corresponding profile image is determined from the image barcode on the test object; for the plurality of regions of interest as selected, the processor is configured to compare each region of interest with a corresponding profile image and identify defects in each region of interest, grade, by the processor, a cosmetic appearance of each region of interest based on the identified defects; and store the grades of the cosmetic appearance for each region of interest. a server device comprising a processor and a memory, wherein the processor of the server device is configured to: . A system, comprising:
claim 10 . The system of, comprising sending the grades of the cosmetic appearance for each region of interest to a remote device over a network.
claim 10 . The system of, wherein the plurality of images of the test object are received from a remote device over a network, wherein the remote device comprises a camera configured to capture the plurality of images.
claim 12 . The system of, wherein the remote device is a cosmetic inspection device.
claim 12 . The system of, wherein the remote device is a mobile device.
claim 10 . The system of, wherein the barcode is a QR code.
claim 10 . The system of, wherein the processor is configured to align the plurality of images with the corresponding profile images.
claim 10 . The system of, wherein the test object is a mobile device; wherein the processor is configured to determine a value of the mobile device based on the grades of the cosmetic appearance for each region of interest.
claim 10 . The system of, wherein the test object is a mobile device; wherein the barcode is a QR code displayed on a display of the mobile device.
receiving, by a processor, a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object; receiving, by the processor, an image of a barcode on the test object; selecting, by the processor, a region of interest in each of the plurality of images of the test object, the region of interest comprising the test object having a background removed; wherein the corresponding profile image is determined from the image barcode on the test object; for the plurality of regions of interest as selected, comparing, by the processor, each region of interest with a corresponding profile image and identifying defects in each region of interest, grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects; and storing the grades of the cosmetic appearance for each region of interest. . A non-transitory computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to perform a method, comprising:
claim 19 . The non-transitory computer readable storage medium of, comprising sending the grades of the cosmetic appearance for each region of interest to a remote device over a network.
Complete technical specification and implementation details from the patent document.
The present application is a continuation application of U.S. patent application Ser. No. 17/525,643 filed Nov. 12, 2021, issued as U.S. Pat. No. 12,482,089 on Nov. 25, 2025, the entire disclosures of which applications are hereby incorporated herein by reference.
At least some embodiments disclosed herein relate generally to cosmetic evaluation of an object. More particularly, the embodiments relate to systems, devices, and methods for computer-aided cosmetic evaluation and categorization of an object such as, but not limited to, an electronic device or the like.
Large volumes of computing devices (e.g., mobile devices, such as cellular telephones, tablets, etc.) are recycled and often refurbished. There are numerous aspects to the refurbishing process. One aspect includes inspecting the visual characteristics of the computing device to grade its visual appearance. Some of these devices are then refurbished and can be resold to new users.
In some embodiments, a method includes receiving, by a processor, a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object. In some embodiments, the method includes receiving, by the processor, an image of a barcode on the test object. In some embodiments, the method includes selecting, by the processor, a region of interest in each of the plurality of images of the test object. In some embodiments, the region of interest includes the test object having a background removed. In some embodiments, for the plurality of regions of interest as selected, the method includes comparing, by the processor, each region of interest with a corresponding profile image and identifying defects in each region of interest. In some embodiments, the corresponding profile image is determined from the image barcode on the test object. In some embodiments, the method includes grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects. In some embodiments, the method includes storing the grades of the cosmetic appearance for each region of interest.
In some embodiments, the method includes sending the grades of the cosmetic appearance for each region of interest to a remote device.
In some embodiments, the plurality of images of the test object are received from a remote device. In some embodiments, the remote device includes a camera configured to capture the plurality of images.
In some embodiments, the remote device is a cosmetic inspection device.
In some embodiments, the remote device is a mobile device.
In some embodiments, the barcode is a QR code.
In some embodiments, the method includes aligning the plurality of images with the corresponding profile images.
In some embodiments, the test object is a mobile device. In some embodiments, the method includes determining a value of the mobile device based on the grades of the cosmetic appearance for each region of interest.
In some embodiments, the test object is a mobile device. In some embodiments, the barcode is a QR code displayed on a display of the mobile device.
In some embodiments, a system includes a server device including a processor and a memory. In some embodiments, the processor of the server device is configured to receive a plurality of images of a test object. In some embodiments, the plurality of images include a plurality of surfaces of the test object. In some embodiments, the processor is configured to receive an image of a barcode on the test object. In some embodiments, the processor is configured to select a region of interest in each of the plurality of images of the test object. In some embodiments, the region of interest includes the test object having a background removed. In some embodiments, for the plurality of regions of interest as selected, the processor is configured to compare each region of interest with a corresponding profile image and identify defects in each region of interest. In some embodiments, the corresponding profile image is determined from the image barcode on the test object. In some embodiments, the processor is configured to grade a cosmetic appearance of each region of interest based on the identified defects. In some embodiments, the processor to store the grades of the cosmetic appearance for each region of interest.
In some embodiments, the processor is configured to send the grades of the cosmetic appearance for each region of interest to a remote device over a network.
In some embodiments, the plurality of images of the test object are received from a remote device over a network. In some embodiments, the remote device includes a camera configured to capture the plurality of images.
In some embodiments, the remote device is a cosmetic inspection device.
In some embodiments, the remote device is a mobile device.
In some embodiments, the barcode is a QR code.
In some embodiments, the processor is configured to align the plurality of images with the corresponding profile images.
In some embodiments, the test object is a mobile device. In some embodiments, the processor is configured to determine a value of the mobile device based on the grades of the cosmetic appearance for each region of interest.
In some embodiments, the test object is a mobile device. In some embodiments, the barcode is a QR code displayed on a display of the mobile device.
In some embodiments, a non-transitory computer-readable storage medium includes instructions that, when executed by a processor, cause the processor to perform a method. In some embodiments, the method includes receiving, by the processor, a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object. In some embodiments, the method includes receiving, by the processor, an image of a barcode on the test object. In some embodiments, the method includes selecting, by the processor, a region of interest in each of the plurality of images of the test object. In some embodiments, the region of interest includes the test object having a background removed. In some embodiments, for the plurality of regions of interest as selected, the method includes comparing, by the processor, each region of interest with a corresponding profile image and identifying defects in each region of interest. In some embodiments, the corresponding profile image is determined from the image barcode on the test object. In some embodiments, the method includes grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects. In some embodiments, the method includes storing the grades of the cosmetic appearance for each region of interest.
In some embodiments, the method includes sending the grades of the cosmetic appearance for each region of interest to a remote device over a network.
Like reference numbers represent the same or similar parts throughout.
Various objects such as, for example, a shipping box or container can show damage such as scuffmarks, dents, rips, tears, or the like. Other examples include computer devices such as, but not limited to, smartphones, tablets, laptops, smartwatches, and the like, can show damage such as cracks, scuffmarks, or the like. The visible damage can be important in understanding whether the shipping box or container was damaged during shipment, or whether a computer device has lost some of its value. Objects such as computer devices also include numerous components that are assembled together. The assembly process can include fasteners (e.g., screws or the like) that keep the various components secured. It is important that these fasteners be installed correctly (e.g., all screws installed (e.g., no missing screws), proper screws installed, screws properly tightened, or the like) as part of the quality control process.
The embodiments disclosed herein are directed to systems and methods for inspecting an appearance of an object (e.g., a computer device such as, but not limited to, a smartphone, a tablet, a laptop, a smartwatch, a cellphone, or the like). The inspection of the appearance and cosmetic grading of the object can be utilized during, for example, manufacturing of a device, in a retail setting in which computer devices are sold/purchased, or the like.
An image of an object can be captured from each of a plurality of cameras (in a specific cosmetic grading device) or a plurality of images from a single camera can alternatively be captured. “Profile images” (i.e., images of a particular object can be captured in a calibration process and used to train the cosmetic grading system. Each image of an object being validated (i.e., a test object) can be taken in the same coordinate system or with a predetermined relationship. Each of the captured images is compared against the corresponding profile image to determine a cosmetic score.
1 FIG. 50 50 50 50 50 shows a cosmetic grading system, according to some embodiments. The cosmetic grading systemcan be used to, for example, provide a variety of different cosmetic grades for various test objects. The cosmetic grading systemcan provide a cosmetic grade for different types of test objects captured by different types of devices. For example, in some embodiments, the cosmetic grading systemcan provide a cosmetic grading service that can be accessed by a variety of different remote devices that are able to utilize a server of the cosmetic grading system.
50 52 54 56 50 58 52 56 The cosmetic grading systemgenerally includes a server devicein communication with a computer devicethrough a network. The systemcan also include a computer deviceconnected to the server devicethrough the network.
52 62 62 62 62 54 58 62 56 54 58 54 58 54 58 The server devicecan include a cosmetic grading applicationthat is configured to compare received images of a test object with images of a corresponding profile test object. The cosmetic grading applicationcan be in communication with a database including profile images of various test objects. The profile images can be of different views of the test object. The profile images can be associated with a particular test object according to a machine readable code such as a barcode. In embodiments, the barcode can be a QR code. As a result, when the cosmetic grading applicationreceives an image of a barcode, the barcode can be used to retrieve the appropriate profile images for the test object. The cosmetic grading applicationcan then compare images received from the computer deviceorand, based on the comparison, grade the cosmetic appearance of the test object. The cosmetic grading applicationcan then store the result and can also output the result via the networkto the computer deviceor the. In this manner, the computer deviceand the computer devicecan be used to grade a cosmetic appearance of a test object without the computer deviceor the computer devicebeing specifically configured with a cosmetic grading application.
56 56 56 54 58 56 54 58 56 The networkmay be referred to as the communications network. Examples of the networkinclude, but are not limited to, a local area network (LAN), a wide area network (WAN), the Internet, or the like. The computer deviceor computer devicecan transmit data via the networkthrough a wireless connection using Wi-Fi, Bluetooth, or other similar wireless communication protocols. The computer deviceor computer devicecan transmit data via the networkthrough a cellular, 3G, 4G, 5G, or other wireless protocol.
54 54 100 2 4 FIGS.- The computer devicecan be a device specifically configured for capturing images of test objects. An example of the computer deviceis a cosmetic inspection device such as the systemdescribed in additional detail in accordance withbelow.
58 56 52 58 58 58 58 The computer devicecan include an application that permits a user to send images of a test object over the networkto the server devicefor cosmetic grading. The computer deviceincludes a camera and a network input/output to accomplish the communication and image capturing. The computer deviceincludes a display for showing results of the cosmetic grading. In some embodiments, the computer deviceis a smartphone, a tablet, or the like. The computer devicecan also be a laptop or a desktop computer having a camera attached thereto.
2 FIG. 100 102 100 100 shows a systemfor grading an appearance of a test object, according to some embodiments. The systemcan generally be used to, for example, capture images of the test object and communicate with a server device having a cosmetic grading application to assess a cosmetic appearance of the test object. For example, in some embodiments, the systemcan be a kiosk implemented in a retail environment and the test object can be a shipping container, an electronic device (e.g., a smartphone, a smartwatch, a tablet, or the like) and determine whether the cosmetic appearance of the test object is damaged. In some embodiments, the validation can be part of a quality control process during manufacturing.
102 102 102 102 100 102 102 In the illustrated embodiment, the test objectis a smartphone. It is to be appreciated that the smartphone is an example, and the test objectcan vary beyond a smartphone. Examples of other test objectsinclude, but are not limited to, a tablet, a smartwatch, a mobile phone other than a smartphone, a personal digital assistant (PDA), a laptop computing device, or the like. Furthermore, the maker or manufacturer of the test objectis not limited. That is, the systemcan be used to validate the installation correctness of components in test objectsfrom different manufacturers so long as a calibration procedure is performed to create a profile image for the corresponding test object.
100 104 104 104 102 The systemincludes a displayfor displaying results of the validation to the user. In some embodiments, the displaycan be a combined display and input (e.g., a touchscreen). In some embodiments, the displaycan be a display of a tablet or the like. In such an embodiment, a memory of the tablet can store one or more programs to be executed by a processing device of the tablet for validating the correctness of the installation of the component in the test object.
104 106 100 104 106 106 100 100 104 106 100 In the illustrated embodiment, the displayis secured to housingof the system. In some embodiments, the displaycan be separate from the housing(i.e., not secured to the housing, but positioned near the systemand electronically connected to the system). However, it may be beneficial to secure the displayto the housingto reduce a footprint of the system.
108 102 100 108 102 100 102 100 108 3 FIG. A platformis utilized to position the test objectwithin the systemfor validation. The platformenables each test objectplaced into the systemfor validation to be placed in substantially the same location. As a result, an amount of effort in determining whether the profile image and the test objectunder test (test object) is in a same location relative to cameras of the systemcan be reduced. The platformis shown and described in additional detail in accordance withbelow.
100 100 110 100 100 110 100 102 In some embodiments, the systemcan be portable. For example, the illustrated embodiment shows systemwith a handlefor carrying the system. It is to be appreciated that portability of the systemis optional, and accordingly, the handleis optional. In some embodiments, the systemmay be sized differently based on the type of test objectto be validated.
3 FIG. 2 FIG. 108 100 102 shows the platformof the systemoffor validation of installation of a component in an test object, according to an embodiment.
108 112 116 112 116 112 116 116 The platformincludes a tiered surface having a first surfaceand a second surface. A step is thus formed between the first surfaceand the second surface. A plane of the first surfaceand a plane of the second surfaceare parallel. In the illustrated embodiment, the second surfaceis L-shaped when viewed from a top view.
116 112 112 116 118 The second surfaceis positioned a height H from the first surface. The height H between the first surfaceand the second surfacecreates an abutment surface.
118 102 100 118 102 102 102 102 The height H is selected such that the abutment surfaceserves as a stop for the test objectwhen placed within the system. The abutment surfaceis configured to provide a stop for the test objecton two sides of the test object(i.e., a major dimension of the test objectand a minor dimension of the test object).
102 100 102 102 102 102 118 118 102 100 102 The height H is selected to be smaller than a thickness T of the test objectbeing validated in the system. The height H is selected to be smaller than the thickness T of the test objectto not hinder side views of the test object. The height H is selected to be large enough that an operator inserting the test objectcan abut the test objectwith the abutment surface. In this manner, the abutment surfaceserves as a stop for the operator when inserting the test objectinto the system. In some embodiments, the height H can be substantially the same as the thickness T of the test object.
108 102 108 100 108 102 102 102 The configuration of the platformis helpful in establishing the location of the test object. By including the platform, the systemcan be calibrated to generate the profile images using a single assembly since the coordinate system is generally fixed. The platformcan, as a result, be used to account for minor variations in placement of the test objectby the operator as the offset from the expected coordinated system can be determined based on the location of the test objectrelative to a calibration test object.
4 FIG. 2 FIG. 100 shows a schematic architecture for the systemof, according to an embodiment.
100 120 122 124 126 128 130 132 134 136 126 128 130 132 134 136 106 126 128 130 132 134 136 106 The systemgenerally includes a plurality of cameras; a motion sensor; a proximity sensor; a processing device, memory, a network input/output (I/O), user I/O, storage, and an interconnect. The processing device, memory, network input/output (I/O), user I/O, storage, and interconnectcan be within the housingin some embodiments. In some embodiments, the processing device, memory, network input/output (I/O), user I/O, storage, and interconnectcan be external from the housing.
120 100 102 120 100 120 100 120 120 120 The plurality of camerasare arranged in the systemto capture different views of the test object. In some embodiments, the camerasare digital cameras. For example, in some embodiments the systemincludes three camerasarranged to capture a top view, an up-front view, and an up-side view. In some embodiments, the systemincludes four camerasarranged to capture a top view, an up-front view, a first up-side view, and a second (opposite) up-side view. It will be appreciated that a single cameracould be used, although accuracy may be improved when a plurality of camerasare used as a component may appear to be correctly installed in a first view but be determined to be incorrectly installed in a second view.
122 102 122 106 122 The motion sensorcan be, for example, a laser sensor that can be triggered when an object (i.e., test object) breaks the laser signal. The motion sensorcan be installed at the opening to the housing. In some embodiments, the motion sensormay not be included.
124 124 108 100 122 124 120 102 108 124 122 122 124 124 102 The proximity sensorcan be a sensor to determine when an object is placed near it. The proximity sensorcan be placed in the platformof the system. In some embodiments, when the motion sensoris triggered and the proximity sensordetects an object, the camerascan capture images of the test objecton the platform. In some embodiments, the proximity sensorcan be included regardless of whether the motion sensoris present. In some embodiments with both motion sensorand proximity sensor, the image capturing may be performed after the proximity sensordetects the test object.
124 124 122 102 102 100 In some embodiments, automatically causing the image capturing and subsequent validation to be performed using the proximity sensor, or a combination of the proximity sensorand the motion sensor, can increase a number of test objectsthat can be validated in a set period. That is, reducing effort of a human operator, or even allowing for a robotic arm to load the test objectinto the systemfor validation, can reduce an amount of time and effort needed to review the quality of the manufacturing process.
126 128 134 126 128 The processing devicecan retrieve and execute programming instructions stored in the memory, the storage, or combinations thereof. The processing devicecan also store and retrieve application data residing in the memory.
136 126 132 128 134 130 136 126 126 126 The interconnectis used to transmit programming instructions and/or application data between the processing device, the user I/O, the memory, the storage, and the network I/O. The interconnectcan, for example, be one or more busses or the like. The processing devicecan be a single processing device, multiple processing devices, or a single processing device having multiple processing cores. In some embodiments, the processing devicecan be a single-threaded processing device. In some embodiments, the processing devicecan be a multi-threaded processing device.
128 128 128 128 The memoryis generally included to be representative of a random-access memory such as, but not limited to, Static Random-Access Memory (SRAM), Dynamic Random-Access Memory (DRAM), or Flash. In some embodiments, the memorycan be a volatile memory. In some embodiments, the memorycan be a non-volatile memory. In some embodiments, at least a portion of the memorycan be virtual memory.
134 134 134 The storageis generally included to be representative of a non-volatile memory such as, but not limited to, a hard disk drive, a solid-state device, removable memory cards, optical storage, flash memory devices, network attached storage (NAS), or connections to storage area network (SAN) devices, or other similar devices that may store non-volatile data. In some embodiments, the storageis a computer readable medium. In some embodiments, the storagecan include storage that is external to the user device, such as in a cloud.
5 FIG. 52 54 58 shows a block diagram illustrating an internal architecture of an example of a computer, according to some embodiments. In some embodiments, the computer can be, for example, the server device, the computer device, or the computer device, in accordance with some embodiments.
5 FIG. 150 162 152 152 156 164 154 158 160 166 168 170 172 A computer as referred to herein refers to any device with a processor capable of executing logic or coded instructions, and could be a server, personal computer, set top box, smart phone, pad computer or media device, to name a few such devices. As shown in the example of, internal architectureincludes one or more processing units (also referred to herein as CPUs), which interface with at least one computer bus. Also interfacing with computer busare persistent storage medium/media, network interface, memory, e.g., random access memory (RAM), run-time transient memory, read only memory (ROM), etc., media disk drive interfaceas an interface for a drive that can read and/or write to media including removable media such as floppy, CD ROM, DVD, etc. media, display interfaceas interface for a monitor or other display device, keyboard interfaceas interface for a keyboard, pointing device interfaceas an interface for a mouse or other pointing device, and miscellaneous other interfaces,not shown individually, such as parallel and serial port interfaces, a universal serial bus (USB) interface, and the like.
154 152 154 162 162 154 156 162 162 Memoryinterfaces with computer busso as to provide information stored in memoryto CPUduring execution of software programs such as an operating system, application programs, device drivers, and software modules that comprise program code, and/or computer executable process operations, incorporating functionality described herein, e.g., one or more of process flows described herein. CPUfirst loads computer executable process operations from storage, e.g., memory, storage medium/media, removable media drive, and/or other storage device. CPUcan then execute the stored process operations in order to execute the loaded computer-executable process operations. Stored data, e.g., data stored by a storage device, can be accessed by CPUduring the execution of computer-executable process operations.
156 156 156 Persistent storage medium/mediais a computer readable storage medium(s) that can be used to store software and data, e.g., an operating system and one or more application programs. Persistent storage medium/mediacan also be used to store device drivers, such as one or more of a digital camera driver, monitor driver, printer driver, scanner driver, or other device drivers, web pages, content files, playlists, and other files. Persistent storage medium/mediacan further include program modules and data files used to implement one or more embodiments of the present disclosure.
For the purposes of this disclosure a module is a software, hardware, or firmware (or combinations thereof) system, process or functionality, or component thereof, that performs or facilitates the processes, features, and/or functions described herein (with or without human interaction or augmentation). A module can include sub-modules. Software components of a module may be stored on a computer readable medium. Modules may be integral to one or more servers, or be loaded and executed by one or more servers. One or more modules may be grouped into an engine or an application.
Examples of computer-readable storage media include, but are not limited to, any tangible medium capable of storing a computer program for use by a programmable processing device to perform functions described herein by operating on input data and generating an output. A computer program is a set of instructions that can be used, directly or indirectly, in a computer system to perform a certain function or determine a certain result. Examples of computer-readable storage media include, but are not limited to, a floppy disk; a hard disk; a random access memory (RAM); a read-only memory (ROM); a semiconductor memory device such as, but not limited to, an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), Flash memory, or the like; a portable compact disk read-only memory (CD-ROM); an optical storage device; a magnetic storage device; other similar device; or suitable combinations of the foregoing.
In some embodiments, hardwired circuitry may be used in combination with software instructions. Thus, the description is not limited to any specific combination of hardware circuitry and software instructions, nor to any source for the instructions executed by the data processing system.
6 FIG. 200 200 shows a flowchart of a method, according to some embodiments. In some embodiments, the methodcan be representative of a cosmetic grading service being accessed via a cosmetic grading device. In some embodiments, the cosmetic grading device can be implemented as a kiosk or the like in a setting such as a retail store. In some embodiments, the cosmetic grading device can be utilized in other environments such as, for example, in a manufacturing environment in which the object to be tested is a shipping box to be shipped or a computer device to be refurbished. It is to be appreciated that these are examples, and the applications can vary beyond the above stated examples.
202 100 118 108 108 122 124 At blocka test object is loaded into the system. This includes abutting the test object with the abutment surfaceof the platform. In some embodiments, the test object can be loaded by a human operator. In some embodiments, a robotic or mechanical arm can be automated to place the test object onto the platform. In some embodiments, the test object can be a computer device such as, but not limited to, a smartphone, smartwatch, tablet, or the like. The placement of the test object can cause the motion sensor, the proximity sensor, or a combination thereof, to generate a signal indicative of the test object being in place.
204 122 124 120 120 120 At block, in response to the signal generated by the motion sensor, the proximity sensor, or a combination thereof, the plurality of cameraseach capture an image. As discussed above, the camerasare oriented such that the captured images are of different views of the test object. In some embodiments, the test object can have a barcode (e.g., a QR code or other machine readable code) on a surface of the test object that is captured by one of the cameras.
206 At block, the captured images are transmitted to a server device to be compared against profile images that are retrieved using the barcode as captured.
208 At blockan output is generated by the server device that is indicative of the results of the validation (e.g., pass, fail, needs review). The output can be based on a range of the matching score. That is, if the matching score is greater than a first value, then the output can be that the test object passes; between the first value and a lower second value, the test object may need checking (e.g., by an operator); and between the lower second value and a third value that is lower than the second value, the test object may fail. A failure can mean, for example, that the test object is damaged such that the appearance does not match the expected appearance.
To obtain the grade, the method includes selecting, by the processor, a region of interest in each of the plurality of images of the test object. In some embodiments, the region of interest includes the test object having a background removed. In some embodiments, for the plurality of regions of interest as selected, the method includes comparing, by the processor, each region of interest with a corresponding profile image and identifying defects in each region of interest. In some embodiments, the corresponding profile image is determined from the image barcode on the test object. In some embodiments, the method includes grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects. In some embodiments, the method includes storing the grades of the cosmetic appearance for each region of interest.
210 100 104 100 At block, the output is received by the systemand displayed on the displayof the system.
7 FIG. 250 250 shows a flowchart of a method, according to some embodiments. In some embodiments, the methodcan be representative of a cosmetic grading service being accessed via a computer device such as a smartphone or the like. In some embodiments, the computer device can be utilized to review aesthetics of test objects in any environment accessible by a user, so long as the server providing the cosmetic grading service has received some profile images of the test object against which the images received from the computer device can be compared.
252 At blocka plurality of images of a test object are captured. The user can orient the computer device to capture multiple views of the test object. In some embodiments, the test object can have a barcode (e.g., a QR code or other machine readable code) on a surface of the test object that is captured by the camera of the computer device.
254 At block, the captured images are transmitted to a server device to be compared against profile images that are retrieved using the barcode as captured.
256 At blockan output is generated by the server device that is indicative of the results of the validation (e.g., pass, fail, needs review). The output can be based on a range of the matching score. That is, if the matching score is greater than a first value, then the output can be that the test object passes; between the first value and a lower second value, the test object may need checking (e.g., by an operator); and between the lower second value and a third value that is lower than the second value, the test object may fail. A failure can mean, for example, that the test object is damaged such that the appearance does not match the expected appearance.
To obtain the grade, the method includes selecting, by the processor, a region of interest in each of the plurality of images of the test object. In some embodiments, the region of interest includes the test object having a background removed. In some embodiments, for the plurality of regions of interest as selected, the method includes comparing, by the processor, each region of interest with a corresponding profile image and identifying defects in each region of interest. In some embodiments, the corresponding profile image is determined from the image barcode on the test object. In some embodiments, the method includes grading, by the processor, a cosmetic appearance of each region of interest based on the identified defects. In some embodiments, the method includes storing the grades of the cosmetic appearance for each region of interest.
258 At block, the output is received by the computer device and displayed on the display of the computer device.
The terminology used herein is intended to describe embodiments and is not intended to be limiting. The terms “a,” “an,” and “the” include the plural forms as well, unless clearly indicated otherwise. The terms “comprises” and/or “comprising,” when used in this Specification, specify the presence of the stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, and/or components.
It is to be understood that changes may be made in detail, especially in matters of the construction materials employed and the shape, size, and arrangement of parts without departing from the scope of the present disclosure. This Specification and the embodiments described are examples, with the true scope and spirit of the disclosure being indicated by the claims that follow.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 20, 2025
April 16, 2026
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.