Patentable/Patents/US-10600169
US-10600169

Image processing system and image processing method

PublishedMarch 24, 2020
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

Provided is an image processing system including at least one information processing apparatus and a distribution server. The information processing apparatus includes a clipping unit that performs image processing of clipping a predetermined object from a moving image in which the object is imaged and generates a clipped moving image of the object, and an operation content acquisition unit that obtains operation content of operation performed on the clipped moving image of the object. The distribution server includes an image processing unit that performs, individually for each of the objects, image processing that corresponds to operation content on a clipped moving image of a plurality of objects, and a combining unit that generates a combined moving image in which the plurality of objects is arranged by combining the clipped moving images of the plurality of objects that has undergone image processing.

Patent Claims
11 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. An image processing system, comprising: at least one processor configured to: receive a first object moving image from a first imaging device of a plurality of imaging devices and a second object moving image from a second imaging device of the plurality of imaging devices, wherein the first imaging device: calculates a distance from the first imaging device to a first specific object captured in a first moving image, wherein the first moving image is captured by the first imaging device; executes a clipping operation corresponding to an image processing such that the first specific object is clipped from the first moving image, wherein the clipping operation is executed based on the calculated distance; generates the first object moving image based on the execution of the clipping operation; adds likelihood information to the first object moving image based on the calculation of the distance to the first specific object, wherein the likelihood information indicates a probability of a calculation result being correct, the calculation result is associated with the calculation of the distance to the first specific object, and the likelihood information is in units of pixels constituting the first moving image; and executes a deletion operation corresponding to the image processing such that an unnecessary region in the first object moving image is deleted based on the likelihood information, the second imaging device generates the second object moving image from a second moving image, the second moving image includes a second specific object, the first object moving image includes a first region in which the first specific object is captured, and the second object moving image includes a second region in which the second specific object is captured; execute the image processing on each of the first object moving image and the second object moving image, wherein the image processing corresponds to each of addition of first operation content to the first object moving image and addition of second operation content to the second object moving image; generate a first combined moving image based on a combination of the first object moving image and the second object moving image with a specific moving image, and the execution of the image processing, wherein the generated first combined moving image includes the specific moving image as a background image, the first object moving image, and the second object moving image; control each of a first display unit of the first imaging device and a second display unit of the second imaging device to display the generated first combined moving image; receive a user input from the first imaging device, wherein the user input indicates a plurality of depth coordinates of the first object moving image in the displayed first combined moving image; generate a second combined moving image based on the plurality of depth coordinates; and control the first display unit to display the generated second combined moving image.

2

2. The image processing system according to claim 1 , wherein the at least one processor is further configured to: record the first object moving image for the first specific object; record the first operation content for the first specific object based on execution of an operation on the first object moving image; and update the first object moving image based on the recorded first operation content.

3

3. The image processing system according to claim 1 , wherein the execution of the deletion operation is further based on a specific position and a specific size of the unnecessary region, and the unnecessary region corresponds to a center of the first object moving image, which is automatically detectable from the first object moving image.

4

4. The image processing system according to claim 1 , wherein the unnecessary region is in a specific region of the first moving image, and the specific region of the first moving image is a target region that corresponds to the first object moving image.

5

5. The image processing system according to claim 1 , wherein the at least one processor is further configured to execute a trimming operation corresponding to the image processing such that the first object moving image is trimmed from a specific position of the first object moving image, the trimming operation is executed based on the first operation content, the first operation content indicates the specific position, and the specific position corresponds to each of a center and a size of the first object moving image.

6

6. The image processing system according to claim 1 , wherein the at least one processor is further configured to execute the image processing based on a transformation parameter corresponding to the first object moving image.

7

7. The image processing system according to claim 6 , wherein the at least one processor is further configured to execute at least one of an enlargement operation, a reduction operation, a translation operation, or a rotation operation based on the transformation parameter and the first operation content of the first object moving image, and each of the enlargement operation, the reduction operation, the translation operation, and the rotation operation corresponds to the image processing on the first object moving image.

8

8. The image processing system according to claim 1 , wherein the at least one processor is further configured to: execute a preregistration operation such that the first operation content is added to the first object moving image at a designated time; and execute the image processing on the first object moving image based on the first operation content, wherein the image processing is executed at the designated time.

9

9. The image processing system according to claim 8 , wherein the first operation content includes a plurality of items added to the first object moving image at the designated time, and the at least one processor is further configured to: execute a voting operation on the plurality of items of the first operation content; and execute the image processing on the first object moving image based on the voting operation, wherein the image processing is executed at the designated time.

10

10. An image processing method, comprising: receiving a first object moving image from a first imaging device of a plurality of imaging devices and a second object moving image from a second imaging device of the plurality of imaging devices, wherein the first imaging device: calculates a distance from the first imaging device to a first specific object captured in a first moving image, wherein the first moving image is captured by the first imaging device; executes a clipping operation corresponding to an image processing such that the first specific object is clipped from the first moving image, wherein the clipping operation is executed based on the calculated distance; generates the first object moving image based on the execution of the clipping operation; adds likelihood information to the first object moving image based on the calculation of the distance to the first specific object, wherein the likelihood information indicates a probability of a calculation result being correct, the calculation result is associated with the calculation of the distance to the first specific object, and the likelihood information is in units of pixels constituting the first moving image; and executes a deletion operation corresponding to the image processing such that an unnecessary region in the first object moving image is deleted based on the likelihood information, the second imaging device generates the second object moving image from a second moving image, the second moving image includes a second specific object, the first object moving image includes a first region in which the first specific object is captured, and the second object moving image includes a second region in which the second specific object is captured; executing the image processing on each of the first object moving image and the second object moving image, wherein the image processing corresponds to each of addition of first operation content to the first object moving image and addition of second operation content to the second object moving image; generating a first combined moving image based on a combination of the first object moving image and the second object moving image with a specific moving image, and the execution of the image processing, wherein the generated first combined moving image includes the specific moving image as a background image, the first object moving image, and the second object moving image; controlling each of a first display unit of the first imaging device and a second display unit of the second imaging device to display the generated first combined moving image; receiving a user input from the first imaging device, wherein the user input indicates a plurality of depth coordinates of the first object moving image in the displayed first combined moving image; generating a second combined moving image based on the plurality of depth coordinates; and controlling the first display unit to display the generated second combined moving image.

11

11. A non-transitory computer-readable medium having stored thereon computer-readable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising: receiving a first object moving image from a first imaging device of a plurality of imaging devices and a second object moving image from a second imaging device of the plurality of imaging devices, wherein the first imaging device: calculates a distance from the first imaging device to a first specific object captured in a first moving image, wherein the first moving image is captured by the first imaging device; executes a clipping operation corresponding to an image processing such that the first specific object is clipped from the first moving image, wherein the clipping operation is executed based on the calculated distance; generates the first object moving image based on the execution of the clipping operation; adds likelihood information to the first object moving image based on the calculation of the distance to the first specific object, wherein the likelihood information indicates a probability of a calculation result being correct, the calculation result is associated with the calculation of the distance to the first specific object, and the likelihood information is in units of pixels constituting the first moving image; and executes a deletion operation corresponding to the image processing such that an unnecessary region in the first object moving image is deleted based on the likelihood information, the second imaging device generates the second object moving image from a second moving image, the second moving image includes a second specific object, the first object moving image includes a first region in which the first specific object is captured, and the second object moving image includes a second region in which the second specific object is captured; executing the image processing on each of the first object moving image and the second object moving image, wherein the image processing corresponds to each of addition of first operation content to the first object moving image and addition of second operation content to the second object moving image; generating a first combined moving image based on a combination of the first object moving image and the second object moving image with a specific moving image, and the execution of the image processing, wherein the generated first combined moving image includes the specific moving image as a background image, the first object moving image, and the second object moving image; controlling each of a first display unit of the first imaging device and a second display unit of the second imaging device to display the generated first combined moving image; receiving a user input from the first imaging device, wherein the user input indicates a plurality of depth coordinates of the first object moving image in the displayed first combined moving image; generating a second combined moving image based on the plurality of depth coordinates; and controlling the first display unit to display the generated second combined moving image.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

March 15, 2016

Publication Date

March 24, 2020

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Image processing system and image processing method” (US-10600169). https://patentable.app/patents/US-10600169

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.