A virtual object operating system and a virtual object operating method are provided. The virtual object operating method includes the following steps. Multiple images are obtained. A motion of an operating object in the images is determined. The operating object is existed in a real environment. A motion of a virtual object interacted with the operating object according to the motion of the operating object is determined. The virtual object is existed in a virtual environment. Accordingly, the motion of the operating object can be tracked without motion sensor on operating body portion of a user.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A virtual object operating method, comprising: obtaining a plurality of images, wherein the images are captured from a real environment; determining a motion of an operating object according to the plurality of images, wherein the operating object is existed in the plurality of images, and determining the motion of the operating object according to the plurality of images comprises: selecting a plurality of interacting images among the plurality of images, wherein the plurality of interacting images capture a plurality states of an interacting situation between the operating object and the virtual object; and determining the motion of the operating object by comparing the plurality of interacting images; and determining a motion of a virtual object interacted with the operating object according to a determining factor, wherein the virtual object is existed in a virtual environment, wherein the determining factor comprises the motion of the operating object.
2. The virtual object operating method according to claim 1 , wherein the plurality of interacting images comprises a starting image and an ending image, and the step of determining the motion of the operating object according to the plurality of images comprises: selecting the starting image among the plurality of images, wherein the starting image captures an initial state of the interacting situation between the operating object and the virtual object; selecting the ending image among the plurality of images, wherein the ending image captures a final state of the interacting situation between the operating object and the virtual object; and determining the motion of the operating object by comparing the starting image and the ending image.
3. The virtual object operating method according to claim 2 , wherein the step of determining the motion of the operating object by comparing the starting image and the ending image comprises: calculating an elapsed time and a position change of the operating object between the starting image and the ending image; obtaining an average velocity of the operating object according to the elapsed time and the position change of the operating object between the starting image and the ending image; and using the average velocity of the operating object as a reference to determine the motion of the operating object.
4. The virtual object operating method according to claim 1 , wherein the plurality of interacting images comprises a starting image, a middle image, and an ending image, and the step of determining the motion of the operating object according to the plurality of images comprises: selecting the starting image among the plurality of images, wherein the starting image captures an initial state of the interacting situation between the operating object and the virtual object; selecting the middle image among the plurality of images, wherein the middle image captures a middle state of an interacting situation between the operating object and the virtual object; selecting the ending image among the plurality of images, wherein the ending image captures a final state of the interacting situation between the operating object and the virtual object; and determining the motion of the operating object by comparing the starting image, the middle image, and the ending image.
5. The virtual object operating method according to claim 4 , wherein the step of determining the motion of the operating object by comparing the starting image, the middle image, and the ending image comprises: calculating a first elapsed time and a first position change of the operating object from the starting image to the middle image; obtaining a first velocity of the operating object according to the first elapsed time and the first position change of the operating object from the starting image to the middle image; calculating a second elapsed time and a second position change of the operating object from the middle image to the ending image; obtaining a second velocity of the operating object according to the second elapsed time and the second position change of the operating object from the middle image to the ending image; obtaining an average acceleration of the operating object according to the first elapsed time, the second elapsed time, the first velocity and the second velocity of the operating object; and using the average acceleration of the operating object as a reference to determine the motion of the operating object.
6. The virtual object operating method according to claim 4 , wherein the step of determining the motion of the operating object by comparing the starting image, the middle image, and the ending image comprises: obtaining a position change route of the operating object according to the first position change and the second position change; and using the position change route of the operating object as a reference to determine the motion of the operating object.
7. The virtual object operating method according to claim 1 , further comprising: determining physical characteristics of the virtual object; and wherein the determining factor further comprises the physical characteristics of the virtual object.
8. The virtual object operating method according to claim 7 , further comprising: scanning a real object in the real environment to generate a scanning result; identifying the real object according to the scanning result to generate an identification result; creating the virtual object in the virtual environment corresponding to the real object in the real environment according to the scanning result; and determining the physical characteristics of the virtual object according to the identification result.
9. The virtual object operating method according to claim 1 , further comprises: determining at least one interactive characteristic of the virtual object, wherein the determining factor further comprises the interactive characteristics of the virtual object.
10. The virtual object operating method according to claim 9 , further comprising: scanning a real object in the real environment to generate a scanning result; identifying the real object according to the scanning result to generate an identification result; creating the virtual object in the virtual environment corresponding to the real object in the real environment according to the scanning result; and determining the at least one interactive characteristic of the virtual object according to the identification result.
11. The virtual object operating method according to claim 10 , further comprising: identifying at least one manipulating point on the virtual object contacted by the operating object in the virtual environment; determining whether the at least one manipulating point meets at least one predefined manipulating point according to the at least one interactive characteristic, wherein the at least one interactive characteristic comprises the at least one predefined manipulating point, and the determining factor comprises the at least one manipulating point when the at least one manipulating point meets the at least one predefined manipulating point.
12. The virtual object operating method according to claim 1 , further comprising: identifying at least one manipulating point on the virtual object contacted by the operating object in the virtual environment; wherein the determining factor comprises the at least one manipulating point.
13. The virtual object operating method according to claim 1 , further comprising: identifying at least one manipulating point on the operating object contacted by the virtual object; and estimating at least one of spin speed and spin rotation of the virtual object, wherein the determining factor comprises at least one of the at least one manipulating point, acceleration of the operating object, the spin speed, and the spin rotation of the virtual object.
14. The object operating method according to claim 1 , wherein the step of determining the motion of the operating object according to the plurality of images comprises: obtaining motion detecting data of the operating object by a motion sensor on the operating object; and using the motion detecting data of the operating object as a reference to determine the motion of the operating object.
15. A virtual object operating system, comprises: an image capturing apparatus, obtaining a plurality of images from a real environment; a processor, coupled to the image capturing apparatus, and configured for: determining a motion of an operating object according to the plurality of images, wherein the operating object is existed in a real environment, and determining the motion of the operating object according to the plurality of images comprises: selecting a plurality of interacting images among the plurality of images, wherein the plurality of interacting images capture a plurality states of an interacting situation between the operating object and the virtual object; and determining the motion of the operating object by comparing the plurality of interacting images; and determining a motion of a virtual object interacted with the operating object according to a determining factor, wherein the virtual object is existed in a virtual environment, wherein the determining factor comprises the motion of the operating object.
16. The virtual object operating system according to claim 15 , wherein the plurality of interacting images comprises a starting image and an ending image, and the processor is configured for: selecting the starting image among the plurality of images, wherein the starting image captures an initial state of the interacting situation between the operating object and the virtual object; selecting the ending image among the plurality of images, wherein the ending image captures a final state of the interacting situation between the operating object and the virtual object; and determining the motion of the operating object by comparing the starting image and the ending image.
17. The virtual object operating system according to claim 16 , wherein the processor is configured for: calculating an elapsed time and a position change of the operating object between the starting image and the ending image; obtaining an average velocity of the operating object according to the elapsed time and the position change of the operating object between the starting image and the ending image; and using the average velocity of the operating object as a reference to determine the motion of the operating object.
18. The virtual object operating system according to claim 15 , wherein the plurality of interacting images comprises a starting image, a middle image, and an ending image, and the processor is configured for: selecting the starting image among the plurality of images, wherein the starting image captures an initial state of the interacting situation between the operating object and the virtual object; selecting the middle image among the plurality of images, wherein the middle image captures a middle state of an interacting situation between the operating object and the virtual object; selecting the ending image among the plurality of images, wherein the ending image captures a final state of the interacting situation between the operating object and the virtual object; and determining the motion of the operating object by comparing the starting image, the middle image, and the ending image.
19. The virtual object operating system according to claim 18 , wherein the processor is configured for: calculating a first elapsed time and a first position change of the operating object from the starting image to the middle image; obtaining a first velocity of the operating object according to the first elapsed time and the first position change of the operating object from the starting image to the middle image; calculating a second elapsed time and a second position change of the operating object from the middle image to the ending image; obtaining a second velocity of the operating object according to the second elapsed time and the second position change of the operating object from the middle image to the ending image; obtaining an average acceleration of the operating object according to the first elapsed time, the second elapsed time, the first velocity and the second velocity of the operating object; and using the average acceleration of the operating object as a reference to determine the motion of the operating object.
20. The virtual object operating system according to claim 18 , wherein the processor is configured for: obtaining a position change route of the operating object according to the first position change and the second position change; and using the position change route of the operating object as a reference to determine the motion of the operating object.
21. The virtual object operating system according to claim 15 , wherein the processor is configured for: determining physical characteristics of the virtual object; and wherein the determining factor further comprises the physical characteristics of the virtual object.
22. The virtual object operating system according to claim 21 , wherein the processor is configured for: scanning a real object in the real environment through the image capturing apparatus to generate a scanning result; identifying the real object according to the scanning result to generate an identification result; creating the virtual object in the virtual environment corresponding to the real object in the real environment according to the scanning result; and determining the physical characteristics of the virtual object according to the identification result.
23. The virtual object operating system according to claim 15 , wherein the processor is configured for: determining at least one interactive characteristic of the virtual object, wherein the determining factor further comprises the interactive characteristics of the virtual object.
24. The virtual object operating system according to claim 23 , wherein the processor is configured for: scanning a real object in the real environment to generate a scanning result; identifying the real object according to the scanning result to generate an identification result; creating the virtual object in the virtual environment corresponding to the real object in the real environment according to the scanning result; and determining the at least one interactive characteristic of the virtual object according to the identification result.
25. The virtual object operating system according to claim 24 , wherein the processor is configured for: identifying at least one manipulating point on the virtual object contacted by the operating object in the virtual environment; determining whether the at least one manipulating point meets at least one predefined manipulating point according to the at least one interactive characteristic, wherein the at least one interactive characteristic comprises the at least one predefined manipulating point, and the determining factor comprises the at least one manipulating point when the at least one manipulating point meets the at least one predefined manipulating point.
26. The virtual object operating system according to claim 15 , wherein the processor is configured for: identifying at least one manipulating point on the virtual object contacted by the operating object in the virtual environment; wherein the determining factor comprises the at least one manipulating point.
27. The virtual object operating system according to claim 15 , wherein the processor is configured for: identifying at least one manipulating point on the operating object contacted by the virtual object; and estimating at least one of spin speed and spin rotation of the virtual object, wherein the determining factor comprises at least one of the at least one manipulating point, acceleration of the operating object, the spin speed, and the spin rotation of the virtual object.
28. The virtual object operating system according to claim 15 , wherein the processor is configured for: obtaining motion detecting data of the operating object by a motion sensor on the operating object; and using the motion detecting data of the operating object as a reference to determine the motion of the operating object.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
October 24, 2019
March 16, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.