Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method of controlling a virtual object or a viewpoint of a user on a two-dimensional (2D) interactive display, the method comprising: verifying, when a number of touch points by a user input is at least two, two touch points most adjacent to each other among the at least two touch points; determining whether a distance between the verified two touch points is less than a predetermined value; pairing the verified two touch points when the distance between the verified two touch points is less than the predetermined value; converting the user input to at least 6 degrees of freedom (DOF) structured data according to at least one of a movement direction of the paired touch points and a rotation direction of the paired touch points; and controlling a manipulation target using the at least 6DOF structured data.
A method for controlling a virtual object or a user's viewpoint on a 2D interactive display involves processing user touch inputs. When two or more touch points are detected, the method identifies the two closest touch points. If the distance between these points is below a threshold, they are paired. The touch input is then converted into 6 degrees of freedom (6DOF) data based on the movement and/or rotation of the paired touch points. Finally, the virtual object or viewpoint is controlled using this 6DOF data.
2. The method of claim 1 , wherein the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a three-dimensional (3D) space comprising the X axis, the Y axis, and the Z axis.
The method of controlling a virtual object or a user's viewpoint on a 2D interactive display, where the 6 degrees of freedom (6DOF) data from the previous description include movement along the X, Y, and Z axes, as well as roll, pitch, and yaw rotations around these axes in a 3D space. This allows for full spatial control of the virtual object or viewpoint.
3. The method of claim 1 , wherein the converting of the user input comprises comparing the number of the touch points with a predetermined particular value to convert the user input to the at least 6DOF structured data.
In the method of controlling a virtual object or a user's viewpoint on a 2D interactive display, the conversion of user touch input into 6 degrees of freedom (6DOF) data involves comparing the number of touch points to a specific predetermined value. The 6DOF data generation is influenced by this comparison.
4. The method of claim 1 , wherein, when the number of the touch points is at least two, the converting of the user input comprises pairing the at least two touch points and converting the user input to the at least 6DOF structured data according to a movement direction of the paired at least two touch points and a rotation direction thereof.
In the method of controlling a virtual object or a user's viewpoint on a 2D interactive display, when two or more touch points are detected, the method pairs these touch points and converts the user input into 6 degrees of freedom (6DOF) data based on the movement and/or rotation direction of the paired touch points.
5. The method of claim 1 , wherein the controlling of the manipulation target comprises applying a video effect or an audio effect to the manipulation target that is any one of the virtual object and the viewpoint of the user.
In the method of controlling a virtual object or a user's viewpoint on a 2D interactive display, controlling the virtual object or user viewpoint involves applying video or audio effects. This effect is applied to whichever is selected as the manipulation target.
6. The method of claim 1 , further comprising: displaying a virtual manipulation medium as a user interface to manipulate the virtual object, displayed on a screen, or the viewpoint of the user, wherein the virtual manipulation medium is displayed in a region including the virtual object when the virtual object is determined as the manipulation target, and the virtual manipulation medium is displayed in a region excluding the virtual object when the viewpoint of the user is determined as the manipulation target.
The method of controlling a virtual object or a user's viewpoint on a 2D interactive display further comprises displaying a virtual manipulation medium on the screen as a user interface. If the virtual object is the manipulation target, the medium is displayed in a region including the virtual object. If the viewpoint is the target, the medium is displayed in a region excluding the virtual object.
7. The method of claim 6 , wherein, when the number of the touch points is two, the displayed virtual manipulation medium has a spherical form which has a diameter which is determined by a distance between two fingers, and the displayed virtual medium includes display of three-dimensional (3D) coordinate axes.
In the method where a virtual manipulation medium is displayed, when two touch points are used, the virtual manipulation medium takes on a spherical shape. The diameter of this sphere is determined by the distance between the two fingers used for touch input. Additionally, the virtual manipulation medium displays 3D coordinate axes.
8. A non-transitory computer-readable recording media storing program instructions to control at least one processor to implement the method of claim 1 .
A non-transitory computer-readable storage medium stores program instructions that, when executed, control a processor to perform the method of controlling a virtual object or a user's viewpoint on a 2D interactive display. The method involves: verifying two closest touch points when two or more are present; determining if their distance is less than a threshold; pairing them if it is; converting the input to 6DOF data based on movement/rotation; and controlling the manipulation target using this data.
9. The method of claim 1 , wherein: the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a three-dimensional (3D) space comprising the X axis, the Y axis, and the Z axis; and when the number of touch points is at least two, the converting of the user input comprises pairing the at least two touch points and converting the user input to the at least 6DOF structured data according to at least one of a movement direction of the paired at least two touch points and a rotation direction thereof to provide movement along the X-axis, movement along the Y-axis, movement along the Z-axis, roll, pitch, and yaw.
A method of controlling a virtual object or a user's viewpoint on a 2D interactive display, where the 6 degrees of freedom (6DOF) data from the previous description include movement along the X, Y, and Z axes, as well as roll, pitch, and yaw rotations around these axes in a 3D space. Furthermore, when two or more touch points are detected, the method pairs these touch points and converts the user input into 6 degrees of freedom (6DOF) data based on the movement and/or rotation direction of the paired touch points to provide movement along the X, Y, and Z-axis, roll, pitch and yaw.
10. The method of claim 1 , further comprising: determining, as the manipulation target, any one of the virtual object and the viewpoint of the user, based on the touch points, wherein the virtual object is determined as the manipulation target when a location of the touch points exists in a region including the virtual object, and the viewpoint of the user is determined as the manipulation target when the location of the touch points exists in a region excluding the virtual object.
The method of controlling a virtual object or a user's viewpoint on a 2D interactive display also includes determining which one is the manipulation target. This determination is based on the location of the touch points. If the touch points are located in a region including the virtual object, the virtual object is selected. If they are located in a region excluding the virtual object, the viewpoint is selected.
11. A method of processing multi-touch structured data, the method comprising: receiving, from a multi-touch driver, the multi-touch structured data that is associated with a user input via a virtual manipulation medium; extracting, from the multi-touch structured data, a number of touch points, a movement direction thereof, a location thereof, and a rotation direction thereof; verifying, when the number of touch points is at least two, two touch points most adjacent to each other among the at least two touch points; determining whether a distance between the verified two touch points is less than a predetermined value; pairing the verified two touch points when the distance between the verified two touch points is less than the predetermined value; and converting the multi-touch structured data to at least 6 degrees of freedom (6DOF) structured data, based on at least one of a movement direction of the paired touch points and a rotation direction of the paired touch points.
A method for processing multi-touch data involves receiving data from a multi-touch driver associated with a user's interaction with a virtual manipulation medium. The number of touch points, their movement direction, location, and rotation direction are extracted. If two or more touch points are present, the two closest points are identified. If their distance is below a threshold, they are paired. The multi-touch data is then converted into 6 degrees of freedom (6DOF) data based on the movement and/or rotation of the paired touch points.
12. The method of claim 11 , wherein the converting of the multi-touch structured data comprises comparing the number of touch points with a predetermined particular value to convert the multi-touch structured data to the at least 6DOF structured data.
In the method of processing multi-touch data, the conversion of multi-touch structured data into 6 degrees of freedom (6DOF) data involves comparing the number of touch points with a predetermined value. The 6DOF data is generated based on this comparison.
13. The method of claim 8 , wherein the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a 3D space comprising of the X axis, the Y axis, and the Z axis.
In the method of processing multi-touch data, the 6 degrees of freedom (6DOF) data includes movement along the X, Y, and Z axes, as well as roll, pitch, and yaw rotations around these axes in a 3D space. This allows for full spatial control of the interaction.
14. A non-transitory computer-readable recording media storing program instructions to control at least one processor to implement the method of claim 11 .
A non-transitory computer-readable storage medium stores program instructions that, when executed, control a processor to perform the method of processing multi-touch data. The method involves receiving data from a multi-touch driver; extracting touch point information; verifying and pairing closest touch points; converting the data to 6DOF data.
15. A method of processing a virtual manipulation medium that is used to control a virtual object or a viewpoint of a user on an interactive display, the method comprising: receiving, from a user input via the virtual manipulation medium, at least 6 degrees of freedom (6DOF) structured data, wherein the at least 6DOF structured data is generated based on a number of touch points, a movement direction thereof, a location thereof, and a rotation direction thereof; determining, as a manipulation target, any one of the virtual object, displayed on a screen, and the viewpoint of the user, based on the location of the touch point, wherein the virtual object is determined as the manipulation target when a location of the touch points exists in a region including the virtual object, and the viewpoint of the user is determined as the manipulation target when the location of the touch points exists in a region excluding the virtual object; displaying, as a user interface, the virtual manipulation medium in any one of a region including the virtual object and a region excluding the virtual object, depending on whether the virtual object is determined as the manipulation target or the viewpoint of the user is determined as the manipulation target; and applying a video effect or an audio effect to the manipulation target that is any one of the virtual object and the viewpoint of the user.
A method of processing a virtual manipulation medium used to control a virtual object or user viewpoint on an interactive display involves receiving 6 degrees of freedom (6DOF) data from a user interacting with the medium. This 6DOF data is generated from touch points, their movement, location, and rotation. The virtual object or viewpoint is selected as the manipulation target based on touch location. The manipulation medium is displayed either including or excluding the virtual object based on the selected target. Video/audio effects are applied to the manipulation target.
16. The method of claim 15 , wherein the at least 6DOF comprises a movement along an X axis, a movement along a Y axis, a movement along a Z axis, a roll based on the X axis, a pitch based on the Y axis, and a yaw based on the Z axis, in a 3D space comprising the X axis, the Y axis, and the Z axis.
In the method of processing a virtual manipulation medium, the 6 degrees of freedom (6DOF) data includes movement along the X, Y, and Z axes, as well as roll, pitch, and yaw rotations around these axes in a 3D space.
17. The method of claim 15 , wherein, when the number of touch points is two, the displayed virtual manipulation medium has a spherical form which has a diameter which is determined by a distance between two fingers, and the displayed virtual medium includes display of three-dimensional (3D) coordinate axes.
In the method of processing a virtual manipulation medium, when two touch points are used, the virtual manipulation medium takes on a spherical shape. The diameter of this sphere is determined by the distance between the two fingers used for touch input. Additionally, the virtual manipulation medium displays 3D coordinate axes.
18. A non-transitory computer-readable recording media storing program instructions to control at least one processor to implement the method of claim 15 .
A non-transitory computer-readable storage medium stores program instructions that, when executed, control a processor to perform the method of processing a virtual manipulation medium to control a virtual object or viewpoint using 6DOF data derived from touch inputs.
19. A computing system for controlling a virtual object or a viewpoint of a user on a two-dimensional (2D) interactive display, the system comprising: a multi-touch sensor to recognize one or more touches of the user and to generate one or more touch signals, wherein a virtual manipulation medium is displayed on the interactive display after the multi-touch sensor recognizes the one or more touches; a multi-touch driver, using at least one processor, to generate multi-touch structured data based on one or more touch signals received from the multi-touch sensor; a six degree of freedom interaction engine to receive the multi-touch structured data from the multi-touch driver and to generate six degrees of freedom structured data; a virtual manipulation medium processing engine to generate a command to apply at least one of a video effect and an audio effect to the virtual manipulation medium to correspond to a user gesture using the six degrees of freedom structured data; and a three-dimensional virtual application to generate a command to perform a graphic process according to motion of the virtual object or according to a movement of a camera, using the six degrees of freedom structured data, wherein, when the number of touches is two, the displayed virtual manipulation medium has a spherical form which has a diameter which is determined by a distance between two fingers, and the displayed virtual medium includes display of three-dimensional (3D) coordinate axes.
A computing system for controlling a virtual object or viewpoint on a 2D display includes a multi-touch sensor to detect user touches and generate signals. A virtual manipulation medium is displayed upon touch recognition. A multi-touch driver generates multi-touch data. A 6DOF engine processes this data to generate 6DOF data. A medium processing engine generates commands to apply video/audio effects corresponding to user gestures. A 3D application generates commands for graphic processing based on the motion or camera movement. When two touches are used, the displayed virtual medium has a spherical form with a diameter determined by finger distance and displays 3D coordinate axes.
Unknown
September 16, 2014
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.