[Object] To provide a control apparatus, an input apparatus, a control system, a control method, and a handheld apparatus that are capable of preventing a deviation between a display position of a pointer and a relative position of the input apparatus when the input apparatus is moved out of a screen from an end portion of the screen, and with which a user can obtain an intuitional operational feeling.[Solving Means] Not only on a real screen (95) but also on a virtual screen (105) set around the real screen (95), coordinates of a virtual pointer (2′) are generated and stored. Accordingly, by moving an input apparatus (1) only by an amount that the input apparatus has moved outside the real screen (95), in an opposite direction, for example, a user can resume a movement of a pointer (2) that has reached a boundary line of the real screen (95), on the real screen (95). As a result, since coordinate values of the pointer are generated in a pseudo absolute coordinate system without being bound by a small screen, the user can operate the input apparatus (1) intuitionally without stress.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A control apparatus for controlling display of a pointer based on input information including a three-dimensional movement amount of an input apparatus, the control apparatus comprising: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the input apparatus in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the input apparatus in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated; a storage means for storing a virtual display area on the virtual screen out of a selection operation area as a target of a selection operation by the input apparatus, the virtual display area being stored in association with the second coordinate system; a judgment means for judging whether the generated second coordinate information is within the virtual display area; and a selection control means for controlling the target of the selection operation when the generated second coordinate information is within the virtual display area.
A control system displays a pointer on a screen based on 3D input device movements. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. It stores a "virtual display area" (part of a selection area) on the virtual screen. The system determines if the virtual pointer position is within this virtual display area. If so, it controls what the user can select. This allows continuous pointer control even when the input device moves beyond the physical screen boundaries, providing an intuitive user experience.
2. The control apparatus according to claim 1 , wherein the display control means generates image data of a real display area on the real screen adjacent to the virtual display area out of the selection operation area.
The control apparatus described in claim 1 generates image data of a real display area on the real screen adjacent to the virtual display area out of the selection operation area. This means that when a selection area extends from the real screen to the virtual screen, the system creates a visual representation of the selection area's portion residing on the real screen. This provides visual feedback to the user about available options even when interacting with the virtual screen extension.
3. The control apparatus according to claim 2 , wherein the display control means displays the real display area on the real screen when the judgment means judges that the second coordinate information is within the virtual display area.
The control apparatus described in claim 1 which generates pointer coordinates for both real and virtual screens and stores a virtual display area, and as further described in claim 2 which generates image data of a real display area on the real screen adjacent to the virtual display area, the system displays the real display area on the real screen only when the virtual pointer is within the virtual display area. This ensures the user only sees relevant parts of the extended selection operation when needed, maintaining a cleaner interface otherwise.
4. The control apparatus according to claim 1 , wherein the selection control means variably controls a switching velocity in the selection operation in accordance with a distance between the generated second coordinate information and a boundary line at an end portion of the first coordinate system, the boundary line being a boundary between the first coordinate system and the second coordinate system.
The control apparatus described in claim 1 which generates pointer coordinates for both real and virtual screens and stores a virtual display area, variably controls a switching velocity in the selection operation based on the distance between the generated virtual pointer position and the boundary between the real and virtual screen coordinate systems. Closer to the boundary, the selection operation speed changes to allow finer control near the screen edge, while farther away the selection operation behaves normally.
5. The control apparatus according to claim 1 , wherein the storage means stores the virtual display area of the selection operation area that is provided plurally, the plurality of virtual display areas being stored in association with the second coordinate system.
The control apparatus described in claim 1 which generates pointer coordinates for both real and virtual screens and stores a virtual display area, stores multiple virtual display areas associated with the virtual screen coordinate system. This allows for multiple selectable regions to exist within the extended virtual space, enabling more complex interactions beyond the physical screen boundaries.
6. The control apparatus according to claim 1 , further comprising: a reception means for receiving a command signal output in accordance with a button operation of the input apparatus; and a correction means for causing the position of the pointer to correspond to a predetermined reference position on the real screen based on the received command signal.
The control apparatus described in claim 1 which generates pointer coordinates for both real and virtual screens and stores a virtual display area, also receives commands from a button press on the input device. Upon receiving a command, the pointer is repositioned to a predetermined reference point on the real screen. This provides a quick way for the user to reset the pointer position to a known location.
7. The control apparatus according to claim 6 , wherein the display control means temporarily displays the pointer with emphasis when the pointer is displayed at the reference position.
The control apparatus described in claim 1 which generates pointer coordinates for both real and virtual screens and stores a virtual display area, and as further described in claim 6 which repositions the pointer to a reference point upon button press, the system highlights the pointer temporarily when it is repositioned to the reference point, providing visual feedback to the user that the repositioning action has occurred.
8. A control apparatus for controlling display of a pointer based on input information including a three-dimensional movement amount of an input apparatus, the control apparatus comprising: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the input apparatus in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the input apparatus in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; and a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated, wherein the display control means controls the display of the pointer so that, when the input information is changed from a first input value that corresponds to a position on a boundary line at an end portion of the first coordinate system, the boundary line being a boundary between the first coordinate system and the second coordinate system, to a second input value that corresponds to a position in an area of the second coordinate system adjacent to the boundary line, the pointer is displayed on the boundary line.
A control system displays a pointer on a screen based on 3D input device movements. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. When the input moves from a real screen position to a virtual screen position across the boundary, the pointer stays on the edge of the real screen. This prevents the pointer from disappearing when the input device moves off-screen, ensuring continuous visual feedback to the user.
9. The control apparatus according to claim 8 , wherein the display control means controls the display of the pointer so that the pointer moves on the boundary line by updating the first coordinate values on the boundary line in accordance with the second coordinate information generated by the generation means.
The control apparatus described in claim 8 which displays a pointer on the edge of the real screen when the input device moves into the virtual area, moves the pointer along the real screen edge based on the virtual coordinates. This means the user can continue to control the pointer along the screen edge even when the input device is beyond the physical screen.
10. The control apparatus according to claim 8 , wherein the display control means changes a display form of the pointer on the boundary line in accordance with a change in the second input value.
The control apparatus described in claim 8 which displays a pointer on the edge of the real screen when the input device moves into the virtual area, changes the pointer's appearance when it's on the edge. For example, the color or shape of the pointer changes, indicating to the user that the input device is off-screen and the pointer's behavior is different.
11. A control apparatus for controlling display of a pointer based on input information including a three-dimensional movement amount of an input apparatus, the control apparatus comprising: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the input apparatus in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the input apparatus in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; and a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated, wherein the display control means generates a signal for executing processing for setting a state of the pointer to be uncorrelated to the input information when the input information is changed from a first input value of the input information that indicates that the pointer is positioned in the first coordinate system to a second input value of the input information that indicates that the pointer is positioned in the second coordinate system.
A control system displays a pointer on a screen based on 3D input device movements. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. When the input moves from the real screen to the virtual screen, the system stops updating the pointer position. This essentially freezes the pointer when the input device goes off-screen.
12. The control apparatus according to claim 11 , wherein the processing uncorrelated to the input information includes processing of stopping the pointer on the real screen.
The control apparatus described in claim 11, where the pointer stops being updated when the input device is moved into the virtual area, freezes the pointer's position on the real screen. The pointer remains visible but does not respond to further movement of the input device until it's moved back onto the "real" screen.
13. A control apparatus for controlling display of a pointer based on input information including a three-dimensional movement amount of an input apparatus, the control apparatus comprising: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the input apparatus in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the input apparatus in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated; a judgment means for judging whether the generated first coordinate information is on a boundary line at an end portion of the first coordinate system, the boundary line being a boundary between the first coordinate system and the second coordinate system; and a start means for causing the generation means to start generating the second coordinate information when the first coordinate information is on the boundary line.
A control system displays a pointer on a screen based on 3D input device movements. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. The system detects when the pointer reaches the edge of the real screen. When this happens, it starts generating coordinates in the virtual screen system. This allows seamless transition from real to virtual screen interaction.
14. A control apparatus for controlling display of a pointer based on input information including a three-dimensional movement amount of an input apparatus, the control apparatus comprising: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the input apparatus in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the input apparatus in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; and a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated, wherein the input apparatus is a three-dimensional operation input apparatus that generates a velocity value of the input apparatus based on at least one of an acceleration value of the input apparatus and an angular velocity value of the input apparatus and transmits information on the velocity value, the control apparatus further comprising: a reception means for receiving the transmitted information on the velocity value as the input information.
A control system displays a pointer on a screen based on 3D input device movements. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. The system receives velocity data from a 3D motion controller, which calculates velocity based on acceleration or angular velocity. The system uses this velocity data to determine the pointer's position on the screen.
15. A control apparatus for controlling display of a pointer based on input information including a three-dimensional movement amount of an input apparatus, the control apparatus comprising: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the input apparatus in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the input apparatus in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; and a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated, wherein the input apparatus is a three-dimensional operation input apparatus that transmits information on at least one of an acceleration value of the input apparatus and an angular velocity value of the input apparatus, the control apparatus further comprising: a reception means for receiving the transmitted information on at least one of the acceleration value and the angular velocity value; and a calculation means for calculating a velocity value of the input apparatus based on the received information on at least one of the acceleration value and the angular velocity value, wherein the generation means generates the first coordinate information and the second coordinate information that correspond to the input information while using information on the calculated velocity value as the input information.
A control system displays a pointer on a screen based on 3D input device movements. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. The system receives acceleration and/or angular velocity data from a 3D motion controller. It calculates velocity based on this received data. The system then uses this calculated velocity to determine the pointer's position on the screen in both the real and virtual coordinate systems.
16. An input apparatus controlling display of a pointer, comprising: a casing; an input information generation means for detecting a three-dimensional movement of the casing and generating input information including an amount of the movement of the casing; a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the casing in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the casing in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated; a storage means for storing a virtual display area on the virtual screen out of a selection operation area as a target of a selection operation by the input apparatus, the virtual display area being stored in association with the second coordinate system; a judgment means for judging whether the generated second coordinate information is within the virtual display area; and a selection control means for controlling the target of the selection operation when the generated second coordinate information is within the virtual display area.
A 3D input device displays a pointer on a screen. It detects movement and calculates a movement amount. It generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. It stores a "virtual display area" (part of a selection area) on the virtual screen. The system determines if the virtual pointer position is within this virtual display area. If so, it controls what the user can select. This allows continuous pointer control even when the input device moves beyond the physical screen boundaries, providing an intuitive user experience.
17. A control system controlling display of a pointer, comprising: an input apparatus including: a casing, an input information generation means for detecting a three-dimensional movement of the casing and generating input information including an amount of the movement of the casing, and a transmission means for transmitting the input information; and a control apparatus including: a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the casing in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the casing in a second coordinate system corresponding to a virtual screen associated with the first coordinate system, a display control means for controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated, a storage means for storing a virtual display area on the virtual screen out of a selection operation area as a target of a selection operation by the input apparatus, the virtual display area being stored in association with the second coordinate system, a judgment means for judging whether the generated second coordinate information is within the virtual display area, and a selection control means for controlling the target of the selection operation when the generated second coordinate information is within the virtual display area.
A system includes a 3D input device and a control apparatus. The 3D input device detects movement and transmits this movement data. The control apparatus receives this data and generates pointer coordinates in two systems: a "real screen" coordinate system and a "virtual screen" coordinate system extending beyond the real screen. It stores a "virtual display area" (part of a selection area) on the virtual screen. The system determines if the virtual pointer position is within this virtual display area. If so, it controls what the user can select. This allows continuous pointer control even when the input device moves beyond the physical screen boundaries, providing an intuitive user experience.
18. A control method controlling display of a pointer based on input information corresponding to a three-dimensional movement of an input apparatus, comprising: generating first coordinate information indicating a position of the pointer by integrating an amount of the movement of the casing in a first coordinate system corresponding to a real screen; generating second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the casing in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; controlling the display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated; storing a virtual display area on the virtual screen out of a selection operation area as a target of a selection operation by the input apparatus, the virtual display area being stored in association with the second coordinate system; judging whether the generated second coordinate information is within the virtual display area; and controlling the target of the selection operation when the generated second coordinate information is within the virtual display area.
A method for controlling a pointer on a screen using a 3D input device involves: generating pointer coordinates in both a "real screen" coordinate system and a "virtual screen" coordinate system; displaying the pointer based on these coordinates; storing a "virtual display area" within the virtual screen; determining if the pointer is within the virtual display area; and controlling selection behavior based on whether the pointer is within this virtual area. This provides an intuitive and continuous pointer control experience when using a 3D input device that can move beyond the screen boundaries.
19. A handheld apparatus comprising: a casing; a display section; an input information generation means for detecting a three-dimensional movement of the casing and generating input information including an amount of the movement of the casing; a generation means for generating first coordinate information indicating a position of the pointer by integrating the movement amount of the casing in a first coordinate system corresponding to a real screen, and second coordinate information indicating a virtual position of the pointer by integrating the movement amount of the casing in a second coordinate system corresponding to a virtual screen associated with the first coordinate system; a display control means for controlling display of the pointer on the real screen in accordance with the first coordinate information and the second coordinate information that have been generated; a storage means for storing a virtual display area on the virtual screen out of a selection operation area as a target of a selection operation by the input apparatus, the virtual display area being stored in association with the second coordinate system; a judgment means for judging whether the generated second coordinate information is within the virtual display area; and a selection control means for controlling the target of the selection operation when the generated second coordinate information is within the virtual display area.
A handheld device with a display screen tracks its 3D movement. It generates pointer coordinates in two systems: a "real screen" coordinate system (the device's physical screen) and a "virtual screen" coordinate system extending beyond the real screen. It stores a "virtual display area" on the virtual screen. The device determines if the virtual pointer position is within this virtual display area. If so, it controls what the user can select. This enables continued pointer control even when the device is moved beyond the edges of its own physical screen.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
December 2, 2008
September 10, 2013
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.