Virtual Input Device

The present invention relates to an input device, and more particularly to a virtual input device.

The development of electronic communication devices is in the trend of size miniaturization. For the purposes of maneuverability of the portable electronic devices, namely fulfilling the ultimate goal of enabling communication with anyone at any time and any place, the size of the electronic devices cannot be unlimitedly expanded, and consequently, the existing portable electronic devices suffer small screen size.

To overcome such a problem, Taiwan Patent 1307032 provides a keyboard input method and device, which suggests a direction control button be combined with an existing button or shown on a screen as a virtual button, in order to suit the need for input with an existing interface to drive a corresponding button to allow a user to make inputs.

Although the know technology described above allows a screen display area to be expanded, yet in case that for a display screen of a portable electronic device is relatively small, while the screen is displaying an image, there is a simultaneous need for operating a virtual button on the screen for carrying out inputting, the inputting operation cannot be properly performed for directly entering characters, texts, or controls before the image that is being displayed is reduced in size to allow the virtual button to display on the screen for operation for inputting. The operation is inconvenient and further improvement is necessary.

To achieve the above-mentioned objective, the present invention provides a virtual input device, which comprises: a head-mounted display device, which comprise an image projection module and a control module; a hand gesture detection module, which is arranged on the head-mounted display device, the hand gesture detection module being electrically connected with the control module; and a transmission module, which is electrically connected with the control module.

The head-mounted display device can be a head-mounted augmented reality (AR) display device or a head-mounted virtual reality (VR) display device.

The hand gesture detection module can be a non-contact hand gesture detection module, comprising an ultrasonic, laser, or infrared based hand gesture detection module.

The transmission module can be an infrared, ZigBee, Bluetooth, radio frequency, or laser based wireless transmission module.

The transmission module can be a serial bus, RS232, or IEEE1394 based wired transmission module.

The head-mounted display device uses the image projection module to project and form a virtual device, and uses the hand gesture detection module to detect a hand gesture of a user to serve as a hand gesture input, and uses the control module to output a drive signal according to a requirement of the user to which the hand gesture input corresponds, and uses the transmission module to transmit the drive signal to a physical device that is externally located. For example, if the user attempts to operate a mobile phone or computer, but considers the mobile phone screen or the computer screen is relatively small and is not easy to use, the user may use the present invention to project and form a virtual mobile phone or computer at any time on a desk top, making the use extremely convenient.

Referring to, the present invention provides a virtual input device, which comprises: a head-mounted display device, a hand gesture detection module, and a transmission module.

The head-mounted display devicecomprises an image projection moduleand a control module. The head-mounted display devicecan be a head-mounted augmented reality (AR) display device or a head-mounted virtual reality (VR) display device. The image projection modulefunctions to project a virtual image. Taking an AR display device as an example, the image projection modulefunctions as an optical machine of AR display device. The term “|optical machine” is a simplified term for “optoelectrical precision instrument and machines”. The optical machine comprises a light source, an optical waveguide, and an optical grating. In the AR display device, the optical machine often includes a miniature light-emitting diode (LED) or a laser source to generate image data, and the optical waveguide technology is applied to transmit, by means of refraction and total reflection, the image data to a retina of a user to allow the user to see the virtual image, while not affecting the user's observation of a physical site view. The control moduleincludes functions of logic operations, storage of operation results, and execution of instructions, and the control modulecan be a central processing unit (CPU), a microprocessor unit (MPU), a microcontroller unit (MCU), or an application specific integrated circuit.

The hand gesture detection moduleis arranged on the head-mounted display device, and the hand gesture detection moduleis electrically connected with the control module. The hand gesture detection moduleis a non-contact hand gesture detection module, including ultrasonic, laser, or infrared based hand gesture detection modules. As an example of illustration, an infrared based hand gesture detection module comprises an infrared LED, a sensor, and a microcontroller. When the sensor detects an object, the infrared LED emits infrared light and receives energy reflected by an object upon which the infrared light impinges to convert into an electronic signal, with which a user's hand gesture, including moving path and location of the hand, is detected to serve as a hand gesture input. The sensor transmits data of the hand gesture to the microcontroller, and the microcontroller is loaded with software that analyzes and determines the user's hand gesture, such a hand waving direction. For example, the microcontroller may be loaded with a preset hand gesture, and the microcontroller execute software to identify, through comparison, if the hand gesture input corresponds to or matches the preset hand gesture in order to generate a hand gesture comparison signal according to the result of comparison. Afterwards, the hand gesture detection moduletransmits the hand gesture comparison signal to the control module, and the control moduleoutputs a drive signal according to a user's requirement corresponding to the hand gesture input. The corresponding relationship between the hand gesture input and the user's requirement can be pre-stored in the control module, and the control moduleoutputs the drive signal according to the corresponding relationship between the hand gesture input and the user's requirement.

The transmission moduleis electrically connected with the control module. The transmission modulecan be an infrared, ZigBee, Bluetooth, radio frequency, or laser based wireless transmission module. Or alternatively, the transmission modulecan be a serial bus, RS232, or IEEE1394 based wired transmission module.

Referring to, use of the virtual input device according to the present invention can be implemented with the following steps:

As such, the head-mounted display deviceuses the image projection moduleto project and form a virtual device, and uses the hand gesture detection moduleto detect a hand gesture of a user to serve as a hand gesture input, and uses the control moduleto output a drive signal according to the requirement of the user to which the hand gesture input corresponds, and uses the transmission moduleto transmit the drive signal to a physical devicethat is externally located. For example, if the user attempts to operate a mobile phone or computer, but considers the mobile phone screen or the computer screen is relatively small and is not easy to use, the user may use the present invention to project and form a virtual mobile phone or computer at any time on a desk top, making the use extremely convenient. Compared with the prior art, the present invention makes a direct projection of a virtual device, rather than just displaying of a virtual button on a screen, so that the operation is made convenient.