Control Method, Apparatus, Device, and Medium for an Application in an Extended Reality Space

The present application claims priority to Chinese Patent Application No. 2022113945776, filed on Nov. 8, 2022 and entitled “CONTROL METHOD, APPARATUS, DEVICE, AND MEDIUM FOR AN APPLICATION IN AN EXTENDED REALITY SPACE”, the entirety of which is incorporated herein by reference.

Embodiments of the present application relate to the field of electronic device technologies, and in particular, to a control method, apparatus, device, and medium for an application in an extended reality space.

Extended Reality (XR) refers to combining reality and virtuality by using a computer to construct a virtual environment for human-machine interaction. XR is also a collective term for various technologies including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). By blending the visual interactive technologies of the three, a “sense of immersion” that seamlessly transitions between a virtual world and the real world is brought to the user.

Currently, in an XR device, there are a plurality of controls displayed on a user interface (UI) of an application, for example, a closing control, a minimizing control, a zoom control, and a screen projection control, or the like, and a user operates the application through these controls.

However, having too many controls on the UI of an application makes the UI unaesthetic, and some controls are inconvenient for users to operate.

Provided are a control method, apparatus, device, and medium for an application in an extended reality space. By integrating a plurality of interactive functions of an application into a first comprehensive control outside a UI, the UI of the application becomes more concise and convenient for users to operate a control of the UI.

According to a first aspect, an embodiment of the present application provides a control method for an application in an extended reality space, comprising:

In some embodiments, in response to the operation on the first comprehensive control, controlling the application to perform the interactive function corresponding to the operation comprises:

In some embodiments, the first operation is a click operation on the first comprehensive control.

In some embodiments, in response to the operation on the first comprehensive control, controlling the application to perform the interactive function corresponding to the operation comprises:

In some embodiments, in response to the second operation on the first comprehensive control, controlling the UI to move comprises:

In some embodiments, the second operation is a drag operation on the first comprehensive control.

In some embodiments, in response to the operation on the first comprehensive control, controlling the application to perform the interactive function corresponding to the operation comprises:

In some embodiments, in response to detecting that the cursor moves into the first detection area of the first comprehensive control and hovers for the duration equal to the first duration, displaying the title bar at the predetermined location comprises:

In some embodiments, the method further comprises:

In some embodiments, the title bar is located in proximity to the first comprehensive control and the method further comprises:

In some embodiments, the first state is a downward arrow style and the second state is a horizontal bar style.

In some embodiments, in response to the operation on the first comprehensive control, controlling the application to perform the interactive function corresponding to the operation comprises:

In some embodiments, in response to the third operation on the first comprehensive control, closing the UI and the application comprises:

In some embodiments, the third operation is a double-click operation.

In some embodiments, the first state is a downward arrow style and the third state is a cross style.

In some embodiments, the first comprehensive control is a downward arrow style of control.

In some embodiments, the UI does not comprise a control, and the first comprehensive control integrates a function of an existing control of the application.

In some embodiments, a taskbar and a second comprehensive control of the taskbar are further displayed in the extended reality space, the second comprehensive control is located outside the taskbar, the second comprehensive control integrates a plurality of interactive functions of the taskbar, and the second comprehensive control is displayed following the taskbar, and wherein the method further comprises:

In some embodiments, in response to the operation on the second comprehensive control, controlling the taskbar to perform the interactive function corresponding to the operation on the second comprehensive control comprises:

In some embodiments, the fourth operation is a click operation or a double-click operation on the second comprehensive control.

In some embodiments, in response to the fourth operation on the second comprehensive control, hiding the taskbar comprises:

In some embodiments, in response to the operation on the second comprehensive control, controlling the taskbar to perform the interactive function corresponding to the operation on the second comprehensive control comprises:

In some embodiments, in response to the fifth operation on the second comprehensive control, controlling the taskbar to move, or controlling the taskbar to move together with the UI of the application running in the foreground comprises:

In some embodiments, the second comprehensive control is a downward arrow style of control.

In some embodiments, the first state of the second comprehensive control is a downward arrow style, and the second state of the second comprehensive control is a horizontal bar style.

In some embodiments, a relative location of the first comprehensive control and the UI remains unchanged.

In some embodiments, a relative location of the second comprehensive control and the taskbar remains unchanged.

In some embodiments, an embodiment of the present application provides a control apparatus for an application in an extended reality space, comprising:

In some embodiments, an embodiment of the present application provides an electronic device, comprising:

In some embodiments, an embodiment of the present application provides a computer-readable storage medium, configured to store a computer program, the computer program causing a computer to perform any of the above methods.

In some embodiments, an embodiment of the present application provides a computer program product, comprising a computer program which, when executed by a processor, performs any of the above methods.

The embodiments of the present application provide a control method, apparatus, device, and medium for an application in an extended reality space, and the method comprises: in response to an opening instruction for an application in an extended reality space, displaying a user interface (UI) of the application and a first comprehensive control of the application, wherein the first comprehensive control is located outside the UI, the first comprehensive control integrates a plurality of interactive functions of the application, and the first comprehensive control is displayed following the UI; and in response to an operation on the first comprehensive control, controlling the application to perform an interactive function corresponding to the operation. By integrating a plurality of interactive functions of an application into a first comprehensive control outside a UI, the UI of the application becomes more concise, and it is also convenient for a user to operate a control of the UI, thereby enhancing the “sense of immersion” brought to the user by an XR device.

The following clearly and completely describes the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are merely a part rather than all of the embodiments of the present invention. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall belong to the scope of protection of the present invention.

It should be noted that terms such as “first” and “second” in the specification, claims, and the accompanying drawings of the present invention are used to distinguish similar objects, but are not necessarily used to describe a specific sequence or order. It should be understood that the data so used may be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in sequences other than those illustrated or described herein. Furthermore, the terms “include”, “comprise” and “have” and any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, a method, a system, a product, or a server that includes a series of steps or units is not necessarily limited to those expressly listed, but may include other steps or units not expressly listed or inherent to such process, method, product or device.

The present application is applicable to a human-machine interaction scenario. In practical use, a user often needs to interact with a virtual space provided by an electronic device. The virtual space may be understood as a virtual scenario, which is a virtual scenario displayed (or provided) when an application runs on an electronic device. The virtual scenario may be a real-world simulation environment, a semi-simulated semi-fictional virtual scenario, or a purely fictional virtual scenario.

How to interact with the virtual space becomes a problem to be solved urgently at present. Therefore, the present application designs a control method for an application in an extended reality space, to solve the problem of interaction between a user and an application in a virtual space by means of the method.

In order to facilitate understanding of the embodiments of the present application, before describing the embodiments of the present application, some concepts involved in all the embodiments of the present application are first explained and illustrated appropriately, specifically as follows:

Alternatively, the Virtual Reality device described in the embodiments of the present application may include, but is not limited to, the following types:

That is, the MR is a simulated scenery in which a computer-created sensory input (for example, a virtual object) is integrated with a sensory input from a physical scenery or a representation thereof. In some MR sceneries, the computer-created sensory input may adapt to a change in the sensory input from the physical scenery. Additionally, some electronic systems for displaying the MR scenery may monitor an orientation and/or location relative to the physical scenery to enable a virtual object to interact with a real object (that is, a physical element or a representation thereof from the physical scenery). For example, the system may monitor motion such that a virtual plant appears stationary relative to a physical building.

After some concepts involved in the embodiments of the present application are introduced, a control method for an application provided in the embodiments of the present application is specifically described below with reference to the accompanying drawings. For the same content, reference is made to the description in the foregoing embodiments, and the description is not repeated.

is a flowchart of a control method for an application in an extended reality space according to Embodiment 1 of the present application. The embodiments of the present application are applicable to a human-machine interaction scenario, and the control method for the application may be performed by a control apparatus for an application. The apparatus may be composed of hardware and/or software and may be integrated into an electronic device. In the embodiments of the present application, the electronic device may be any hardware device capable of providing an extended reality space. For example, the electronic device is an XR device such as a VR device, an AR device, or an MR device, which is not specifically limited in the present application. In consideration that principles implemented by different types of electronic devices are the same, for ease of description, a case in which the electronic device is a VR device is used as an example in the following embodiments for detailed description.

As shown in, the control method for an application in an extended reality space comprises the following steps.

S. In response to an opening instruction for an application in an extended reality space, a UI of the application and a first comprehensive control of the application are displayed, wherein the first comprehensive control is located outside the UI, the first comprehensive control integrates a plurality of interactive functions of the UI, and the first comprehensive control is displayed following the UI.

In the extended reality space, a user opens an application (app), and the user may open the app in various manners. Manner 1: on a home interface of a VR device, a user opens an app by clicking an icon of the app. Manner 2: an app runs in the background, and an icon of the app is displayed in a taskbar for the interface. A user opens the app by clicking the icon of the app in the taskbar.