Task Processing

This application claims the benefit of Chinese Patent Application No. 202411596932.7 filed on Nov. 8, 2024, entitled “METHOD, APPARATUS, DEVICE, STORAGE MEDIUM AND PROGRAM PRODUCT FOR TASK PROCESSING”, which is hereby incorporated by reference in its entirety.

Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to task processing.

With the development of information technologies, various terminal devices may provide various services to people in terms of work and life. For example, an application providing a service may be deployed in the terminal device. The terminal device or the application may provide a task processing function to a user, to assist the user in using the terminal device or the application.

In a first aspect of the present disclosure, a method for task processing is provided. The method is implemented at a client device, and includes: receiving, from a server device, a task execution instruction for execution corresponding to a task request in response to sending the task request to the server device; receiving prediction information for the task request from the server device, the prediction information indicating at least one predicted execution result of the task execution instruction and a predicted response respectively corresponding to the at least one predicted execution result; and providing, in response to a completion of executing the task execution instruction, a response to the task request based on a match between a target execution result of the task execution instruction and the at least one predicted execution result.

In a second aspect of the present disclosure, a method for task processing is provided. The method is implemented at a server device, and includes: determining, in response to receiving a task request from a client device, a task execution instruction corresponding to the task request based on the task request; determining prediction information for the task request based on the task execution instruction; and sending the prediction information to the client device.

In a third aspect of the present disclosure, an apparatus for task processing is provided. The apparatus is implemented at a client device, and includes: a task request sending module configured to receive, from a server device, a task execution instruction for execution corresponding to a task request in response to sending the task request to the server device; a prediction information receiving module configured to receive prediction information for the task request from the server device, the prediction information indicating at least one predicted execution result of the task execution instruction and a predicted response respectively corresponding to the at least one predicted execution result; and a response providing module configured to provide, in response to a completion of executing the task execution instruction, a response to the task request based on a match between a target execution result of the task execution instruction and the at least one predicted execution result.

In a fourth aspect of the present disclosure, an apparatus for task processing is provided. The apparatus is implemented at a server device, and includes: a task request receiving module, configured to determine, in response to receiving a task request from a client device, a task execution instruction corresponding to the task request based on the task request; a prediction information determining module, configured to determine prediction information for the task request based on the task execution instruction; and a prediction information sending module, configured to send the prediction information to the client device.

In a fifth aspect of the present disclosure, an electronic device is provided. The electronic device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions executable by the at least one processor. The instructions, when executed by the at least one processor, cause the electronic device to perform the method of the first aspect and/or the second aspect.

In a sixth aspect of the present disclosure, a computer-readable storage medium is provided. The medium stores a computer program. The computer program, when executed by a processor, causes the method of the first aspect and/or the second aspect to be performed.

In a seventh aspect of the present disclosure, a computer program product is provided. The product includes a computer program. The computer program, when executed by a processor, causes the method of the first aspect and/or the second aspect of the present disclosure to be performed.

It should be understood that the content described in this content section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood from the following description.

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure may be implemented in various forms, and should not be construed as limited to the embodiments set forth herein, but rather, these embodiments are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for example only and are not intended to limit the scope of the present disclosure.

In the description of the embodiments of the present disclosure, the terms “including” and the like should be understood to include “including but not limited to”. The term “based on” should be understood as “based at least in part on”. The terms “one embodiment” or “the embodiment” should be understood as “at least one embodiment”. The term “some embodiments” should be understood as “at least some embodiments”. Other explicit and implicit definitions may also be included below.

As used herein, unless explicitly stated, “responding to A” performs one step and does not imply that this step is performed immediately after “A”, but may include one or more intermediate steps.

It may be understood that the data involved in the technical solution (including but not limited to the data itself, the obtaining, using, storing or deleting of the data) should follow the requirements of the corresponding laws and regulations and related regulations.

It can be understood that, before the technical solutions disclosed in the embodiments of the present disclosure are used, the types of personal information related to the present disclosure, the usage scope, the usage scenario and the like should be notified to the user in an appropriate manner according to the relevant laws and regulations, and the authorization of the user is obtained.

For example, in response to receiving an active request from a user, prompt information is sent to the user to explicitly prompt the user that the requested operation will need to obtain and use personal information of the user, so that the user can autonomously select whether to provide personal information to software or hardware executing the operation of the technical solution of the present disclosure according to the prompt information.

As an optional but non-limiting implementation, in response to receiving an active request of the user, a manner of sending prompt information to the user may be, for example, a pop-up window, and prompt information may be presented in a text manner in the pop-up window. In addition, the pop-up window may further carry a selection control for the user to select “agree” or “not agree” to provide personal information to the electronic device.

It may be understood that the foregoing notification and obtaining a user authorization process are merely illustrative, and do not constitute a limitation on implementations of the present disclosure, and other manners of meeting related laws and regulations may also be applied to implementations of the present disclosure.

As used herein, the term “model” may learn an association relationship between respective inputs and outputs from training data such that a corresponding output may be generated for a given input after training is complete. The generation of the model may be based on machine learning techniques. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using a multi-layer processing unit. The neural network model is one example of a deep learning-based model. As used herein, a “model” may also be referred to as a “machine learning model,” a “learning model,” a “machine learning network,” or a “learning network,” which terms are used interchangeably herein.

A “neural network” is a deep learning-based machine learning network. The neural network is capable of processing inputs and providing respective outputs, which typically include an input layer and an output layer and one or more hidden layers between the input layer and the output layer. Neural networks used in deep learning applications typically include many hidden layers, increasing the depth of the network. Each layer of the neural network is connected in sequence such that the output of the previous layer is provided as an input to the next layer, where the input layer receives the input of the neural network, and the output of the output layer serves as the final output of the neural network. Each layer of the neural network includes one or more nodes (also referred to as processing nodes or neurons), each node processing input from the previous layer.

Generally, machine learning may generally include three phases, a training phase, a testing phase, and an application phase (also referred to as an inference phase). At the training stage, a given model may be trained using a large amount of training data, constantly updating the parameter values, until the model is able to obtain consistent inferences from the training data that satisfy the expected objectives. By training, the model may be considered to be able to learn from the training data an association from input to output (also referred to as mapping of input to output). The parameter values of the trained model are determined. In the testing phase, the test input is applied to the trained model to test whether the model can provide the correct output, thereby determining the performance of the model. The testing phase may sometimes be fused in a training phase. In the application or inference stage, the trained model may be used to process the actual model input based on the parameter value obtained by training, to determine a corresponding model output.

1 FIG. 100 100 112 114 110 140 112 110 110 112 110 110 illustrates a schematic diagram of an example environmentin which embodiments of the present disclosure can be implemented. In the example environment, an applicationand a digital assistantare installed in the client device. The usermay interact with the applicationvia the client deviceand/or an attachment device of the client device. In some implementations, the applicationmay be authorized to capture speech via an audio capture device (e.g., a microphone) of the client device, capture images via an image capture device (e.g., a camera) of the client device, and/or the like.

112 114 110 112 114 In some embodiments, the applicationand the digital assistantmay be downloaded, and installed on the client device. In some embodiments, the applicationand the digital assistantmay also be accessed in other manners, such as through a web page.

112 110 112 1 FIG. In some example embodiments of the present disclosure, the applicationmay be any suitable application having a task processing function, which may include, but is not limited to, one or more of the following: a chat application component (also referred to as an instant messaging application component), a browser application component, a planning application component, a document application component, an audio and video conference application component, a mail application component, a task application component, a calendar application component, an objective and key result (OKR) application component, and the like. It may be understood that although a single application service component is shown in, in practice, multiple application service components may be installed on the client device. In some embodiments, the applicationmay include a multifunctional collaboration platform, for example, an office collaboration platform (also referred to as an office suite), which can provide integration of multiple types of business components, so that people can conveniently perform activities such as office and communication. In the multifunctional collaboration platform, people can start different service components according to needs to complete corresponding information processing, sharing, communication and the like.

114 112 1 FIG. In some embodiments, the digital assistantmay be provided by a separate application business component, or may be integrated in some applicationcapable of providing a content entity. An application business component for providing a client interface of a digital assistant may correspond to a single function application business component or a multifunction collaboration platform, such as an office suite or other collaboration platform capable of integrating multiple components. It is to be understood that although a single digital assistant is shown in, a plurality of digital assistants may actually be provided.

114 114 140 140 140 114 140 114 140 114 The digital assistantis a user's intelligent assistant, and has an intelligent dialogue and information processing capability. In some embodiments of the present disclosure, the digital assistantmay be configured to interact with the userto assist the userin using the terminal device or the application. In some embodiments, multiple interaction modes between the userand the digital assistantmay be provided, and flexible switching between the multiple interaction modes may be supported. In the event that a certain interaction mode is triggered, a corresponding interaction area may be presented to facilitate interaction of the userwith the digital assistant. The interaction manners between the userand the digital assistantmay vary under different interaction modes, which may flexibly adapt to interaction requirements in different application scenarios.

100 112 110 150 112 114 150 112 114 150 140 114 140 114 In the environment, in response to the launch of the application, the client devicemay present an interfacefor the applicationand/or the digital assistant. The interfacemay include, for example, an interactive interface of the applicationand the digital assistant. In some embodiments, the interfacemay present an interaction window between the userand the digital assistant. In the interaction window, the usermay interact with the digital assistantby inputting a natural language, an image, an audio file, a video file, a web page file, etc., to instruct the digital assistant to assist in completing various tasks.

114 140 114 140 114 140 140 114 The interaction window between the digital assistantand the usermay include a session window, such as a session window in an instant messaging application or an instant messaging module of a particular application. In the session window, the interaction between the digital assistantand the usermay be presented in the form of a session message. Alternatively, or additionally, the interaction window of the digital assistantand the usermay further include other types of windows, such as a window of a floating-window mode, where the usermay trigger the digital assistantto perform the corresponding operation by inputting an instruction, selecting a shortcut instruction, or the like.

114 140 114 140 114 114 140 114 114 114 In some embodiments, the digital assistantmay support an interaction mode of a session window, also referred to as a session mode. In this interaction mode, a session window of the userand the digital assistantmay be presented, and the usermay interact with the digital assistantthrough the session message in the session window. In the session mode, the digital assistantmay perform a task according to the session message in the session window. In the interaction window, the usermay enter an interaction message, and the digital assistantmay provide a reply message in response to the user input. By selecting the digital assistant, a session window with the digital assistantmay be opened. The session window may include interface elements for information interaction, such as input boxes, message lists, message bubbles, and the like.

110 120 110 120 110 120 112 114 In some embodiments, a communication connection is established between the client deviceand the server device. The communication connection may be established in a wired manner or a wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a universal serial bus (USB) connection, a wireless fidelity (Wi-Fi) connection, and the like, and the embodiments of the present disclosure are not limited in this aspect. In an embodiment of the present disclosure, the client deviceand the server devicemay implement signaling interaction through a communication connection between the client deviceand the server device, so as to supply services of the applicationand/or the digital assistant.

1 FIG. 120 130 112 114 130 130 130 130 As shown in, the server devicemay invoke the machine learning modelto support functionality of the applicationand/or the digital assistantbased on the output of the machine learning model. The machine learning modelmay be based on any suitable model structure including, but not limited to, a Transformer model, a convolutional neural network (CNN), a recurrent neural network (RNN), a deep neural network (DNN), or the like. In some embodiments, the machine learning modelmay be based on a language model (LM). The language model can have question-answering capability by learning from a large corpus of corpora. The machine learning modelmay also be based on other suitable models.

130 120 130 130 The machine learning modelmay be deployed on the server device, or may be deployed on other devices. The machine learning modelmay include one or more machine learning models. It should be noted that, if the machine learning modelincludes a plurality of machine learning models, the plurality of machine learning models may have different uses and functions, which is not limited in the present disclosure.

110 110 The client devicemay be any type of mobile terminal, fixed terminal, or portable terminal, including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio/video player, a digital camera/camcorder, a pointing device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the client devicecan also support any type of interface for a user (such as a “wearable” circuit, etc.).

120 120 The server devicemay be a standalone physical server, a server cluster composed of multiple physical servers, or a distributed system, or may be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server devicemay include, for example, a computing system/server, such as a mainframe, an edge computing node, a computing device in a cloud environment, or the like.

100 It should be understood that the structures and functions of the various elements in the environmentare described for illustrative purposes only and do not imply any limitation to the scope of the present disclosure.

As described above, the terminal device or the application may provide a task processing function to a user, to assist the user in using the terminal device or the application. The terminal device may receive a task request from the user, perform a task corresponding to the task request, and provide a corresponding response to the user based on an execution result of the task. In a human-machine interaction process, a user may be supported to input a task request through speech or text at a client device. The server device and/or the client device may determine the task to be performed by analyzing the task request. Depending on the specific content of the task, the task may be performed at the server device or at the client device. If the task is to be executed at the client, the server device may send a task execution instruction to the client device. The server device may determine a response to the task request based on the execution result of the task, and the response may then be provided to the user by the client device.

In the conventional processing flow, the client device may send the task request input by the user to the server device. The server device may send a task execution instruction to the client device based on the received task request. The client device may execute the task request based on the received task execution instruction, and send the execution result to the server device. In response to the received execution result, the server device may determine a response to the task request based on the execution result, and deliver the response to the client device. The client device may provide the response to the user in response to receiving the response.

It may be found that the link of the conventional task processing mode is long. After executing the task execution instruction, the client device needs to provide the execution result to the server device, and then provides a response to the execution result sent by the server device to the user. Therefore, after executing the task execution instruction, the client device still needs to wait for a period of time (e.g., tens of milliseconds or hundreds of milliseconds) to obtain the response, which affects the efficiency of the user in obtaining the response. In addition, the communication between the client device and the server device usually relies on the network. In the case of poor network conditions, even if the client device has completed executing the task execution instruction, it may still fail to obtain the response from the server device. Thus, the client device may fail to provide the response to the user, leaving the user unaware of the execution status of the task request, and impacting interaction experience of the user.

In view of this, embodiments of the present disclosure provide a solution for task processing. According to the solution of the embodiments of the present disclosure, at the client device side, in response to sending the task request to the server device, a task execution instruction for execution corresponding to the task request is received from the server device. The prediction information for the task request is received from the server device, and the prediction information indicates at least one predicted execution result of the task execution instruction and a predicted response respectively corresponding to the at least one predicted execution result. In response to a completion of executing the task execution instruction, a response to the task request is provided based on a match between a target execution result of the task execution instruction and the at least one predicted execution result.

According to the solution of embodiments of the present disclosure, at the server device side, in response to receiving the task request from the client device, the task execution instruction corresponding to the task request is determined based on the task request. The prediction information for the task request is determined based on the task execution instruction. The prediction information is sent to the client device.

In this way, the server device may determine the prediction information based on the task execution instruction, and send the prediction information to the client device. The prediction information indicates at least one predicted execution result of the task execution instruction and a predicted response respectively corresponding to the at least one predicted execution result. The client device may determine a matching result between the target execution result of the task execution instruction and the at least one predicted execution result, and determine, in response to the at least one predicted execution result including a target predicted execution result that matches the target execution result, a predicted response corresponding to the target predicted execution result as the response to the task request. In this case, the client device does not need to resend the target execution result to the server device. The stability and efficiency of the client device in providing the response may be improved.

Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

2 FIG. 1 FIG. 2 FIG. 200 200 200 110 120 120 201 202 illustrates a flowchart of a signaling flowfor task processing according to some embodiments of the present disclosure. For ease of discussion, the signaling flowwill be described with reference to. As illustrated in, the signaling flowinvolves the client deviceand the server device, where the server deviceincludes a speech serviceand a model service.

201 The speech servicemay provide speech processing services with a trained speech processing model. For example, the speech processing services may include text to speech (TTS) services (also referred to as text-to-speech services) and automatic speech recognition (ASR) services (also referred to as speech-to-text services). Accordingly, the speech processing model may include a machine learning model for performing TTS (simply referred to as the TTS model) and a machine learning model for performing ASR (simply referred to as the ASR model). The input to the ASR model is speech and the output is text. The input of the TTS model is text, and the output is the corresponding speech.

202 202 202 201 202 The model servicemay provide task processing services, response services, etc., by using a trained machine learning model. It will be appreciated that, depending on the specific service, the model servicemay utilize different models to provide corresponding services. As an example, the model servicemay provide a question and answer service by using a question-answering model, where an input of the question and answer model is a question text, and an output is the corresponding response text. It may be understood that the machine learning model used by the speech serviceand the model servicemay be based on any suitable model structure, including but not limited to a Transformer model, a convolutional neural network (CNN), a recurrent neural network (RNN), a deep neural network (DNN), or the like. In some embodiments, the machine learning model may also be based on a language model (LM).

110 130 110 110 110 112 114 110 In some embodiments, the client devicemay receive a task request from a user (e.g., the user) in any suitable manner. For example, the client devicemay receive a task request input by the user via a microphone, an input box, or the like. In some embodiments, the task request may include a user question directed to the digital assistant. The client devicereceives the user question during the interaction between the user and the digital assistant. For example, the client devicemay receive the user question through an interaction interface of the applicationand/or the digital assistant, and in response to determining that the user question indicates a task, determine the user question as a task request. As an example, the task request may be presented in the interaction interface in the form of a session message from the user. It may be understood that during the interaction between the user and the digital assistant, the client devicemay receive a plurality of task requests, which may correspond to a plurality of tasks.

110 120 110 211 201 120 201 212 202 110 213 202 120 The client devicemay send the received task request to the server device. It may be understood that the task request may be of any suitable type, such as a text type, a speech type, etc. In some embodiments, if the task request is a speech-type request (which may be referred to as a task request speech), the client devicemay send () the task request speech to the speech servicein the server device. The speech servicemay determine, by utilizing an ASR model, a task request text corresponding to the task request speech, and send () the task request text to the model service. It may be understood that, if the task request is directly a text-type request (which may be referred to as a task request text), the client devicemay directly send () the task request text to the model servicein the server device.

120 214 120 202 202 The server devicemay determine (), in response to receiving the task request from the client device, a task execution instruction corresponding to the task request based on the task request. It may be understood that the server devicemay determine the task execution instruction in any suitable manner. In some embodiments, if the model servicereceives the task request, the model servicemay determine the task execution instruction corresponding to the task request by utilizing the trained machine learning model.

120 215 110 110 217 120 110 110 The server devicemay send () the determined task execution instruction to the client device. The client devicemay receive the task execution instruction and determine a task execution result for the task request by executing () the task execution instruction. For example, if the task request is “enabling Bluetooth”, the server devicemay send, to the client device, an instruction indicating to turn on Bluetooth based on the task request. The client devicemay turn on its Bluetooth by executing the instruction.

120 216 110 120 120 120 120 In some embodiments, the server devicemay further determine () prediction information for the task request based on the task execution instruction. Regarding the timing for determining the prediction information, to prevent the scenario where the client devicehas completed the execution of the task execution instruction and sent the execution result for the task execution instruction to the server devicewhen the server devicedetermines the prediction information, the server devicemay determine the prediction information without having received the execution result of the task execution instruction. In this case, if the server devicehas received the execution result, it may no longer continue to determine the prediction information, and directly determine a response to the execution result.

120 120 120 110 120 In some embodiments, the server devicemay further determine a type of the task execution instruction or the task request, and in response to the type being a predetermined type, determine the prediction information based on the task execution instruction. For example, the server devicemay obtain a set of predetermined types, which may be set by the user or determined by the server deviceor the client device. For example, the server devicemay determine the prediction information in response to the task execution instruction being of the predetermined type, and not determine the prediction information in response to the task execution instruction not being of the predetermined type.

120 120 120 120 Regarding the manner of determining the prediction information, the server devicemay determine, for example, at least one predicted execution result corresponding to the task execution instruction based at least on the task execution instruction. The server devicemay further determine, by using the trained language model, a predicted response respectively corresponding to the at least one predicted execution result. The server devicemay then determine the prediction information based at least on the at least one predicted execution result and the predicted response respectively corresponding to the at least one predicted execution result. For example, the server devicemay determine at least one prediction result identification (for example, may be referred to as a prediction code) corresponding to the at least one predicted execution result. The prediction result identification may be any suitable identification such as a code, a number, a text, an image, or the like.

120 120 120 The server devicemay determine the prediction result identification in any suitable manner. For example, the server devicemay obtain a correspondence table between the result identification and the execution result, and determine the prediction result identification corresponding to each predicted execution result by searching the table. The server devicemay then determine the prediction information based on the at least one predicted execution result, the at least one prediction result identification, and the predicted response respectively corresponding to the at least one predicted execution result.

120 120 The server devicemay determine the at least one predicted execution result in any suitable manner. In some embodiments, if the task request corresponds to a target user (that is, the task request is from the target user), the server devicemay determine the at least one predicted execution result based on the task execution instruction and the historical interaction information associated with the target user., For example, the historical interaction information may indicate user attribute information of the target user, historical task requests of the target user, historical execution results and historical responses to the historical task requests, and the like.

202 120 202 202 202 In some embodiments, the model servicein the server devicemay determine the at least one predicted execution result with a trained prediction model. For example, the model servicemay determine a prompt input for the prediction model based at least on the task execution instruction and historical interaction information associated with the target user. For example, the model servicemay obtain a prompt template, and determine the prompt input by filling the task execution instruction and the historical interaction information into the prompt template. The model servicemay determine the at least one predicted execution result based on the task execution instruction and the historical interaction information by providing the prompt input to the prediction model.

202 202 202 The model servicemay determine the predicted response for each predicted execution result with a trained language model. For example, the model servicemay construct a prompt input for the language model based on the predicted execution result. The prompt input may guide the language model to determine the response to the predicted execution result, i.e., the predicted response to the predicted execution result. The model servicemay then determine the prediction information based on the at least one predicted execution result and the predicted response respectively corresponding to the at least one predicted execution result.

110 202 110 110 120 202 219 201 201 In some embodiments, the predicted response may default to a response of the text type (which may be referred to as a response text). If the client devicemay present the response text to the target user, the model servicemay directly send the prediction information to the client device. In some embodiments, if the client devicemay present a response of the audio or speech type (which may be referred to as response audio) to the target user, the server devicemay convert the predicted response of the text type to the audio type. As an example, the model servicemay send () prediction information to the speech service, to indicate the speech serviceto convert the predicted response to the audio type.

201 220 201 120 221 110 After receiving the prediction information, the speech servicemay determine () the corresponding response audio based on the response text in the prediction information. For example, the speech servicemay convert the response text in the prediction information to the response audio with a TTS model. The server devicemay then send () the prediction information including the response audio to the client device.

120 120 110 120 120 In some embodiments, the server devicemay further obtain a predetermined condition, which may indicate a predetermined number for the predicted execution result. If the at least one predicted execution result includes a plurality of predicted execution results, and the number of predicted execution results included in the plurality of predicted execution results exceeds the predetermined number, the server devicemay determine, from the plurality of predicted execution results, a predetermined number of predicted execution results that best matches the target user based on the historical interaction information associated with the target user. For example, if the task execution instruction indicates enabling Bluetooth on the client device, the predicted execution result for this task execution instruction may include two predicted execution results, including successful Bluetooth enabling and failed Bluetooth enabling. If the historical interaction information suggests that the Bluetooth is typically enabled successfully and the predetermined number is 1, the server devicemay determine, from the two predicted execution results, “successful Bluetooth enabling” as the single predicted execution results that best matches the target user. The server devicemay then only determine a set of predicted responses corresponding to this set of predicted execution results, and determine the predicted information based on this set of predicted execution results and this set of predicted responses.

120 218 110 110 120 110 120 110 218 219 218 220 221 218 216 222 2 FIG. In some embodiments, before sending the prediction information, the server devicemay further send (), to the client device, a prediction indication for provision of the prediction information in response to determining the prediction information. After receiving the prediction indication, the client devicemay know, based on the prediction indication, that the server deviceis about to send the prediction information to the client device. The server devicemay send the prediction information to the client deviceafter sending the prediction indication. It may be understood that although stepis before stepin, in practice, stepmay occur after stepand before step, or stepmay occur after stepand before step.

110 120 110 120 110 120 The client devicemay receive the prediction information for the task request from the server device. The prediction information may indicate at least one predicted execution result of the task execution instruction and the predicted response respectively corresponding to the at least one predicted execution result. In some embodiments, the client devicemay receive the prediction information from the server devicebefore the completion of executing the task execution instruction. That is, if the execution of the task execution instruction has been completed, the client devicemay select not to receive the prediction information even if the server devicesends the prediction information to it at that time.

110 120 120 110 110 120 110 110 Alternatively, or additionally, in some embodiments, the client devicemay receive the prediction information from the server devicewithin a preset time period after the completion of executing the task execution instruction. As an example, the preset time period is 1s, in the case that the execution of the task execution instruction has been completed, if the server devicesends the prediction information to the client devicewithin 1s, the client devicemay receive the prediction information. If the server devicesends the prediction information to the client deviceafter 1s (e.g., the 2s after completion of the execution), the client devicemay reject receiving the prediction information.

110 222 110 110 110 After the completion of executing the task execution instruction, the client devicemay determine () a matching result between a target execution result of the task execution instruction and the at least one predicted execution result. It will be appreciated that if the client devicereceives the prediction information before the completion of executing the task execution instruction, the client devicemay cache the prediction information for subsequent determination of the response based on the prediction information. For example, the client devicemay compare the target execution result with the at least one predicted execution result in the prediction information, and in response to determining a certain predicted execution result that matches the target execution result from the at least one predicted execution result, determine this predicted execution result as the target predicted execution result that matches the target execution result.

110 110 110 In some embodiments, if the prediction information further indicates respective prediction result identifications corresponding to each predicted execution result, the client devicemay also compare a result identification (also referred to as a result code, which may include any suitable identification such as a code, a number, a text, an image, etc.) corresponding to the target execution result with the prediction result identification included in the prediction information, and search, from the prediction result identification included in the prediction information, a prediction result identification that is the same as the result identification. The client devicemay determine the prediction result identification as the target prediction result identification that matches the result identification. The client devicemay then determine the predicted execution result corresponding to the target prediction result identification as the target predicted execution result that matches the target execution result.

110 In response to determining the target predicted execution result from the at least one predicted execution result (that is, the at least one predicted execution result includes a predicted execution result that matches the target execution result, or the at least one prediction result identification corresponding to the at least one predicted execution result includes a prediction result identification that is the same as the result identification corresponding to the target execution result), the client devicemay then determine the predicted response corresponding to the target predicted execution result as the response to the task request.

110 223 110 110 The client devicemay provide () the response to the target user. For example, if the prediction information includes the response text, the client devicemay present the response text via the screen. If the prediction information includes response audio, the client devicemay play the response audio via a speaker.

110 224 120 120 120 120 225 In some embodiments, the client devicemay also receive feedback to the provided response (i.e., the predicted response corresponding to the target predicted execution result), and send () the feedback to the server device. The feedback may indicate, for example, a satisfaction degree, a preference degree, and the like of the target user for the response or prediction information. The server devicemay adjust, in response to receiving the feedback to the prediction information, the determination of the prediction information of a subsequent task request based on the feedback. For example, if the server devicedetermines at least one predicted execution result with a prediction model, and determines a predicted response for each predicted execution result with a language model, the server devicemay fine-tune () the prediction model and/or the language model based on the feedback. Therefore, the accuracy of the determination of the subsequent prediction information may be improved, making the user more satisfied with the prediction information determined subsequently.

110 226 120 120 110 110 In some embodiments, the client devicemay further send () the target execution result to the server devicein response to determining that the target execution result matches none of the at least one predicted execution result (that is, the at least one predicted execution result does not include a predicted execution result that matches the target execution result, or the at least one prediction result identification does not include a prediction result identification that is the same as the result identification), or in response to not receiving the prediction information (including both the case where the server devicedoes not send the prediction information and the case where the client devicedoes not receive the prediction information, it may be understood that the client devicedoes not receive the prediction information after the completion of executing the task execution instruction or after the preset time period after the completion of executing the task execution instruction).

120 227 110 120 202 120 120 110 The server devicemay determine () a target response for the target execution result based on the execution result in response to receiving the execution result from the client device. The server devicemay determine the response in any suitable manner. For example, the model servicein the server devicemay determine the target response based on the target execution result with the trained machine learning model. The server devicemay send the target response to the client devicein response to determining the target response.

202 110 201 201 201 229 201 120 230 110 110 231 Similarly, after determining the target response with the language model, the model servicemay directly send the target response of the text type to the client device, or may send the target response to the speech serviceto indicate the speech serviceto convert the target response to the audio type. The speech servicemay determine () the corresponding response audio based on the target response of the text type in response to receiving the target response. For example, the speech servicemay convert the target response to the response audio with a TTS model. The server devicemay then send () the response audio corresponding to the target response to the client device. The client devicemay provide () the target response to the target user.

In summary, according to embodiments of the present disclosure, the server device may determine the prediction information based on the task execution instruction, and send the prediction information to the client device. The prediction information may indicate at least one predicted execution result of the task execution instruction and the predicted response respectively corresponding to the at least one predicted execution result. The client device may determine a matching result between the target execution result of the task execution instruction and the at least one predicted execution result, and determine, in response to the at least one predicted execution result including a target predicted execution result that matches the target execution result, a predicted response corresponding to the target predicted execution result as the response to the task request. In this case, the client device does not need to resend the target execution result to the server device. The stability and efficiency of the client device in providing the response may be improved.

3 FIG. 1 FIG. 300 300 110 300 illustrates a flowchart of a task processing methodaccording to some embodiments of the present disclosure. The methodmay be implemented at the client device. The methodwill be described below with reference to.

310 110 120 120 At block, the client devicereceives, from a server device, a task execution instruction for execution corresponding to a task request in response to sending the task request to the server device.

320 110 120 At block, the client devicereceives prediction information for the task request from the server device, the prediction information indicating at least one predicted execution result of the task execution instruction and a predicted response respectively corresponding to the at least one predicted execution result.

330 110 At block, the client deviceprovides, in response to a completion of executing the task execution instruction, a response to the task request based on a match between a target execution result of the task execution instruction and the at least one predicted execution result.

120 In some embodiments, receiving the prediction information for the task request from the server deviceincludes: receiving the prediction information from the server device before the completion of executing the task execution instruction; or receiving the prediction information from the server device within a preset time period after the completion of executing the task execution instruction.

120 120 120 In some embodiments, receiving the prediction information for the task request from the server deviceincludes: receiving a prediction indication for provision of the prediction information from the server device; and receiving the prediction information from the server device.

In some embodiments, providing the response to the task request based on the match between the target execution result of the task execution instruction and the at least one predicted execution result includes: comparing the target execution result with the at least one predicted execution result; and providing a target predicted response corresponding to a target predicted execution result in response to determining the target predicted execution result that matches the target execution result from the at least one predicted execution result.

In some embodiments, the prediction information further indicates at least one prediction result identification corresponding to the at least one predicted execution result, and comparing the target execution result with the at least one predicted execution result includes: comparing a result identification corresponding to the target execution result with the at least one prediction result identification; and determining that the target predicted execution result corresponding to a target prediction result identification matches the target execution result in response to determining the target prediction result identification that matches the result identification from the at least one prediction result identification.

300 120 120 In some embodiments, the methodfurther includes: sending the target execution result to the server devicein response to determining that the target execution result matches none of the at least one predicted execution result, or in response to not receiving the prediction information; receiving a target response for the target execution result from the server device; and providing the target response for the target execution result.

300 120 In some embodiments, the methodfurther includes: receiving feedback to the provided response; and sending the feedback to the server device.

4 FIG. 1 FIG. 400 400 120 400 illustrates a flowchart of a task processing methodaccording to some embodiments of the present disclosure. The methodmay be implemented at the server device. The methodwill be described below with reference to.

410 120 110 At block, the server devicedetermines, in response to receiving a task request from a client device, a task execution instruction corresponding to the task request based on the task request.

420 120 At block, the server devicedetermines prediction information for the task request based on the task execution instruction.

430 120 110 At block, the server devicesends the prediction information to the client device.

In some embodiments, determining the prediction information for the task request based on the task execution instruction includes: determining the prediction information in response to not receiving an execution result of the task execution instruction.

In some embodiments, determining the prediction information for the task request based on the task execution instruction includes: determining the prediction information based on the task execution instruction in response to the task execution instruction being of a predetermined type.

In some embodiments, determining the prediction information for the task request based on the task execution instruction includes: determining at least one predicted execution result corresponding to the task execution instruction based at least on the task execution instruction; determining, with a trained language model, a predicted response respectively corresponding to the at least one predicted execution result; and determining the prediction information based at least on the at least one predicted execution result and the predicted response respectively corresponding to the at least one predicted execution result.

In some embodiments, determining the prediction information based at least on the at least one predicted execution result and the predicted response respectively corresponding to the at least one predicted execution result includes: determining at least one prediction result identification corresponding to the at least one predicted execution result; and determining the prediction information based on the at least one predicted execution result, the at least one prediction result identification, and the predicted response respectively corresponding to the at least one predicted execution result.

In some embodiments, the task request corresponds to a target user, and determining the at least one predicted execution result corresponding to the task execution instruction includes: determining the at least one predicted execution result based on the task execution instruction and historical interaction information associated with the target user.

110 110 110 In some embodiments, sending the prediction information to the client deviceincludes: sending, to the client device, a prediction indication for provision of the prediction information in response to determining the prediction information; and sending the prediction information to the client device.

400 110 110 In some embodiments, the methodfurther includes: determining a target response for an execution result based on the execution result in response to receiving the execution result from the client device; and sending the target response to the client device.

400 In some embodiments, the methodfurther includes: adjusting a determination of the prediction information of a subsequent task request based on feedback to the prediction information in response to receiving the feedback from the client device.

Embodiments of the present disclosure further provide a corresponding apparatus for implementing the above method or process.

5 FIG. 500 500 110 500 illustrates an example block diagram of an apparatusfor task processing according to some embodiments of the present disclosure. The apparatusmay be implemented or included in the client device. The various modules/components in the apparatusmay be implemented by hardware, software, firmware, or any combination thereof.

5 FIG. 500 510 520 530 510 520 530 As shown in, the apparatusincludes a task request sending module, a prediction information receiving module, and a response providing module. The task request sending moduleis configured to receive, from a server device, a task execution instruction for execution corresponding to a task request in response to sending the task request to the server device. The prediction information receiving moduleis configured to receive prediction information for the task request from the server device, the prediction information indicating at least one predicted execution result of the task execution instruction and a predicted response respectively corresponding to the at least one predicted execution result. The response providing moduleis configured to provide, in response to a completion of executing the task execution instruction, a response to the task request based on a match between a target execution result of the task execution instruction and the at least one predicted execution result.

520 In some embodiments, the prediction information receiving moduleis further configured to: receive the prediction information from the server device before the completion of executing the task execution instruction; or receive the prediction information from the server device within a preset time period after the completion of executing the task execution instruction.

520 120 120 In some embodiments, the prediction information receiving moduleis further configured to: receive, from the server device, a prediction indication for provision of the prediction information; and receive the prediction information from the server device.

530 In some embodiments, the response providing moduleis further configured to: compare the target execution result with the at least one predicted execution result; and provide a target predicted response corresponding to a target predicted execution result in response to determining the target predicted execution result that matches the target execution result from the at least one predicted execution result.

530 In some embodiments, the prediction information further indicates at least one prediction result identification corresponding to the at least one predicted execution result, and the response providing moduleis further configured to: compare a result identification corresponding to the target execution result with the at least one prediction result identification; and determine that the target predicted execution result corresponding to a target prediction result identification matches the target execution result in response to determining the target prediction result identification that matches the result identification from the at least one prediction result identification.

500 120 120 In some embodiments, the apparatusfurther includes: an execution result sending module, configured to send the target execution result to the server devicein response to determining that the target execution result matches none of the at least one predicted execution result, or in response to not receiving the prediction information; receive a target response for the target execution result from the server device; and provide the target response for the target execution result.

500 120 In some embodiments, the apparatusfurther includes: a feedback receiving module, configured to receive feedback to the provided response; and a feedback sending module, configured to send the feedback to the server device.

6 FIG. 600 600 120 600 illustrates an example block diagram of an apparatusfor task processing according to some embodiments of the present disclosure. The apparatusmay be implemented or included in the server device. The various modules/components in the apparatusmay be implemented by hardware, software, firmware, or any combination thereof.

6 FIG. 600 610 620 630 610 620 As shown in, the apparatusincludes a task request receiving module, a prediction information determining module, and a prediction information sending module. The task request receiving moduleis configured to determine, in response to receiving a task request from a client device, a task execution instruction corresponding to the task request based on the task request. The prediction information determining moduleis configured to determine prediction information for the task request based on the task execution instruction. The prediction information sending module is configured to send the prediction information to the client device.

620 In some embodiments, the prediction information determining moduleis further configured to: determine the prediction information in response to not receiving an execution result of the task execution instruction.

620 In some embodiments, the prediction information determining moduleis further configured to: determine the prediction information based on the task execution instruction in response to the task execution instruction being of a predetermined type.

620 In some embodiments, the prediction information determining moduleis further configured to: determine at least one predicted execution result corresponding to the task execution instruction based at least on the task execution instruction; determine, with a trained language model, a predicted response respectively corresponding to the at least one predicted execution result; and determine the prediction information based at least on the at least one predicted execution result and the predicted response respectively corresponding to the at least one predicted execution result.

620 In some embodiments, the prediction information determining moduleis further configured to: determine at least one prediction result identification corresponding to the at least one predicted execution result; and determine the prediction information based on the at least one predicted execution result, the at least one prediction result identification, and the predicted response respectively corresponding to the at least one predicted execution result.

620 In some embodiments, the task request corresponds to the target user, and the prediction information determining moduleis further configured to determine the at least one predicted execution result based on the task execution instruction and historical interaction information associated with the target user.

630 110 110 In some embodiments, the prediction information sending moduleis further configured to: send a prediction indication for provision of the prediction information to the client devicein response to determining the prediction information; and send the prediction information to the client device.

600 110 110 In some embodiments, the apparatusfurther includes: a target response determining module, configured to determine a target response for an execution result based on the execution result in response to receiving the execution result from the client device; and a target response sending module, configured to send the target response to the client device.

600 In some embodiments, the apparatusfurther includes: an adjustment module, configured to adjust a determination of the prediction information of a subsequent task request based on feedback to the prediction information in response to receiving the feedback from the client device.

500 600 500 600 The modules included in the apparatusand/or the apparatusmay be implemented in various manners, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more modules may be implemented using software and/or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the modules in apparatusand/or apparatusmay be implemented, at least in part, by one or more hardware logic components. By way of example and not limitation, example types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standards (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), and the like.

110 120 1 FIG. It should be understood that one or more of the above methods may be performed by a suitable electronic device or a combination of electronic devices. Such electronic devices or combinations of electronic devices may include, for example, client deviceand/or server devicein.

7 FIG. 7 FIG. 7 FIG. 1 FIG. 700 700 700 110 120 illustrates a block diagram of an electronic devicein which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic deviceillustrated inis merely illustrative and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic deviceshown inmay be configured to implement the client deviceand/or the server devicein.

7 FIG. 700 700 710 720 730 740 750 760 710 720 700 As shown in, the electronic deviceis in the form of a general-purpose electronic device. Components of the electronic devicemay include, but are not limited to, one or more processors or processors, a memory, a storage device, one or more communication units, one or more input devices, and one or more output devices. The processormay be an actual or virtual processor and capable of performing various processes according to programs stored in the memory. In multiprocessor systems, multiple processors execute computer-executable instructions in parallel to improve parallel processing capabilities of electronic device.

700 700 720 730 700 Electronic devicetypically includes a plurality of computer storage media. Such media may be any available media accessible to the electronic device, including, but not limited to, volatile and non-volatile media, removable and non-removable media. The memorymay be volatile memory (e.g., registers, caches, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage devicemay be a removable or non-removable medium and may include a machine-readable medium, such as a flash drive, magnetic disk, or any other medium, which may be capable of storing information and/or data and may be accessed within electronic device.

700 720 725 7 FIG. The electronic devicemay further include additional removable/non-removable, volatile/non-volatile storage media. Although not shown in, a disk drive for reading or writing from a removable, nonvolatile magnetic disk (e.g., a “floppy disk”) and an optical disk drive for reading or writing from a removable, nonvolatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memorymay include a computer program producthaving one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

740 700 700 The communication unitis configured to communicate with another electronic device through a communication medium. Additionally, the functionality of components of the electronic devicemay be implemented in a single computing cluster or multiple computing machines capable of communicating over a communication connection. Thus, the electronic devicemay operate in a networked environment using logical connections with one or more other servers, network personal computers (PCs), or another network node.

750 760 700 740 700 700 The input devicemay be one or more input devices, such as a mouse, a keyboard, a trackball, or the like. The output devicemay be one or more output devices, such as a display, a speaker, a printer, or the like. The electronic devicemay also communicate with one or more external devices (not shown) through the communication unitas needed, external devices such as storage devices, display devices, etc., communicate with one or more devices that enable a user to interact with the electronic device, or communicate with any device (e.g., a network card, a modem, etc.) that enables the electronic deviceto communicate with one or more other electronic devices. Such communication may be performed via an input/output (I/O) interface (not shown).

According to example implementations of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to example implementations of the present disclosure, a computer program product is further provided, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, the computer-executable instructions being executed by a processor to implement the method described above.

Aspects of the present disclosure are described herein with reference to flowcharts and/or block diagrams of methods, apparatuses, devices, and computer program products implemented in accordance with the present disclosure. It should be understood that each block of the flowchart and/or block diagram, and combinations of blocks in the flowcharts and/or block diagrams, may be implemented by computer readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, when executed by a processor of a computer or other programmable data processing apparatus, produce means to implement the functions/acts specified in the flowchart and/or block diagram. These computer-readable program instructions may also be stored in a computer-readable storage medium that cause the computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing instructions includes an article of manufacture including instructions to implement aspects of the functions/acts specified in the flowchart and/or block diagram(s).

The computer-readable program instructions may be loaded onto a computer, other programmable data processing apparatus, or other apparatus, such that a series of operational steps are performed on a computer, other programmable data processing apparatus, or other apparatus to produce a computer-implemented process such that the instructions executed on a computer, other programmable data processing apparatus, or other apparatus implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures show architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of an instruction that includes one or more executable instructions for implementing the specified logical function. In some implementations as an update, the functions noted in the blocks may also occur in a different order than that shown in the figures. For example, two consecutive blocks may actually be performed substantially in parallel, which may sometimes be performed in the reverse order, depending on the functionality involved. It is also noted that each block in the block diagrams and/or flowchart, as well as combinations of blocks in the block diagrams and/or flowchart, may be implemented with a dedicated hardware-based system that performs the specified functions or actions, or may be implemented in a combination of dedicated hardware and computer instructions.

Various implementations of the present disclosure have been described above, which are illustrative, not exhaustive, and are not limited to the implementations disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various implementations illustrated. The selection of the terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to techniques in the marketplace, or to enable others of ordinary skill in the art to understand the various implementations disclosed herein.