Electronic Device and Method for Wireless Communication, and Computer-Readable Storage Medium

The present application claims priority to Chinese Patent Application No.202211488978.8, titled “ELECTRONIC DEVICE AND METHOD FOR WIRELESS COMMUNICATION, AND COMPUTER-READABLE STORAGE MEDIUM”, filed on Nov. 25, 2022 with the China National Intellectual Property Administration, which is incorporated herein by reference in its entirety.

The present disclosure relates to the technical field of wireless communications, specifically to updating of a global model based on Federated Reinforcement Learning. More specifically, the present disclosure relates to an electronic apparatus and a method for wireless communications, and a computer-readable storage medium.

As machine learning develops, it becomes more capable of solving complex problems such as image processing, language recognition and semantic understanding.

1 FIG. From a technical perspective, Federated Learning (FL) is a distributed federated learning solution, in which respective local models trained by multiple users are utilized to jointly build a shared model while maintaining privacy of user data.shows an example of a model of FL. Participants perform training based on their own dataset to obtain local models, such as local models A to C, and submit the local models to a coordinator. The coordinator aggregates the local models to obtain a global model. The coordinator further provides the updated global model to the participants.

Reinforcement Learning (RL) is a branch of machine learning that focuses on how individual users interact with an environment and maximizes a cumulative reward. The process of reinforcement learning allows the individuals to learn through fault-tolerant attempts and improve their behaviors. The individuals participating in the RF take actions to explore the environment and expect to be rewarded accordingly, through a series of strategies.

2 FIG. t t t+1 t+1 shows an example of a model of reinforcement learning. An agent which is an individual user takes an action Abased on the environment at state Sand obtains a reward Rat the next state S. For reinforcement learning, an important problem is to avoid leakage of user information, so as to protect privacy of the user to the greatest extent. This is because raw data transmission between an individual and a central processor has great security risks.

In this case, federated learning is advantageous, because it can not only implement information interaction without leaking user privacy information, but also help users adapt to different environments. Another problem about reinforcement learning is that multiple algorithms require pre-training models in a simulation environment, but the simulation environment cannot fully reflect and replicate a real environment. Federated learning can bring together a simulation environment and a real environment and thereby build a bridge between the simulation environment and the real environment.

In view of the above, the concept of Federated Reinforcement Learning (FRL) is proposed. In other words, the FRL may be regarded as a combination of federated learning and reinforcement learning under data privacy protection. Some of parameters of reinforcement learning may be presented in federated learning and used to handle continuous decision-making tasks.

A brief summary of the present disclosure is given below to provide basic understanding on some aspects of the present disclosure. It should be understood that the summary is not an exhaustive summary of the present disclosure. It is not intended to identify the key or important parts of the present disclosure, nor is it intended to limit the scope of the present disclosure. Its purpose is merely to present concepts in a simplified form, which serves as a preamble of a more detailed description to be discussed later.

In an aspect according to the present disclosure, an electronic apparatus for wireless communications is provided, including processing circuitry. The processing circuitry is configured to: determine, at least based on a wireless communication environment and processing capabilities of wireless communication terminals within a coverage range of a wireless transceiving node, wireless communication terminals which are to participate in Federated Reinforcement Learning (FRL); and acquire, from the wireless communication terminals participating in the FRL, respective local learning models, and obtain an updated global model based on the local learning models.

In another aspect according to the present disclosure, a method for wireless communications is provided. The method includes: determining, at least based on a wireless communication environment and processing capabilities of wireless communication terminals within a coverage range of a wireless transceiving node, wireless communication terminals which are to participate in Federated Reinforcement Learning (FRL); and acquiring, from the wireless communication terminals participating in the FRL, respective local learning models, and obtaining an updated global model based on the local learning models.

In an aspect according to the present disclosure, an electronic apparatus for wireless communications is provided, including processing circuitry. The processing circuitry is configured to: in response to confirmation information from a wireless transceiving node, perform training of a local learning model at a wireless communication terminal, wherein the confirmation information indicates that the wireless transceiving node determines, based on a wireless communication environment and a processing capability of the wireless communication terminal, that the wireless communication terminal is to participate in FRL; and upload the local learning models to the wireless transceiving node and acquire an updated global model from the wireless transceiving node.

In another aspect according to the present disclosure, a method for wireless communications is provided. The method includes: in response to confirmation information from a wireless transceiving node, performing training of a local learning model at a wireless communication terminal, wherein the confirmation information indicates that the wireless transceiving node determines, based on a wireless communication environment and a processing capability of the wireless communication terminal, that the wireless communication terminal is to participate in FRL; and uploading the local learning model to the wireless transceiving node and acquiring an updated global model from the wireless transceiving node.

In another embodiment according to the present disclosure, computer program codes and a computer program product for implementing the above methods for wireless communications are further provided, and a computer-readable storage medium recording the computer program codes for implementing the methods for wireless communications is provided.

With the electronic apparatus and method according to the embodiments of the present disclosure, the wireless communication terminal to participate in the FRL is selectively determined, so that a probability of congestion in data transmission is reduced, a transmission latency is reduced, and performance of learning is ensured.

These and other advantages of the present disclosure will be more apparent from the following detailed description of preferred embodiments of the present disclosure in conjunction with the accompanying drawings.

An exemplary embodiment of the present disclosure will be described hereinafter in conjunction with the accompanying drawings. For the sake of clarity and conciseness, not all the features of practical implementations are described in the specification. However, it should be understood that during a process of developing any such embodiment, many decisions specific to the embodiments have to be made, to achieve a specific target of a developer, for example, conforming to limitation conditions related to a system and a service. The limitation conditions may change for different embodiments. Furthermore, it should further be understood that although the development work may be very complicated and time-consuming, for those skilled in the art benefiting from the present disclosure, such development work is only a routine task.

Herein, it should be further noted that in order to avoid obscuring the present disclosure due to unnecessary details, only apparatus structures and/or processing steps closely related to the solutions according to the present disclosure are illustrated in the drawings, and other details less related to the present disclosure are omitted.

As mentioned above, FRL may be used to perform training of a global model in a network environment. In this case, users of FRL need to exchange a large number of model parameters, intermediate results and the like with other users and/or network-side servers, consuming quantities of communication resources and electric power. Therefore, communication resource overhead and battery capacity limitation of user-side apparatuses need to be considered. For example, model upload and download strategies need to be coordinated to maximize an iteration efficiency of model update. Specifically, for example, the number of model interactions may be optimized by using a model dynamic update mechanism. The volume of interaction data may be reduced by using a model compression algorithm, and the model aggregation algorithm may be optimized to allow a user participating in the FRL to upload only important parameters of a local learning model and the like.

In this embodiment, a technical solution is provided, in which the iteration efficiency of model update is improved by optimizing selection of users participating in FRL, or optimizing a coordination manner of model upload among users.

3 FIG. 3 FIG. 100 100 101 102 103 101 102 103 is a block diagram showing functional modules of an electronic apparatusfor wireless communications according to an embodiment of the present disclosure. As shown in, the electronic apparatusincludes a determination unit, a communication unitand an acquisition unit. The determination unitis configured to determine, at least based on processing capabilities and a wireless communication environment of wireless communication terminals within a coverage range of a wireless transceiving node, wireless communication terminals which are to participate in Federated Reinforcement Learning (FRL). The communication unitis configured to acquire, from the wireless communication terminals participating in the FRL, respective local learning models. The acquisition unitis configured to obtain an updated global model based on the local learning models.

100 The electronic apparatusmay be arranged at the network side or on the cloud server side, for example, at the wireless transceiving node side. The wireless transceiving node may be a base station, an access point (AP), a road side unit, and the like. In addition, the wireless communication terminals here may be various user equipments (UEs) or user terminals capable of participating in the FRL, or may be communication terminals such as mobile base stations.

101 102 103 3 FIG. The determination unit, the communication unitand the acquisition unitmay be implemented by one or more processing circuitries. Such processing circuitry may be, for example, implemented as a chip or a processor. Moreover, it should be understood that the functional units in the electronic apparatus shown inare only logical modules defined based on specific functions thereof, and are not intended to limit a specific implementation.

100 100 It should further be noted that the electronic apparatusmay be implemented at a chip level, or may be implemented at an apparatus level. For example, the electronic apparatusmay operate as the wireless transceiving node and may further include external apparatuses such as a memory and a transceiver (not shown in the figure). The memory may be configured to store related data information and programs to be executed by the wireless transceiving node to implement various functions. The transceiver may include one or more communication interfaces to support communications with different apparatuses (such as other wireless transceiving nodes and UEs). An implementation of the transceiver is not specifically limited here.

Theoretically, more wireless communication terminals participating in FRL leads to better performance of learning. This is because increasing of samples of a dataset enhances a degree to which a system model cognizes a learning object. The wireless communication terminals need to upload model parameters after local learning, causing occupation of wireless resources. As more wireless communication terminals participate in the FRL, more uplink transmission resources are occupied simultaneously, which is prone to generate a network storm of data upload, resulting in congestion in data transmission and expansion of a transmission latency, thereby seriously affecting the effect of model aggregation and the timeliness of model distribution.

101 101 In this embodiment, the determination unitselects the wireless communication terminals which are to participate in the FRL, in order to reduce the number of wireless communication terminals participating in the FRL while ensuring the learning performance. In an implementation, the determination unitmay consider the processing capabilities and the current wireless communication environment of the wireless communication terminals to select the most suitable wireless communication terminal for participating in the FRL.

101 101 For example, the wireless communication environment of the wireless communication terminal includes one or more of a wireless channel quality, a data rate, strength of interferences, a geographical location, an information transmission path loss related to the geographical location, and a movement speed. Preferably, the determination unitmay determine a wireless communication terminal with a better wireless communication environment to participate in the FRL to ensure transmission of the model parameters. Similarly, the determination unitmay preferably determine a wireless communication terminal with a stronger processing capability to participate in the FRL to ensure effective local model learning and model parameter uploading.

101 101 For example, when determining the learning terminals to participate in the FRL, the wireless communication environment of the wireless communication terminal has a higher weight than the processing capability of the wireless communication terminal. In other words, when the determination unitcannot strike a balance between selecting a wireless communication terminal with a better wireless communication environment and selecting a wireless communication terminal with a stronger processing capability, the determination unitpreferably selects the wireless communication terminal with a better wireless communication environment to ensure that a latency of model update meets the requirements. It should be understood that this is not restrictive and may be modified according to an actual requirement.

102 100 101 The communication unitmay at least partially acquire information on the wireless communication environment and the processing capability from the wireless communication terminal. For example, the network side where the electronic apparatusis located may for example acquire the movement speed by itself, and acquire the geographical location, the channel quality, the processing capability and the like from report of the wireless communication terminal. If the determination unitis able to determine whether to select certain wireless communication terminals to participate in the FRL based on information on the network side, reporting of a channel state by these wireless communication terminals may be forbidden in a certain round to reduce signaling overhead.

In an exemplary scenario based on Internet of vehicles, the wireless communication terminal may be a vehicle or a vehicle in a platoon, and a learning object may be the environment where the vehicle is located, such as a traffic condition in the vicinity of the vehicle. The processing capability of the wireless communication terminal is, for example, one or more of an automated driving level of the vehicle and an environment perception capability of the vehicle. It should be noted that some descriptions below are made by taking the Internet of vehicles as a scenario example, which is not restrictive.

100 103 103 1 FIG. The wireless communication terminal participating in FRL train the local learning model based on a dataset stored thereon, and transmits the trained local learning model to the electronic apparatusfor model aggregation. It should be noted that the wireless communication terminal participating in the FRL initially receives an initial machine learning model distributed from the network side and performs initial training based on the initial machine learning model. The acquisition unitfor example aggregates local learning models acquired from respective wireless communication terminals to obtain an updated global model. For example, the acquisition unitmay perform the function of the coordinator shown in.

In the scenario of Internet of vehicles, in the training of the local learning model by a vehicle, a predetermined reward function may be defined. The reward function includes one or more of a forward driving reward, a collision avoidance reward and a speed maintenance reward. These reward functions are described in detail below.

102 In an example, the communication unitis further configured to provide the updated global model to wireless communication terminals within the coverage of the wireless transceiving node. In this manner, all wireless communication terminals are aware of the latest update of the global model. Before the model converges, the number and identifications of determined wireless communication terminals participating in the FRL may be different in respective rounds of learning depending on changes in the wireless communication environment or other factors. In this example, even if a wireless communication terminal has not been selected to participate in the FRL for a long time period, the wireless communication terminal is provided with the latest updated global model. Therefore, the wireless communication terminal, when selected to participate in the FRL, is able to perform training based on the latest global model. In this way, positive feedback can be provided to the global model in the process of model aggregation, and thereby a convergence speed of the global model is improved.

102 For example, the communication unitmay provide a complete updated global model to the wireless communication terminals participating in the FRL, and provide a lightweight updated global model to the wireless communication terminal that does not participate in the FRL. The lightweight global model may be for example a global model with low complexity or low accuracy.

4 FIG. 4 FIG. 100 To facilitate understanding,shows an example of relevant information flow of the FRL process. Here, a wireless communication terminal is abbreviated to terminal. The network side performs the functions of the electronic apparatus. It should be noted that in the information flow shown inand other drawings, the number of terminals is exemplary and is not limited to 3 as shown.

4 FIG. Firstly, the network side distributes an initial machine learning model to terminals A to C as a basis for training. Then, a first round of FRL is started, and the terminals A to C which potentially participate in the FRL report relevant information of themselves to the network side. For example, the information is about a wireless communication environment and/or a processing capability. The network side determines terminals which are to participate in the FRL based on the received terminal-relevant information and/or information stored by itself. In the example of, terminal A and terminal C are determined to participate in the current round of FRL. Therefore, the network side informs terminal A and terminal C of confirmation information. On receipt of the confirmation information, terminal A and terminal C train local learning models respectively based on a local dataset and the initial machine learning model, and upload the local learning models to the network side. The network side aggregates the received local learning models to obtain an updated global model, transmits the obtained complete updated global model to terminal A and terminal C participating in the FRL, and transmits a lightweight updated global model to terminal B that does not participate in the FRL. In this way, all the terminals are enabled to maintain the latest version of the global model while ensuring fairness.

4 FIG. In a case that the model does not converge, a second round of FRL is performed. Similarly, terminals A to C which potentially participate in the FRL report their relevant information to the network side, for example, report information about a wireless communication environment and/or processing capabilities. It should be noted that if the network side is able to determine, without relevant information reported by terminal C, whether terminal C is to participate in the current round of FRL, information report by terminal C in the current round of FRL may be forbidden so as to reduce signaling overhead. The network side determines terminals to participate in the FRL based on the received terminal-relevant information and/or information stored by itself. In the example in, terminal A and terminal B are determined to participate in the current round of FRL. Therefore, the network side informs terminal A and terminal B of confirmation information. On receipt of the confirmation information, terminal A and terminal B train local learning models respectively based on a local dataset and the global model obtained in the first round, and upload the local learning models to the network side. The network side aggregates the received local learning models to obtain an updated global model, transmits the obtained complete updated global model to terminal A and terminal B participating in the FRL, and transmits a lightweight updated global model to terminal C that does not participate in the FRL. For example, the network side determines whether the updated global model converges. The process proceeds to the next round of FRL in a case where the updated global model does not converge, and otherwise the process ends.

102 5 FIG. 5 FIG. 4 FIG. 4 FIG. In addition, the communication unitmay further provide the updated global model to the wireless communication terminals participating in the FRL. The wireless communication terminals that do not participate in the FRL acquire the updated global model from the wireless communication terminals participating in the FRL via P2P communication. An example of relevant information flow in this case is shown in. As can be seen, a difference betweenandlies in methods of updating a global model for the terminal that does not participate in FRL. For the sake of brevity, the description of the same part as inis not repeated here. After the first round of FRL, the network side provides the complete updated global model to terminal A and terminal C participating in FRL, and terminal B that does not participate in FRL transmits a global model update request to terminal A via P2P communication. In response to the request, terminal A provides the updated global model obtained from the network side to terminal B. Here, the P2P communication may be implemented in multiple manners, including but not limited to WiFi, Bluetooth, RFID, and sidelink communication. Similarly, after the second round of FRL, terminal C that does not participate in FRL acquires the updated global model from terminal B via P2P communication.

102 4 FIG. The communication unitmay be further configured to instruct the wireless communication terminals participating in FRL to perform model distillation to control a data volume of the local learning models to a predetermined volume. In this case, the data volume of the to-be-uploaded local learning models is effectively reduced, and thereby a latency and a requirement for transmission resources are reduced. For example, the instruction may be sent together with the confirmation information shown in, or may be sent in a separate signaling, which are not restrictive.

The predetermined volume may be the same or different for different wireless communication terminals. For example, in a case that the data volume of the models after distillation is required to be the same (that is, the predetermined volume is the same), the predetermined volume may be set to a data volume of a model that can be transmitted by a wireless communication terminal with the worst wireless communication environment (such as channel quality).

In another aspect, in a case that the data volume of models after distillation is required to be different (that is, the predetermined volume is different), for example, a wireless communication terminal with a strong processing capability may be configured with a model with a large data volume, and a wireless communication terminal with a weak processing capability may be configured with a model with a small data volume. In this case, the wireless communication terminals with different processing capabilities can exchange their underlying training results via P2P communication during the training process of the local learning models, to ensure that models of different sizes can be aggregated on the network side. For example, the P2P communication includes but is not limited to Sidelink communication, WiFi, Bluetooth, and RFID.

102 102 For example, the communication unitis further configured to schedule the wireless communication terminals participating in the FRL to upload the local learning models, so that an end time of model uploading of each wireless communication terminal is consistent. For example, the communication unitmay schedule the wireless communication terminals according to the data volume of the models configured to the wireless communication terminals.

100 In summary, with the electronic apparatusaccording to this embodiment, the wireless communication terminals to participate in the FRL are selectively determined, so that the probability of congestion in data transmission is reduced and the transmission latency is reduced, while the performance of learning is ensured. In addition, in this embodiment, all wireless communication terminals within the coverage of the wireless transceiving node can keep the update of the global model, ensuring that the positive feedback for the global model can be provided while participating in the FRL, which is conducive to improving the convergence speed of the global model.

As the wireless communication environment changes at any time, there may be a situation where a wireless communication terminal participating in FRL fails to upload a local learning model in time due to a sudden change of the wireless communication environment. In order to ensure a timely update of the global model, a solution in which another wireless communication terminal participating in the FRL assists in communication is provided in this embodiment.

100 100 102 The electronic apparatusaccording to this embodiment includes the same functional modules as the electronic apparatusin the first embodiment. For example, the communication unitis further configured to schedule a first wireless communication terminal participating in the FRL to assist a second wireless communication terminal participating in the FRL in uploading of the local learning model. The second wireless communication terminal transmits a part or all of the local learning model to the first wireless communication terminal via P2P communication to be uploaded by the first wireless communication terminal. For example, the P2P communication includes, but is not limited to, Sidelink communication, WiFi, Bluetooth, and RFID. The “first” and “second” here are only for distinguishing one from another, and do not represent any order or priority.

101 For example, the wireless communication environment of the first wireless communication terminal is better than the wireless communication environment of the second wireless communication terminal. In this case, the determination unitfor example determines that the channel state for the first wireless communication terminal is suitable for transmitting a large model, and the channel state for the second wireless communication terminal is suitable for transmitting a small model or not suitable for uploading a model. Thus, the first wireless communication terminal may assist the second wireless communication terminal in uploading the model.

6 FIG. 6 FIG. 6 FIG. 6 FIG. To facilitate understanding,shows an example of relevant information flow of assisted module upload in FRL. In, the information flow of a single round of FRL is shown, where the network side determines that terminal A and terminal C are to participate in this round of FRL. In the example in, it is assumed that the wireless communication environment (such as channel state) of terminal A is better than the wireless communication environment of the terminal C. Therefore, the network side determines that terminal A assists terminal C in uploading the model. Therefore, the network side transmits scheduling information while transmitting confirmation information to terminal A and terminal C. For example, the scheduling information instructs terminal A to assist terminal C in uploading the local learning model. It should be noted that although the confirmation information and the scheduling information are shown inas a single signaling, this is not restrictive and the confirmation information and the scheduling information may be transmitted separately. In addition, the timing of transmitting the scheduling information is not limited thereto. For example, the scheduling information may be transmitted during the training of the local learning model or during the uploading of the model. Moreover, the scheduling information may be transmitted in response to a request from terminal C, which is not restrictive.

The scheduling information includes for example one or more of identifications (ID) of terminal A and terminal C, a size of a to-be-uploaded model, an incentive strategy, and a P2P communication mode. For example, the incentive strategy is to provide extra rewards (such as additional model sharing) to encourage a terminal to assist other terminal in uploading a model. As mentioned above, the P2P communication here, for example, includes but is not limited to Sidelink communication, WiFi, Bluetooth, RFID and the like. In addition, scheduling information may have different contents for terminal A which provides assistance and terminal C which receives the assistance. For example, the scheduling information for terminal A indicates to provide assistance to terminal C, and the scheduling information for terminal C indicates that assistance is to be provided by terminal A.

Terminal A and terminal C perform training of local learning models respectively. After the training is completed, terminal C transmits (shares) all or part of the trained local learning model to terminal A via P2P communication based on scheduling information, and terminal A uploads the local learning model from terminal C and the local learning model of terminal A to the network side. Terminal A has a good channel state and therefore can achieve fast model upload, so that a latency is reduced. In a case that terminal C shares only a part of the local learning model, the remaining part of the local learning model is uploaded to the network side by terminal C itself.

6 FIG. In addition, in a case that the P2P communication is Sidelink communication, terminal C may establish a sidelink between terminal C and terminal A in response to the scheduling information. As shown by the dashed lines in, terminal C transmits a request of establishing the sidelink to terminal A through a sidelink terminal discovery process, and terminal A transmits a sidelink establishment confirmation to terminal C in response to the request. Thereby, a sidelink between terminal A and terminal C is established, and the part or all of the local learning model of terminal C is transmitted to terminal A via the sidelink.

100 In summary, the electronic apparatusaccording to this embodiment schedules the wireless communication terminal participating in the FRL to assist in model upload based on the P2P communication, so that the latency caused by model upload is further reduced, the timely update of the global model is ensured, and the convergence speed of the global model is improved.

7 FIG. 7 FIG. 200 200 201 202 201 202 is a block diagram showing functional modules of an electronic apparatusfor wireless communications according to another embodiment of the present disclosure. As shown in, the electronic apparatusincludes a training unitand a communication unit. The training unitis configured to perform training of a local learning model at a wireless communication terminal in response to confirmation information from a wireless transceiving node. The confirmation information indicates that the wireless transceiving node determines that the wireless communication terminal is to participate in FRL based on a processing capability and a wireless communication environment of the wireless communication terminal. The communication unitis configured to upload the local learning model to the wireless transceiving node and acquire an updated global model from the wireless transceiving node.

201 202 7 FIG. The training unitand the communication unitmay be implemented by one or more processing circuitries. The processing circuitry may be implemented as a chip or a processor, for example. Furthermore, it should be understood that the functional units in the electronic apparatus shown inare only logical modules defined according to their specific functions, and are not intended to restrict a specific implementation.

200 The electronic apparatusis, for example, arranged at a wireless communication terminal side or communicatively connected to a wireless communication terminal. The wireless communication terminals herein may be various user equipments (UEs) or user terminals capable of participating in the FRL, or may be mobile base stations or other communication terminals. The wireless transceiving node may be a base station, an access point (AP), a road side unit, or the like, and more generally, represents a network side or cloud server side.

200 200 The electronic apparatusmay be implemented at a chip level or at an apparatus level. For example, the electronic apparatusmay operate as a wireless communication terminal itself and may further include external apparatuses such as a memory, a transceiver (not shown) and the like. The memory may be configured to store programs to be executed by the wireless communication terminal for implementing various functions and related data information. The transceiver may include one or more communication interfaces to support communications with different apparatuses (such as other wireless communication terminals, base stations, core networks and the like). An implementation of the transceiver is not limited here.

Similar to the first embodiment, the wireless communication environment of the wireless communication terminal includes one or more of a wireless channel quality, a data rate, strength of interferences, a geographical location, an information transmission path loss related to the geographical location, and a movement speed.

In the scenario example of Internet of vehicles, the wireless communication terminal is a vehicle or a vehicle in the platoon, and the processing capability of the vehicle includes one or more of an automated driving level of the vehicle and an environment perception capability of the vehicle.

202 202 The communication unitmay be further configured to provide the wireless transceiving node with at least part of information on the processing capability and the wireless communication environment of the wireless communication terminal. The wireless transceiving node determines, based on this information and/or relevant information stored by itself, that the wireless communication terminal is to participate in the FRL and transmits confirmation information. The communication unitis configured to receive the confirmation formation.

202 202 202 5 FIG. As a wireless communication terminal participating in the FRL, the communication unitof the wireless communication terminal may acquire an updated global model from the wireless transceiving node. In an example, the communication unitis further configured to provide the updated global model to a wireless communication terminal not participating in the FRL via P2P communication. For example, the communication unitreceives a global model update request sent by a wireless communication terminal that does not participate in the FRL via P2P communication, and provides the acquired updated global model to the wireless communication terminal via P2P communication in response to the request. Here, the P2P communication may be implemented in multiple manners, including but not limited to Wifi, Bluetooth, RFID, sidelink communication, and the like. An example of the detailed information flow is shown inand is not repeated here.

202 In addition, for example, in a case that the wireless communication environment of the wireless communication terminal is poor, the communication unitmay further be configured to upload part or all of the local learning model with assistance of another wireless communication terminal participating in the FRL.

202 202 6 FIG. As an example, the communication unitmay receive scheduling information from the wireless transceiving node, and perform model transmission between the wireless communication terminal and another wireless communication terminal via P2P communication based on the scheduling information. The P2P communication may be implemented in multiple manners, including but not limited to WiFi, Bluetooth, RFID, sidelink communication, and the like. For example, the communication unitmay establish a sidelink between the wireless communication terminal and the another wireless communication terminal in response to the scheduling information. For example, the scheduling information includes one or more of identifications (ID) of the wireless communication terminal and the another wireless communication terminal, a size of a to-be-uploaded model, an incentive strategy, and a P2P communication mode. Relevant details are given in detail in the second embodiment with reference to, which are applied here in the same manner and is not described repeatedly.

202 202 202 202 As another example, the communication unitmay determine another wireless communication terminal capable of providing assistance by broadcasting a request information, and the wireless communication terminal performs P2P communication with the another wireless communication terminal. The request information includes for example one or more of an ID of the wireless communication terminal, a size of a to-be-uploaded model, and an incentive strategy. For example, on receipt of the confirmation information, the communication unitstarts to search for another wireless communication terminal in the vicinity that is willing and able to assist the communication unitin uploading the model, so as to further reduce the latency. When such wireless communication terminal is found, after the training of the local learning model is completed, the communication unittransmits part or all of the local learning model to the another wireless communication terminal via P2P communication.

8 FIG. 8 FIG. 6 FIG. 8 FIG. To facilitate understanding,shows relevant information flow of assisted module upload in FRL according to the example. The information flow of a single round of FRL is shown in. The flow before determining terminals participating in the FRL is the same as the corresponding part ofand is not repeated here. In, the network side transmits confirmation information to terminal A and terminal C that are determined to participate in the FRL. It is assumed that terminal C that receives the confirmation information has a poor wireless communication environment, and therefore needs assistance with model upload via P2P communication. Therefore, terminal C broadcasts request information within its coverage for requesting assistance with model upload. The request information includes for example one or more of an identification (ID) of terminal C, a size of a to-be-uploaded model, and an incentive strategy. On receipt of the broadcasted request information, terminal A determines to provide assistance to terminal C and transmits to terminal C a confirmation of the request for assistance. Terminal C trains the local learning model. After the training is completed, terminal C transmits (shares) part or all of the local learning model to terminal A via P2P communication. Terminal A uploads the received local learning model of terminal C and a local learning model of terminal A to the network side. In a case that terminal C shares a part of the local learning model, the remaining part of the local learning model is uploaded to the network side by terminal C itself. Similarly, the P2P communication may be implemented in multiple manners, including but not limited to WiFi, Bluetooth, RFID, sidelink communication and the like.

200 The electronic apparatusaccording to this embodiment performs assisted model upload via P2P communication by using another wireless communication terminal participating in the FRL, so that the latency caused by model uploading in a poor wireless communication environment is reduced, the timely update of the global model is ensured, and the convergence speed of the global model is improved.

201 In the scenario example of Internet of vehicles, the wireless communication terminal is a vehicle or a vehicle in a platoon. The training unitis configured to define a predetermined reward function in training of the local learning model. The reward function includes, for example, one or more of a forward driving reward, a collision avoidance reward and a speed maintenance reward.

9 FIG. 0 3 A main purpose of the reward function design is to determine effectiveness of a vehicle behavior according to the vehicle behavior and the vehicle's response to the current environment, thereby enable the vehicle to perform learning and iteration with respect to the behavior of the vehicle towards a goal. As shown in a schematic diagram in, Sto Srepresent states, and a number above an arrow represents a reward value or a penalty value. A positive number represents a reward value and a negative number represents a penalty value.

For example, the forward driving reward is mainly for ensuring that the vehicle travels in a relatively correct direction, including that the vehicle faces a forward direction on the road and the vehicle does not exceed the lane lines on the left or right side. For example, the forward driving reward may be calculated by

1 2 1 2 3 4 wherein erepresents an offset distance of the vehicle, erepresents an offset angle of the vehicle, and e′ represents a change rate of the corresponding parameter. Here, k, k, kand krepresents coefficients for the corresponding variables.

f avut f avut f avut The collision avoidance reward is mainly for determining a safety distance from the vehicle to an obstacle, so as to avoid collision between the vehicle and the obstacle. Referring to the following equation (2), a dynamical safety distance (LoSD(v), LaSD(v)) is calculated based on the Bereley algorithm. The dynamical safety distance is related to vehicle velocities vand v, accelerations αand α, a vehicle steering angle β, and a vehicle response time τ, wherein the subscript avut represents the current vehicle under test, and the subscript f represents a vehicle (or a leading vehicle) followed by the current vehicle. By calculating the safety distance and obtaining the location information via the server, a collision probability may be calculated. The greater the collision probability, the greater the penalty.

min keep t max wherein Rrepresents a minimum distance that the current vehicle needs to maintain when the vehicle followed by the current vehicle makes an emergency stop, and also represents a necessary tolerance for distance calculation error. When the speed is less than or equal to a speed limit, a reward is generated along the road direction for a certain distance traveled. A penalty is imposed when the speed exceeds the speed limit. The following equation (3) indicates that, after the vehicle has traveled an effective distance, the reward increases with an increase of the speed along the road direction, thereby encouraging the vehicle to accelerate. However, the penalty is imposed when the vehicle speed exceeds the speed limit. In this way, the vehicle is made to drive close to the speed limit. In the equation, Rvrepresents a speed maintenance reward, ω represents a reward coefficient for each distance, v*cos β represents a speed along the road direction, and vrepresents a maximum speed on the road.

It should be understood that the above reward functions are illustrative, rather than restrictive.

In addition, in a case that the reward function is applied to a platooning scenario, the platoon is regarded as a whole when traveling. Therefore, not all vehicles in the platoon are required to participate in the FRL from the perspective of resource consumption, and the reward function is equally applied to the vehicles participating in the FRL and other member vehicles that only perform local learning. For example, the leading vehicle may participate in the FRL. Vehicles that do not participate in the FRL may acquire the latest global model from the leading vehicle to improve their perception and decision-making capabilities in an environment.

A platoon member that does not participate in the FRL may update its driving strategy in one of the following two manners. In the first manner, the platoon member does not actively learn the surrounding environment or update the driving strategy, but directly acquires a vehicle control instruction and a vehicle driving parameter from the leading vehicle. In the second manner, the platoon member actively learns the surrounding environment and updates the driving strategy. For example, the platoon member may acquire the updated global model from the leading vehicle and update the driving strategy of the vehicle based on a combination of the updated global model and its local learning result.

200 201 202 In addition, the platoon members participating in the FRL may transmits their local learning models to the leading vehicle, and the leading vehicle may perform a coarse update on the local model of the platoon based on the local learning models of the platoon members, and transmits the coarsely updated local model of the platoon to the network side. Accordingly, in a case that the wireless communication terminal corresponding to the electronic apparatusis the leading vehicle in the platoon, the training unitis further configured to perform the coarse update on the local model of the platoon based on the local learning models of the platoon members, and upload the coarsely updated local model of the platoon to the wireless transceiving node. In addition, the communication unitis further configured to transmit the updated global model acquired from the wireless transceiving node to the platoon members.

10 FIG. 4 FIG. To facilitate understanding,shows an example of relevant information flow of FRL in a platoon application scenario. The information flow before determining vehicles participating in the FRL is similar to the corresponding flow shown inand is not repeated here. The network side determines that leading vehicle A and vehicle C are to participate in FRL. The network side transmits confirmation information for leading vehicle A and confirmation information for vehicle C both to leading vehicle A, and leading vehicle A forwards the confirmation information (such as an ID of the vehicle participating in the FRL) to vehicle C. Leading vehicle A and vehicle C perform training of local learning models based on local datasets. After the training is completed, vehicle C provides its local learning model to leading vehicle A via transmission within the platoon, and then leading vehicle A perform coarse update on a local model of the platoon based on the local learning models of leading vehicle A and vehicle C, and uploads the coarsely updated local model of the platoon to the network side. Vehicle C does not need to additionally upload the local learning model, so that resource consumption is reduced. The network side aggregates the uploaded local model of the platoon and the local learning models acquired from other vehicles to obtain an updated global model, and transmits the updated global model to leading vehicle A. Leading vehicle A distributes the updated global model in the platoon, so that update of the global model is synchronized for the platoon members.

In the description of the electronic apparatus for wireless communications in the above embodiments, some processes or methods are further disclosed. Hereinafter, an overview of the methods is given without repeating some of details discussed above. It should be noted that although disclosed in the description of the electronic apparatus for wireless communications, the methods do not necessarily adopt the components as described or be performed by those components. For example, an embodiment of the electronic apparatus for wireless communications may be implemented partially or entirely using hardware and/or firmware, and a method for wireless communications discussed below may be implemented entirely by a computer-executable program, although the method may employ the hardware and/or firmware for the electronic apparatus for wireless communications.

11 FIG. 11 12 shows a flowchart of a method for wireless communications according to an embodiment of the present disclosure. The method includes: determining (S), at least based on processing capabilities and a wireless communication environment of wireless communication terminals within a coverage range of a wireless transceiving node, wireless communication terminals which are to participate in FRL; and acquiring, from the wireless communication terminals participating in the FRL, respective local learning models, and obtaining an updated global model based on the local learning models (S). For example, the method may be performed on the wireless transceiving node side.

For example, the wireless communication environment of the wireless communication terminal includes one or more of a wireless channel quality, a data rate, strength of interferences, a geographical location, an information transmission path loss related to the geographical location, and a movement speed. Information about the wireless communication environment and the processing capability may be acquired at least partially from the wireless communication terminals. For example, when determining the wireless communication terminal which is to participate in the FRL, the wireless communication environment of the wireless communication terminal may have a higher weight than the processing capability of the wireless communication terminal.

11 FIG. 13 In addition, as shown by the dashed box in, the method further includes step S: providing the updated global model to the wireless communication terminals within the coverage range. As an example, a complete updated global model may be provided to the wireless communication terminals participating in the FRL, and a lightweight updated global model may be provided to a wireless communication terminal that does not participate in the FRL. As another example, the updated global model may be provided to the wireless communication terminals participating in the FRL, and the wireless communication terminal that does not participate in the FRL may acquire the updated global model from a wireless communication terminal participating in the FRL via P2P communication.

In addition, although not shown in the figure, the method may further include: scheduling a first wireless communication terminal participating in the FRL to assist a second wireless communication terminal participating in the FRL in uploading of the local learning model. The second wireless communication terminal transmits a part or all of the local learning model to the first wireless communication terminal via P2P communication, to be uploaded by the first wireless communication terminal. For example, the wireless communication environment of the first wireless communication terminal is better than the wireless communication environment of the second wireless communication terminal. For example, the P2P communication includes sidelink communication.

The method may further include: instructing the wireless communication terminals participating in the FRL to perform model distillation to control a data volume of the local learning models to be a predetermined volume. The method may include scheduling the wireless communication terminals participating in the FRL to upload the local learning models, so that an end time of model uploading of each wireless communication terminal is consistent.

As an example, the wireless communication terminal may be a vehicle or a vehicle in a platoon. The processing capability of the vehicle includes one or more of an automated driving level of the vehicle and an environment perception capability of the vehicle. In the training of the local learning model by the vehicle, a predetermined reward function may be defined. The reward function for example includes one or more of a forward driving reward, a collision avoidance reward and a speed maintenance reward.

100 The method corresponds to the electronic apparatusin the first and the second embodiments, and detailed descriptions are given in the first and the second embodiments and are not repeated here.

12 FIG. 21 22 shows a flowchart of a method for wireless communications according to another embodiment of the present disclosure. The method includes: in response to confirmation information from a wireless transceiving node, performing (S) training of a local learning model at a wireless communication terminal, wherein the confirmation information indicates that the wireless transceiving node determines, based on a processing capability and a wireless communication environment of the wireless communication terminal, that the wireless communication terminal is to participate in FRL; and uploading (S) the local learning model to the wireless transceiving node and acquiring an updated global model from the wireless transceiving node. The method may be implemented at the wireless communication terminal side for example.

Similarly, the wireless communication environment of the wireless communication terminal may include one or more of a wireless channel quality, a data rate, a strength of interferences, a geographical location, an information transmission path loss related to the geographical location, and a movement speed.

Although not shown in the figure, the method may further include: in response to a request from a wireless communication terminal which does not participate in the FRL, providing the updated global model to the wireless communication terminal which does not participate in the FRL via P2P communication.

The method further includes uploading a part or all of the local learning model of the wireless communication terminal with assistance of another wireless communication terminal participating in the FRL

In an example, the another wireless communication terminal may be determined by broadcasting request information, and the wireless communication terminal performs P2P communication with the another wireless communication terminal. For example, the request information includes one or more of an identification of the wireless communication terminal, a size of a to-be-uploaded model, and an incentive strategy.

In another example, model transmission may be performed between the wireless communication terminal and the another wireless communication terminal via P2P communication based on scheduling information from the wireless transceiving node.

For example, the wireless communication terminal may be a vehicle or a vehicle in a platoon. The processing capability of the vehicle includes one or more of an automated driving level of the vehicle and an environment perception capability of the vehicle.

The method further includes: defining a predetermined reward function in training of the local learning model by the vehicle. The reward function includes one or more of a forward driving reward, a collision avoidance reward and a speed maintenance reward.

In a case that the wireless communication terminal is a leading vehicle in the platoon, the method further includes: performing coarse update on a local learning model of the platoon by the leading vehicle based on local learning models of members of the platoon, and uploading the coarsely updated local learning model of the platoon to the wireless transceiving node. The leading vehicle may further transmit the updated global model acquired from the wireless transceiving node to the members of the platoon.

200 The method corresponds to the electronic apparatusin the third embodiment. The relevant detailed description is given in the third embodiment and is not repeated here.

It should be noted that the above methods may be applied in combination or separately.

The technology of the present disclosure may be applied to various products.

100 For example, the electronic apparatusmay be implemented as various types of base stations. The base station may be implemented as any type of evolved node B (eNB) or gNB (5G base station). An eNB includes, for example, a macro eNB and a small eNB. A small eNB may be an eNB that covers a cell smaller than a macro cell, such as a pico eNB, a micro eNB, and a home (femto) eNB. The gNB may have similar situations as above. Alternatively, the base station may be implemented as any other type of base station, such as a NodeB or a base transceiver station (BTS). The base station may include a main body (that is also referred to as a base station device) configured to control wireless communications, and one or more remote radio heads (RRH) arranged in a different place from the main body. In addition, various types of user equipment may serve as base stations by temporarily or semi-permanently performing functions of the base station.

200 The electronic apparatusmay be implemented as various types of user equipment. The user equipment may be implemented as a mobile terminal (such as a smartphone, a tablet personal computer (PC), a notebook PC, a portable game terminal, a portable/dongle type mobile router, and a digital camera), or an in-vehicle terminal (such as a vehicle navigation apparatus). The user equipment may be implemented as a terminal (which is also referred to as a machine type communication (MTC) terminal) that performs machine-to-machine (M2M) communications. Furthermore, the user equipment may be a wireless communication module (such as an integrated circuitry module including a single chip) mounted on each of the terminals.

13 FIG. 800 810 820 820 810 is a block diagram showing a first example of a schematic configuration of an eNB or gNB to which the technology of the present disclosure may be applied. It should be noted that the following description is made taking the eNB as an example. The technology of the present disclosure is also applicable to the gNB. An eNBincludes one or more antennasand a base station apparatus. The base station apparatusand each of the antennasmay be connected to each other via a RF cable.

810 820 800 810 810 800 800 810 800 810 13 FIG. 13 FIG. Each of the antennasincludes a single or multiple antenna elements (such as multiple antenna elements included in a Multiple Input Multiple Output (MIMO) antenna), and is used by the base station apparatusto transmit and receive radio signals. As shown in, the eNBmay include multiple antennas. For example, the multiple antennasmay be compatible with multiple frequency bands used by the eNB. Althoughillustrates the example in which the eNBincludes the multiple antennas, the eNBmay include a single antenna.

820 821 822 823 825 The base station apparatusincludes a controller, a memory, a network interface, and a wireless communication interface.

821 820 821 825 823 821 821 822 821 The controllermay be, for example, a CPU or DSP, and operates functions of a higher layer of the base station apparatus. For example, the controllergenerates a data packet from data in signals processed by the wireless communication interface, and transfers the generated packet via the network interface. The controllermay bundle data from multiple base band processors to generate a bundled packet, and transfer the generated bundled packet. The controllermay have logical functions of performing for example radio resource control, radio bearer control, mobility management, admission control, and scheduling. The control may be performed in connection with a core network node or an eNB in the vicinity. The memoryincludes an RAM and an ROM, and stores a program executed by the controllerand various types of control data (such as a terminal list, transmission power data, and scheduling data).

823 820 824 821 823 800 823 823 823 825 The network interfaceis a communication interface for connecting the base station apparatusto a core network. The controllermay communicate with a core network node or another eNB via the network interface. In this case, the eNB, and the core network node or the other eNB may be connected to each other via a logical interface (such as SI interface and X2 interface). The network interfacemay be a wired communication interface or a wireless communication interface for a wireless backhaul link. If the network interfaceis a wireless communication interface, the network interfacemay use a higher frequency band for wireless communications than a frequency band used by the wireless communication interface.

825 800 810 825 826 827 826 826 821 826 826 820 827 810 The wireless communication interfacesupports any cellular communication scheme (such as Long Term Evolution (LTE) and LTE-advanced), and provides wireless connection to a terminal located in a cell of the eNBvia the antenna. The wireless communication interfacemay generally include, for example, a baseband (BB) processorand an RF circuitry. The BB processormay perform, for example, encoding/decoding, modulating/demodulating, and multiplexing/demultiplexing, and performs various types of signal processing of layers (such as L1, media access control (MAC), radio link control (RLC), and a packet data convergence protocol (PDCP)). The BB processormay have a part or all of the above-described logical functions instead of the controller. The BB processormay be a memory storing communication control programs, or a module including a processor and a related circuitry configured to execute the programs. Updating the program may cause the functions of the BB processorto be changed. The module may be a card or a blade that is inserted into a slot of the base station apparatus. Alternatively, the module may be a chip mounted on the card or the blade. Meanwhile, the RF circuitrymay include, for example, a mixer, a filter, and an amplifier, and transmits and receives radio signals via the antenna.

13 FIG. 13 FIG. 13 FIG. 825 826 826 800 825 827 827 825 826 827 825 826 827 As shown in, the wireless communication interfacemay include multiple BB processors. For example, the multiple BB processorsmay be compatible with multiple frequency bands used by the eNB. As shown in, the wireless communication interfacemay include multiple RF circuitries. For example, the multiple RF circuitriesmay be compatible with multiple antenna elements. Althoughillustrates the example in which the wireless communication interfaceincludes the multiple BB processorsand the multiple RF circuitries, the wireless communication interfacemay include a single BB processoror a single RF circuitry.

800 102 100 825 821 821 101 102 103 13 FIG. In the eNBshown in, the communication unitand the transceiver of the electronic apparatusmay be implemented by the wireless communication interface. At least a part of functions may be implemented by the controller. For example, the controllermay determine a suitable wireless communication terminal to participate in the FRL by performing the functions of the determination unit, the communication unitand the acquisition unit, so that the latency of updating the global model is effectively reduced and the convergence speed of the global model is improved.

14 FIG. 830 840 850 860 860 840 850 860 is a block diagram showing a second example of a schematic configuration of an eNB or gNB to which the technology of the present disclosure may be applied. It should be noted that the following description is made taking the eNB as an example. The technology of the present disclosure is also applicable to the gNB. An eNBincludes a single or multiple antennas, base station apparatusand an RRH. The RRHis connected to each antennavia an RF cable. The base station apparatusand the RRHmay be connected to each other via a high-speed line such as an optical fiber cable.

840 860 830 840 840 830 830 840 830 840 14 FIG. 14 FIG. Each of the antennasincludes a single or multiple antenna elements (such as multiple antenna elements included in an MIMO antenna), and is used by the RRHto transmit and receive radio signals. As shown in, the eNBmay include multiple antennas. For example, the multiple antennasmay be compatible with multiple frequency bands used by the eNB. Althoughillustrates the example in which the eNBincludes the multiple antennas, the eNBmay include a single antenna.

850 851 852 853 855 857 851 852 853 821 822 823 13 FIG. The base station apparatusincludes a controller, a memory, a network interface, a wireless communication interface, and a connection interface. The controller, the memory, and the network interfaceare the same as the controller, the memory, and the network interfacedescribed with reference to.

855 860 860 840 855 856 856 826 856 864 860 857 855 856 856 830 855 856 855 856 13 FIG. 14 FIG. 14 FIG. The wireless communication interfacesupports any cellular communication scheme (such as LTE and LTE-Advanced), and provides radio communication to a terminal located in a sector corresponding to the RRHvia the RRHand the antenna. The wireless communication interfacemay generally include, for example, a BB processor. The BB processoris the same as the BB processordescribed with reference to, except the BB processoris connected to the RF circuitryof the RRHvia the connection interface. As shown in, the wireless communication interfacemay include multiple BB processors. For example, the multiple BB processorsmay be compatible with multiple frequency bands used by the eNB. Althoughshows the example in which the wireless communication interfaceincludes multiple BB processors, the wireless communication interfacemay include a single BB processor.

857 850 855 860 857 850 855 860 The connection interfaceis an interface for connecting the base station apparatus(wireless communication interface) to the RRH. The connection interfacemay further be a communication module for communication in the above-described high-speed line that connects the base station apparatus(the wireless communication interface) to the RRH.

860 861 863 The RRHincludes a connection interfaceand a wireless communication interface.

861 860 863 850 861 The connection interfaceis an interface for connecting the RRH(wireless communication interface) to the base station apparatus. The connection interfacemay further be a communication module for communication in the above-described high-speed line.

863 840 863 864 864 840 863 864 864 863 864 863 864 14 FIG. 14 FIG. The wireless communication interfacetransmits and receives radio signals via the antenna. The wireless communication interfacemay generally include, for example, the RF circuitry. The RF circuitrymay include, for example, a mixer, a filter, and an amplifier, and transmits and receives radio signals via the antenna. As shown in, the wireless communication interfacemay include multiple RF circuitries. For example, the multiple RF circuitriesmay support multiple antenna elements. Althoughillustrates the example in which the wireless communication interfaceincludes the multiple RF circuitries, the wireless communication interfacemay include a single RF circuitry.

830 102 100 855 863 851 851 101 102 103 14 FIG. In the eNBshown in, the communication unitand the transceiver of the electronic apparatusmay be implemented by the wireless communication interfaceand/or the wireless communication interface. At least part of the functions may be implemented by the controller. For example, the controllermay determine a suitable wireless communication terminal to participate in FRL by performing the functions of the determination unit, the communication unitand the acquisition unit, so that a latency of updating the global model is reduced and a convergence speed of the global model is improved.

15 FIG. 900 901 902 903 904 906 907 908 909 910 911 912 915 916 917 918 919 is a block diagram showing an example of a schematic configuration of a smartphone to which the technology of the present disclosure may be applied. The smartphoneincludes a processor, a memory, a storage, an external connection interface, a camera, a sensor, a microphone, an input device, a display device, a speaker, a wireless communication interface, one or more antenna switches, one or more antennas, a bus, a batteryand an auxiliary controller.

901 900 902 901 903 904 900 The processormay be, for example, a CPU or a system on chip (SoC), and controls functions of an application layer and another layer of the smartphone. The memoryincludes an RAM and an ROM, and stores programs executed by the processorand data. The storage devicemay include a storage medium, such as a semiconductor memory and a hard disk. The external connection interfaceis an interface configured to connect an external apparatus (such as a memory card and a universal serial bus (USB) device) to the smartphone.

906 907 908 900 909 910 910 900 911 900 The cameraincludes an image sensor (such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS)) and generates a captured image. The sensormay include a set of sensors, such as a measurement sensor, a gyroscope sensor, a geomagnetic sensor and an acceleration sensor. The microphoneconverts sound inputted to the smartphoneinto an audio signal. The input deviceincludes, for example, a touch sensor configured to detect touch on a screen of the display device, a keypad, a keyboard, a button, or a switch, and receives operations or information input from a user. The display deviceincludes a screen (such as a liquid crystal display (LCD) and an organic light-emitting diode (OLED) display), and displays an output image of the smartphone. The loudspeakerconverts the audio signal outputted from the smartphoneinto sound.

912 912 913 914 913 914 916 912 913 914 912 913 914 912 913 914 912 913 914 15 FIG. 15 FIG. The wireless communication interfacesupports any cellular communication scheme (such as LTE and LTE-advanced), and performs wireless communication. The wireless communication interfacemay generally include for example a BB processorand an RF circuitry. The BB processormay perform encoding/decoding, modulating/demodulating and multiplexing/de-multiplexing for example, and perform various types of signal processing for wireless communication. Meanwhile, the RF circuitrymay include, for example, a mixer, a filter and an amplifier, and transmits and receives a wireless signal via an antenna. It should be noted that, although the figure shows a situation where one RF link is connected to one antenna, this is only illustrative and a situation where one RF link is connected to multiple antennas through multiple phase shifters is possible. The wireless communication interfacemay be a chip module on which the BB processorand the RF circuitryare integrated. As shown in, the wireless communication interfacemay include multiple BB processorsand multiple RF circuitries. Althoughillustrates the example in which the wireless communication interfaceincludes the multiple BB processorsand the multiple RF circuitries, the wireless communication interfacemay include a single BB processoror a single RF circuitry.

912 912 913 914 Furthermore, in addition to a cellular communication scheme, the wireless communication interfacemay support another type of wireless communication scheme such as a short-distance wireless communication scheme, a near field communication scheme, and a wireless local area network (LAN) scheme. In that case, the wireless communication interfacemay include a BB processorand an RF circuitryfor each wireless communication scheme.

915 916 912 Each of the antenna switchesswitches connection destinations of the antennasamong multiple circuitries (such as circuitries for different wireless communication schemes) included in the wireless communication interface.

916 912 900 916 900 916 900 916 15 FIG. 15 FIG. Each of the antennasincludes a single or multiple antenna elements (such as multiple antenna elements included in an MIMO antenna), and is used by the wireless communication interfaceto transmit and receive wireless signals. The smartphonemay include the multiple antennas, as shown in. Althoughillustrates the example in which the smartphoneincludes the multiple antennas, the smartphonemay include a single antenna.

900 916 915 900 Furthermore, the smartphonemay include the antennafor each wireless communication scheme. In this case, the antenna switchesmay be omitted from the configuration of the smartphone.

917 901 902 903 904 906 907 908 909 910 911 912 919 918 900 919 900 15 FIG. The busconnects the processor, the memory, the storage device, the external connection interface, the camera, the sensor, the microphone, the input device, the display device, the loudspeaker, the wireless communication interfaceand the auxiliary controllerwith each other. The batterysupplies power for blocks in the smartphoneshown invia feeder lines which are indicated partially as dashed lines in the figure. The auxiliary controlleroperates a minimum necessary function of the smartphonein a sleeping mode, for example.

900 202 200 912 901 919 901 919 201 202 15 FIG. In the smartphoneshown in, the communication unitand the transceiver of the electronic apparatusmay be implemented by the wireless communication interface. At least a part of functions may be implemented by the processoror the auxiliary controller. For example, the processoror the auxiliary controllermay implement the training of the local learning model and timely update of the global model by performing functions of the training unitand the communication unit.

16 FIG. 920 920 921 922 924 925 926 927 928 929 930 931 933 936 937 938 is a block diagram showing an example of a schematic configuration of a vehicle navigation apparatusto which the technology according to the present disclosure may be applied. The vehicle navigation apparatusincludes a processor, a memory, a global positioning system (GPS) module, a sensor, a data interface, a content player, a storage medium interface, an input device, a display device, a speaker, a wireless communication interface, one or more antenna switches, one or more antennasand a battery.

921 920 922 921 The processormay be for example a CPU or SoC, and controls the navigation function and additional functions of the vehicle navigation apparatus. The memoryincludes RAM and ROM, and stores a program executed by the processorand data.

924 920 925 926 941 The GPS modulemeasures a position (such as latitude, longitude, and altitude) of the vehicle navigation apparatusbased on a GPS signal received from a GPS satellite. The sensormay include a group of sensors, such as a gyroscope sensor, a geomagnetic sensor, and an air pressure sensor. The data interfaceis connected to, for example, an in-vehicle networkvia a terminal that is not shown, and acquires data (such as vehicle speed data) generated by the vehicle.

927 928 929 930 930 931 The content playerreproduces content stored in a storage medium (such as a CD and a DVD) that is inserted into the storage medium interface. The input deviceincludes for example a touch sensor configured to detect touch on a screen of the display device, a button or a switch, and receives an operation or information inputted from a user. The display deviceincludes a screen of an LCD or OLED display for example, and displays an image with a navigation function or the reproduced content. The loudspeakeroutputs a sound with a navigation function or the reproduced content.

933 933 934 935 934 935 937 933 934 935 933 934 935 933 934 935 933 934 935 16 FIG. 16 FIG. The wireless communication interfacesupports any cellular communication scheme (such as LTE and LTE-Advanced), and performs wireless communication. The wireless communication interfacemay usually include, for example, a BB processorand an RF circuitry. The BB processormay perform, for example, encoding/decoding, modulating/demodulating, and multiplexing/demultiplexing, and performs various types of signal processing for wireless communication. Meanwhile, the RF circuitrymay include for example a mixer, a filter and an amplifier, and transmit and receive a wireless signal via the antenna. The wireless communication interfacemay be a chip module on which the BB processorand the RF circuitryare integrated. As shown in, the wireless communication interfacemay include multiple BB processorsand multiple RF circuitries. Althoughshows an example in which the wireless communication interfaceincludes multiple BB processorsand multiple RF circuitries, the wireless communication interfacemay include a single BB processoror a single RF circuitry.

933 933 934 935 Furthermore, in addition to a cellular communication scheme, the wireless communication interfacemay support another type of wireless communication scheme, such as a short-distance wireless communication scheme, a near field communication scheme and a wireless LAN scheme. In this case, for each of the wireless communication schemes, the wireless communication interfacemay include a BB processorand an RF circuitry.

936 937 933 Each of the antenna switchesswitches connection destinations of the antennasamong multiple circuitries (such as circuitries for different wireless communication schemes) included in the wireless communication interface.

937 933 920 937 920 937 920 937 16 FIG. 16 FIG. Each of the antennasincludes one or more antenna elements (such as multiple antenna elements included in a MIMO antenna) and is used by the wireless communication interfaceto transmit and receive wireless signals. As shown in, the vehicle navigation apparatusmay include multiple antennas. Althoughillustrates the example in which the vehicle navigation apparatusincludes the multiple antennas, the vehicle navigation apparatusmay include a single antenna.

920 937 936 920 Furthermore, the vehicle navigation apparatusmay include the antennafor each wireless communication scheme. In that case, the antenna switchesmay be omitted from the configuration of the vehicle navigation apparatus.

938 920 938 16 FIG. The batterysupplies power to each block of the vehicle navigation apparatusshown invia feeder lines which are partially shown with dashed lines in the drawing. The batteryaccumulates power supplied from the vehicle.

920 202 200 933 921 921 201 202 16 FIG. In the vehicle navigation apparatusshown in, the communication unitand the transceiver of the electronic apparatusmay be implemented by the wireless communication interface. At least part of the functions may also be implemented by the processor. For example, the processormay implement the training of the local learning model and timely update of the global model by performing functions of the training unitand the communication unit.

940 920 941 942 942 941 The technology of the present disclosure may be implemented as an in-vehicle system (or a vehicle)including the vehicle navigation apparatus, the in-vehicle networkand one or more blocks of and a vehicle module. The vehicle modulegenerates vehicle data (such as a vehicle speed, an engine speed and fault information), and outputs the generated data to the in-vehicle network.

The basic principle of the present disclosure has been described above in conjunction with specific embodiments. However, it should be noted that for those skilled in the art, all or any of the steps or components of the method and apparatus according to the disclosure can be implemented in a form of hardware, firmware, software or a combination thereof in any computing device (including a processor, a storage medium and the like) or a network of computing devices. Such implementation can be realized by those skilled after reading the description of the present disclosure, by utilizing general knowledge in circuitry design or general programming skills.

Moreover, a program product in which machine-readable instruction codes are stored is further provided according to the present disclosure. The instruction codes, when read and executed by the machine, perform the aforementioned methods according to the embodiments of the present disclosure.

Accordingly, a storage medium for carrying the program product storing the machine-readable instruction codes is further provided according to the present disclosure. The storage medium includes, but is not limited to, a floppy disk, an optical disk, a magneto-optical disk, a storage card, a memory stick, and the like.

1700 17 FIG. In a case that the present disclosure is implemented with software or firmware, a program constituting the software is installed in a computer with a dedicated hardware structure (such as the universal computershown in) from a storage medium or network. The computer is capable of implementing various functions when installed with various programs.

17 FIG. 1701 1702 1708 1703 1703 1701 1701 1702 1703 1704 1705 1704 In, a central processing unit (CPU)executes various processing according to a program stored in a read-only memory (ROM)or a program loaded from a storage partto a random-access memory (RAM). In the RAM, data required for performing various processing by the CPUis also stored as required. The CPU, the ROMand the RAMare connected with each other via a bus. An input/output interfaceis connected to the bus.

1705 1706 1707 1708 1709 1709 1710 1705 1711 1710 1708 The following components are connected to the input/output interface: an input part(including a keyboard, a mouse and the like), an output part(including displays such as cathode ray tube (CRT) and liquid crystal display (LCD), a loudspeaker and the like), a memory part(including hard disc and the like), and a communication part(including a network interface card such as LAN card, a modem and the like). The communication partperforms communications via a network such as the Internet. A drivermay also be connected to the input/output interfaceas required. A removable medium, such as magnetic disk, optical disk, magnetic optical disk and semiconductor memory and the like, may be mounted to the driveras required, so that the computer program read therefrom is mounted to the storage partas required.

1711 In the case of implementing the above processing in software, the program constituting the software is mounted from a network, such as the Internet, or from a storage medium, such as the removable medium.

1711 1711 1702 1708 17 FIG. It is to be understood by those skilled in the art that, this storage medium is not limited to the removable medium, as shown in, which stores the program and is distributed separately from the apparatus to provide the program for the user. Examples of the removable mediuminclude a magnetic disk (including soft disk (registered trademark)), optical disk (including compact disk read-only memory (CD-ROM) and digital video disk (DVD)), magnetic optical disk (including mini disk (MD) (registered trademark)), and semiconductor memory. Alternatively, the storage medium may be the ROM, the hard disk included in the storage partor the like. The storage medium stores a program and is distributed to the user along with an apparatus in which the storage medium is incorporated.

It should be further noted that, in the apparatus, method and system according to the present disclosure, the components or steps may be decomposed and/or recombined. These decompositions and/or re-combinations shall be regarded as equivalent solutions of the disclosure. Furthermore, the above series of processing steps may naturally be performed temporally in the sequence as described above but are limited thereto. Some steps may be performed in parallel with or independently from each other.

At last, it should be noted that terms “include”, “comprise” or any variants thereof are intended to be non-exclusive. Therefore, a process, method, article or apparatus including a series of elements includes not only the elements but also other elements that are not enumerated, or further includes the elements inherent to the process, method, article or apparatus. Unless expressively limited otherwise, the element defined by the statement “including a . . . ” does not exclude existence of other same elements in the process, method, article or apparatus.

Although the embodiments of the present disclosure are described in detail above with reference to the accompanying drawings, it should be understood that the implementations described above are only for explaining the present disclosure and do not limit the present disclosure. Those skilled in the art can make various modifications and changes to the above implementations without departing from the essence and scope of the present disclosure. Therefore, the scope of the present disclosure is defined only by the appended claims and equivalents thereof.