A transportation vehicle, infrastructure component, apparatus, computer program, and method for a transportation vehicle configured to be remotely operated by a remote driver in a remote driving mode and to be operated at least partially automatically in an automated driving mode. The method includes determining automated driving preferences of the transportation vehicle from driving behavior of the transportation vehicle, predicting information on a future traffic situation for switching from the remote driving mode to the automated driving mode, determining a predicted quality of service (pQoS) of a communication link to obtain a remote operation interval for which the transportation vehicle is at least operable in the remote driving mode, obtaining a handover duration for taking over control by the transportation vehicle for switching from the remote driving mode to the automated driving mode, and deciding for or against switching from the remote driving mode to the automated driving mode.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method for a transportation vehicle configured to be remotely operated in a remote driving mode and to be operated at least partially automatically in an automated driving mode, the method comprising:
2. The method of, wherein predicting information on the future traffic situation further comprises predicting the information on one or more present control commands of a remote driver operating the transportation vehicle in the remote driving mode, information on the remote driver, information on a planned route, and/or information on driving behavior of the remote driver.
3. The method of, wherein the handover duration comprises at least one of a reaction time of a remote driver operating the transportation vehicle in the remote driving mode, a communication latency of communication, and a reaction time of the transportation vehicle for switching from the remote driving mode to the automated driving mode.
4. The method of, further comprising determining, based on the information on the future traffic situation, a handover time and/or handover place for switching from the remote driving mode to the automated driving mode within the remote operation interval.
5. The method of, wherein the automated driving capabilities comprise one or more conditions for the future traffic situation, and wherein the switching from the remote driving mode to the automated driving mode comprises:
6. The method of, wherein the conditions comprise conditions for an acceleration, deceleration, speed, steering angle of the transportation vehicle, distance to one or more surrounding transportation vehicles, and/or a road profile in the traffic situation.
7. The method of, further comprising causing the transportation vehicle or requesting a remote driver to adapt driving parameters affecting the future traffic situation to fulfill the conditions within the remote operation interval.
8. The method of, wherein the predicting the information on the future traffic situation comprises predicting a plurality of future traffic situations and a comparison of the automated driving capabilities and the plurality of future traffic situations.
9. The method of, wherein the method is executed on a data processing circuit remote from the transportation vehicle.
10. The method of, wherein the switching from the remote driving mode to the automated driving mode to control the vehicle under automated control comprises deciding against switching from the remote driving mode to a manual driving mode of the transportation vehicle to enable manual control of the transportation vehicle.
11. A non-transitory computer readable medium including a computer program having program code for performing the method of, when the computer program is executed on a computer, a processor, or a programmable hardware component.
12. An apparatus comprising:
13. A transportation vehicle comprising the apparatus of.
14. An infrastructure component comprising the apparatus of.
15. The apparatus of, wherein the prediction of the information on the future traffic situation further comprises predicting the information on one or more present control commands of a remote driver operating the transportation vehicle in the remote driving mode, information on the remote driver, information on a planned route, and/or information on driving behavior of the remote driver.
16. The apparatus of, wherein the handover duration comprises at least one of a reaction time of a remote driver operating the transportation vehicle in the remote driving mode, a communication latency of communication, and a reaction time of the transportation vehicle for switching from the remote driving mode to the automated driving mode.
17. The apparatus of, wherein the data processing circuit and the one or more interfaces are further configured to determine, based on the information on the future traffic situation, a handover time and/or handover place for switching from the remote driving mode to the automated driving mode within the remote operation interval.
18. The apparatus of, wherein the automated driving capabilities comprise one or more conditions for the future traffic situation, and wherein decision for or against switching from the remote driving mode to the automated driving mode includes determination in the remote operation interval, a period for which the future traffic situation fulfills the one or more conditions based on the information on the future traffic situation, and decision for or against switching from the remote driving mode to the automated driving mode based on a comparison of the handover duration with the period.
19. The apparatus of, wherein the conditions comprise conditions for an acceleration, deceleration, speed, steering angle of the transportation vehicle, distance to one or more surrounding transportation vehicles, and/or a road profile in the traffic situation.
20. The apparatus of, wherein the data processing circuit and the one or more interfaces are further configured to cause the transportation vehicle or request a remote driver to adapt driving parameters affecting the future traffic situation to fulfill the conditions within the remote operation interval.
21. The apparatus of, wherein the prediction of information on the the future traffic situation comprises prediction of a plurality of future traffic situations and a comparison of the automated driving capabilities and the plurality of future traffic situations.
22. The apparatus of, wherein the apparatus is executed on a data processing circuit remote from the transportation vehicle.
23. The apparatus of, wherein the switching from the remote driving mode to the automated driving mode to control the vehicle under automated control comprises deciding against switching from the remote driving mode to a manual driving mode of the transportation vehicle to enable manual control of the transportation vehicle.
Complete technical specification and implementation details from the patent document.
This patent application is a U.S. National Phase of International Patent Application No. PCT/EP2022/053168, filed 9 Feb. 2022, which claims priority to European Patent Application No. 21156143.6, filed 9 Feb. 2021, the disclosures of which are incorporated herein by reference in their entireties.
Illustrative embodiments relate to a transportation vehicle, an infrastructure component, an apparatus, a computer program, and a method for a transportation vehicle. In particular, illustrative embodiments relate to a concept for handover of control over a transportation vehicle when switching from remote driving mode to automated driving mode.
Several vehicle concepts provide for operating transportation vehicles in different modes for automated and remote driving, respectively. Remote driving is sometimes referred to as “tele-operated driving (ToD)”. In such concepts, transportation vehicles, e.g., are operated at times in a remote driving mode where a remote driver operates the transportation vehicle from remote and at other times in an automated driving mode where the transportation vehicle is operated at least partially automatically. To this end, it may be desired to switch from the remote driving mode to the automated driving mode while driving and in a safe way. Switching from the remote driving mode to the automated driving mode, e.g., is necessary when a connectivity of a transportation vehicle to a remote control center operating the transportation vehicle from remote becomes insufficient for remote driving. One challenge in switching from the remote driving mode to the automated driving mode is to provide a safe and seamless handover of control over the transportation vehicle.
Document DE 10 2019 204943 A1 refers to a concept for teleoperated driving which provides for adjusting the teleoperated driving based on a predicted quality of service of a communication connection between a transportation vehicle and a control center.
Document EP 3 279 053 A1 refers to an operator-evaluation system for an automated transportation vehicle which includes a traffic-detector and a controller. The traffic-detector is used to determine a complexity-ranking of a traffic-scenario approached by a host-vehicle. The controller is in communication with the traffic-detector and is configured to operate the host-vehicle, depending on the complexity-ranking and a skill-ranking of an operator in an automated-mode, monitored mode, or manual mode.
Document US 2020/192360 A1 relates to a concept of determining a risk of operating a transportation vehicle in a current mode and switching modes.
Document US 2020/0077278 A1 relates to a method for predicting a quality of service for a communication between at least two moving communication partners, wherein the prediction is based on at least one link-based quality of service map that is updated in a link-based QoS map generation process.
Document US 2020/0218253 A1 relates to a concept for switching between teleoperation and autonomous operation of a control agent on a task by task basis and based on context for the agent. In particular, this document discloses a hybrid control system including the control agent and a control engine. The control engine is configured to install a master plan to the control agent. The master plan includes a plurality of high-level-tasks. The control agent is configured to operate according to the master plan, to obtain one or more low-level controls for the high-level tasks, and to perform the one or more low-level controls to realize the high level task. Also, the document proposes to adapt controls (e.g., for controlling a steering angle) in the teleoperation to controls in the autonomous operation in the transition for a smooth handover.
Document U.S. Pat. No. 5,307,271 discloses a control system for a remotely controlled transportation vehicle. The control system comprises a supervisory control system which receives supervisory speed and turn rate commands from a human operator which are provided to a servo-controlled transportation vehicle. Also, the control system comprises an obstruction detection system and a collision avoidance control system configured to disable the supervisory speed and turn rate commands when the obstruction detection system detects an obstruction to avoid the obstruction, and to enable the enable the supervisory speed and turn rate commands after the obstruction is avoided to return control to the human operator.
However, in applications of teachings from the documents, a control system of a transportation vehicle, which operates the transportation vehicle automatically, may have trouble to take over control in some situations, e.g., where the transportation vehicle needs to automatically perform complex maneuvers.
Hence, there may be a demand for an improved concept for transferring control of a transportation vehicle when switching from a remote driving mode to an automated driving mode of the transportation vehicle.
This demand may be satisfied by the subject-matter of the appended independent and dependent claims.
Disclosed embodiments are based on the finding that switching from a remote driving mode to an automated driving mode of a transportation vehicle is particularly safe when and/or where it is suitable for the transportation vehicle (e.g., for a system of the transportation vehicle which operates the transportation vehicle automatically) to take over control. In particular, a transition of control is safe when it happens seamlessly, i.e., when control over the transportation vehicle is transferred as long as remote driving is available.
Disclosed embodiments provide a method for a transportation vehicle configured to be remotely operated in a remote driving mode and to be operated at least partially automatically in an automated driving mode. The method comprises determining automated driving preferences of the transportation vehicle from driving behavior of the transportation vehicle. Also, the method comprises predicting information on a future traffic situation for switching from the remote driving mode to the automated driving mode based on the automated driving preferences. Further, the method comprises determining a predicted quality of service (pQoS) of a communication link for the remote driving mode to obtain, based on the predicted quality of service, a remote operation interval for which the transportation vehicle is at least operable in the remote driving mode. The method also comprises obtaining a handover duration for taking over control by the transportation vehicle for switching from the remote driving mode to the automated driving mode. Further, the method comprises deciding for (in favor of) or against (versus) switching from the remote driving mode to the automated driving mode based on the information on the future traffic situation, the remote operation interval, and the handover duration. The information on the future traffic situation, e.g., indicates when and/or where it is suitable, safe, and temporally manageable for the transportation vehicle to take over control. So, together with the pQoS this particularly allows to determine whether a transition of control is safe and temporally manageable while the transportation vehicle is operable in the remote driving mode to coordinate safe and/or to avoid unsafe transitions of control.
Predicting information on the future traffic situation may comprise predicting the information on the future traffic situation based on information on a current traffic situation, information on one or more present control commands of a remote driver operating the transportation vehicle in the remote driving mode, information on the remote driver, information on a planned route, and/or information on driving behavior of the remote driver. Existing concepts, e.g., allow to switch driving modes (e.g., from remote driving mode to automated driving mode) merely when the transportation vehicle stands still. The information on the current traffic situation, the planned route, the remote driver and/or on his or her driving behavior also allow to determine when and/or where the transportation vehicle can safely take over control from the remote driver while driving.
According to some exemplary embodiments, the handover duration comprises at least one of a reaction time of a remote driver operating the transportation vehicle in the remote driving mode, a communication latency of communication, and a reaction time of the transportation vehicle for switching from the remote driving mode to the automated driving mode. Thus, the handover duration allows a more profound decision for or against switching from the remote driving mode to the automated driving mode than, e.g., a default value for the handover duration.
In some exemplary embodiments, the method further comprises determining, based on the information on the future traffic situation, a handover time and/or handover place for switching from the remote driving mode to the automated driving mode within the remote operation interval. The handover time and/or the handover place, e.g., allow/s to coordinate processes at the transportation vehicle and a remote control center for operating the transportation vehicle from remote to provide a seamless transition of control in accordance with the handover time and/or handover place.
In some exemplary embodiments, predicting the future traffic situation comprises predicting the information on the future traffic situation based on a comparison of the automated driving preferences and one or more future traffic situations.
According to some exemplary embodiments, the automated driving preferences comprise one or more conditions for the traffic situation and deciding for or against switching from the remote driving mode to the automated driving mode comprises determining, based on the information on the future traffic situation, in the remote operation interval a period for which the future traffic situation fulfills the one or more conditions. Further, deciding for or against switching from the remote driving mode to the automated driving mode may comprise deciding for or against switching from the remote driving mode to the automated driving mode based on a comparison of the handover duration with the period. The conditions may prohibit switching in predefined traffic situations, e.g., while the transportation vehicle is going through a curve, a construction site, and/or when the transportation vehicle is in other situations challenging for automated driving. So, the conditions may allow a more secure handover of control over the transportation vehicle. Optionally, the conditions comprise conditions for an acceleration, deceleration, speed, steering angle of the transportation vehicle, distance to one or more surrounding transportation vehicles, and/or a road profile in the traffic situation which allow a more profound assessment of whether the future traffic situation is safe for switching from the remote driving mode to the automated driving mode than
In some exemplary embodiments, the method further comprises causing the transportation vehicle or requesting a remote driver to adapt driving parameters affecting the future traffic situation to fulfill the conditions. In this way, a suitable future traffic situation for switching from the automated driving mode to the remote driving mode may be actively created or forced. This, e.g., comes into play when the driving behavior of the remote driver is mostly or generally irreconcilable with the automated driving preferences of the transportation vehicle in the automated driving mode. For example, if the remote driver has a more offensive general style of driving than the transportation vehicle in the automated driving mode and, e.g., generally drives faster and/or with less distance to other transportation vehicles than proposed or indicated by the automated driving preferences.
In further exemplary embodiments, determining the automated driving preferences of the transportation vehicle comprises determining automated driving preferences of the transportation vehicle from driving behavior for different levels of automation (LoA) of the transportation vehicle and deciding for switching from the remote driving mode to the automated driving mode comprises selecting a LoA for the automated driving mode based on the information on the future traffic situation and the automated driving preferences of the different LoA. This allows to select an appropriate LoA for the automated driving mode. The higher the LoA, the less a human driver intervenes. So, the higher the LoA, the more challenging may be complex traffic situations for automated driving. Some situations, so-called “deadlock situations”, e.g., cannot be resolved, in a high LoA but only in lower LoA. The information on the future traffic situation, e.g., indicates how complex the future traffic situation is and, thus, which of the LoA are appropriate to maneuver the transportation vehicle in the future traffic situation for switching from the remote driving mode to the automated driving mode. Accordingly, the more complex the future traffic situation, the lower may be the selected LoA.
In some exemplary embodiments, the method is executed by the transportation vehicle.
Optionally, the method executed on a data processing circuit remote from the transportation vehicle. This allows to save resources (e.g., computing power, energy consumption) of the transportation vehicle.
In some exemplary embodiments, deciding against switching from the remote driving mode to the automated driving mode comprises deciding for switching from the remote driving mode to a manual driving mode of the transportation vehicle. Thus, a driver in the transportation vehicle can take over control of the transportation vehicle. So, this can prevent loss of control of the transportation vehicle, e.g., when remote driving is no longer available and a safe transition of control for switching to the automated driving mode is not manageable.
Other disclosed embodiments provide a computer program having a program code for performing at least one of the methods of the preceding claims, when the computer program is executed on a computer, a processor, or a programmable hardware component.
Further disclosed embodiments provide an apparatus comprising one or more interfaces for communication and a data processing circuit configured to control the one or more interfaces. Further, the data processing circuit and the one or more interfaces are configured to execute one of the methods proposed herein.
Other disclosed embodiments provide a transportation vehicle or an infrastructure component comprising the apparatus proposed herein.
Various example embodiments will now be described more fully with reference to the accompanying drawings in which some example embodiments are illustrated. In the figures, the thicknesses of lines, layers or regions may be exaggerated for clarity. Optional components may be illustrated using broken, dashed, or dotted lines.
Accordingly, while example embodiments are capable of various modifications and alternative forms, embodiments thereof are shown by way of example in the figures and will herein be described in detail. It should be understood, however, that there is no intent to limit example embodiments to the particular forms disclosed, but on the contrary, example embodiments are to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure. Like numbers refer to like or similar elements throughout the description of the figures.
As used herein, the term “or” refers to a non-exclusive or, unless otherwise indicated (e.g., “or else” or “or in the alternative”). Furthermore, as used herein, words used to describe a relationship between elements should be broadly construed to include a direct relationship or the presence of intervening elements unless otherwise indicated. For example, when an element is referred to as being “connected” or “coupled” to another element, the element may be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being “directly connected” or “directly coupled” to another element, there are no intervening elements present. Similarly, words such as “between”, “adjacent”, and the like should be similarly interpreted.
The terminology used herein is for the purpose of describing particular disclosed embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises”, “comprising”, “includes”, or “including”, when used herein, specify the presence of stated features, integers, operations, elements or components, but do not preclude the presence or addition of one or more other features, integers, operations, elements, components or groups thereof.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which example embodiments belong. It will be further understood that terms, e.g., those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Automated driving and remote driving play an increasingly important role in future mobility and transport services. Switching between driving modes for automated and remote driving can have several reasons: The transportation vehicle, e.g., is not able to handle a situation (so-called “deadlock situations”) and/or an operational design domain (ODD) for remote driving does not fulfill predefined requirements, e.g., connectivity to a remote control center for remote driving is insufficient or lost. In some situations, where the transportation vehicle is operated in the remote driving mode, a connectivity to the remote control center may become insufficient for remote driving. Hence, the transportation vehicle may need to switch from the remote driving mode to the automated driving mode. One main challenge is to have a safe transition of control over the transportation vehicle when switching from the remote driving mode to the automated driving mode. Another challenge is to select an appropriate level of automation (LoA) when switching from the remote driving mode to the automated driving mode.
Hence, there may be a demand for an improved concept for transferring control of a transportation vehicle when switching from a remote driving mode to an automated driving mode of the transportation vehicle.
illustrates a flowchart of an exemplary embodiment of a methodfor a transportation vehicle configured to be remotely operated in a remote driving mode and to be operated at least partially automatically in an automated driving mode. The transportation vehicle can be a car, a bus, a truck, or the like. For the remote driving mode, the transportation vehicle may communicate with a remote control center which exhibits equipment for a remote driver to control the transportation vehicle from remote. The remote operator, thus, can have full or at least partial control over the transportation vehicle and, e.g., maneuver the transportation vehicle, accelerate, decelerate, steer, and/or one or more functions (e.g., the electronic stability control, ESC, the anti-lock braking system, ABS, and/or the like) in the remote driving mode. Thus, a passenger or driver in the transportation vehicle may not need to maneuver the transportation vehicle himself or herself in the remote driving mode. In the remote driving mode, the transportation vehicle, e.g., monitors its environment using one or more (various) sensors (e.g., camera/s, lidar sensor/s, radar sensor/s, and/or the like) to provide the remote operator with information from the sensors, e.g., on a course of a road and/or traffic events in the environment to enable the remote operator to maneuver the transportation vehicle. In the automated driving mode, the transportation vehicle operates fully or partially automatically and/or autonomously. So, the transportation vehicle can be understood as a fully pr partly automated/autonomously driving transportation vehicle. Also, the transportation vehicle may be configured to be “manually” operated, i.e., by a (manual) driver in the transportation vehicle, in an manual driving mode.
In some scenarios, it is predicted that remote driving becomes unavailable, e.g., in view of an upcoming tunnel where a communication with the remote control center becomes unavailable due to a lost or insufficient communication link to the remote control center. Thus, it may be desired or necessary to switch from the remote driving mode to the automated driving mode. Also, other reasons, e.g., a request of the remote driver or the driver in the transportation vehicle can make it necessary or desirable to switch from the remote driving mode to the automated driving mode. Methodprovides a concept for doing this safely and seamlessly and to avoid unsafe and/or seamless transitions of control.
As can be seen from the flow chart, methodcomprises determiningautomated driving preferences of the transportation vehicle from driving behavior of the transportation vehicle (in the automated driving mode).
The driving behavior can be understood as a manner of driving of the transportation vehicle in the automated driving mode.
To determine the driving behavior, data related to the driving behavior may be collected in the automated driving mode. The data, e.g., comprises information on the transportation vehicle like, e.g., information on an acceleration (inD orD if available), speed/velocity (inD orD if available), steering angle, distance to one or more other transportation vehicles, a location of the transportation vehicle, and/or a road profile and/or geometry of a road travelled by the transportation vehicle. Accordingly, the driving behavior may be obtained from the collected data. The road profile, e.g., is indicative of a course of a road travelled by the transportation vehicle.
In particular, the driving behavior may depend on a level of automation for automated driving. So, the data may also comprise information on a level of automation (LoA) in the automated driving mode for determining automated driving preferences for different LoA. The transportation vehicle, e.g., has various LoA for automated driving. The LoA are, e.g., indicative of an amount of driver intervention and attentiveness which is required and/or which tasks the transportation vehicle performs automatically in a respective LoA. The LoA may be classified according to the J3016 standard of the Society of Automotive Engineers (SAE). Optionally, the LoA are classified differently. Thus, the driving behavior can be associated with the different LoA. This allows to obtain specific automated driving preferences, e.g., different sets of automated driving preferences for different LoA. In some exemplary embodiments, the automated driving preferences are determined by the transportation vehicle. To save resources of the transportation vehicle, the automated driving preferences are optionally determined remote from the transportation vehicle, e.g., by an infrastructure component. The data can be collected and transmitted to the infrastructure component with the same rate of cooperative awareness messages of the transportation vehicle. So, the rate may depend on the speed/velocity of the transportation vehicle. The higher the velocity, the higher may be the rate for a more accurate determination of the automated driving preferences.
To provide the infrastructure component with the collected data, the transportation vehicle and/or the infrastructure component, e.g., communicate via a communications network. The communications network may use one or more arbitrary communication technologies and/or standards to communicatively connect the transportation vehicle, the remote control center, and/or the infrastructure component. In particular, the communications network may be a mobile communications network. The (mobile) communications network may, for example, be or comprise an Orthogonal Time Frequency Space (OTFS) system or one of the Third Generation Partnership Project (3GPP)-standardized mobile communications networks. The communications network may correspond to or comprise a mobile communication system of the 4th or 5th Generation (4G, 5G) and may use mm-Wave technology. The communications network may correspond to or comprise, for example, a Long-Term Evolution (LTE), an LTE-Advanced (LTE-A), High Speed Packet Access (HSPA), a Universal Mobile Telecommunication System (UMTS) or a UMTS Terrestrial Radio Access Network (UTRAN), an evolved-UTRAN (e-UTRAN), a Global System for Mobile communication (GSM) or Enhanced Data rates for GSM Evolution (EDGE) network, a GSM/EDGE Radio Access Network (GERAN), or mobile communications networks with different standards, for example, a Worldwide Inter-operability for Microwave Access (WIMAX) network IEEE 802.16 or Wireless Local Area Network (WLAN) IEEE 802.11, generally an Orthogonal Frequency Division Multiple Access (OFDMA) network, a Time Division Multiple Access (TDMA) network, a Code Division Multiple Access (CDMA) network, a Wideband-CDMA (WCDMA) network, a Frequency Division Multiple Access (FDMA) network, a Spatial Division Multiple Access (SDMA) network, etc.
The infrastructure component, e.g., comprises or corresponds to a cloud system in the mobile communications network. In some exemplary embodiments, the collected data is processed using an appropriately trained artificial intelligence (AI) algorithms for determining the driving behavior and/or the automated driving preferences from the collected data.
The automated driving preferences, e.g., are indicative of a function, a mean, a maximum, or a minimum value for the velocity, the acceleration, steering angle, and/or the distance to other transportation vehicles. The automated driving preferences can be defined such that they indicate under which circumstances, e.g., for which speed, acceleration, distance to other transportation vehicles, and/or road profile it is safe for the transportation vehicle to take over control for autonomous/automated driving. The automated driving preferences can be also understood as “driving capabilities” of the transportation vehicle which represent circumstances under which the transportation vehicle is able to take over the control safely. Although the present disclosure is limited to the velocity, the acceleration, steering angle, and/or the distance to other transportation vehicles, it is noted that also one or more other or further criteria may be used to determine and/or represent the automated driving preferences.
In some exemplary embodiments, the driving behavior is defined by one or more predefined or default parameters or thresholds to which the transportation vehicle adheres in the automated driving mode. The parameters or thresholds, e.g., are indicative of bounds for the transportation vehicle's velocity, acceleration, and/or distance to other transportation vehicles.
Also, methodcomprises predictinginformation on a future traffic situation for switching from the remote driving mode to the automated driving mode based on the automated driving preferences. In context of the present disclosure, the (future) traffic situation can be understood as a momentary or temporary scene to which the transportation vehicle is exposed. Accordingly, the future traffic situation for switching from the automated driving mode to the remote driving mode can be understood as a momentary or temporary scene for which it may be convenient for the transportation vehicle to take over control with respect to the automated driving preferences. To determine the future traffic situation for switching from the remote driving mode to the automated driving mode, one or multiple estimated/predicted future traffic situations can be compared with the automated driving preferences. In particular, future traffic situations may be predicted based on information on a current traffic situation, information on one or more present control commands of a remote driver operating the transportation vehicle in the remote driving mode, information on the remote driver, information on a planned route, and/or information on driving behavior of the remote driver. The future traffic situation, e.g., is convenient/suitable for switching from the remote driving mode to the automated driving mode with regard to the automated driving preferences if the future traffic situation is reconcilable with the automated driving preferences. This, e.g., is the case if/when the transportation vehicle's acceleration, velocity, steering angle, and/or distance to other transportation vehicles in the future traffic situation differs no more than by a predefined deviation from the automated driving preferences. Also, the automated driving preferences may prohibit to switch from the remote driving mode to the automated driving mode while the transportation vehicle accelerates, brakes, turns, and/or is going through curves, construction sites, and/or other traffic situations which are challenging in automated driving. In practice, the information on the future traffic situation may be indicative of a time, a time interval, a position, and/or an area/road section where and/or when it is safe and/or convenient for the transportation vehicle to take over control. Also, the information on the future traffic situation may relate to multiple future traffic situations and, e.g., indicates multiple times, time intervals, positions, and/or areas/road sections where and/or when it is safe and/or convenient for the transportation vehicle to take over control.
The information on the planned route may be indicative of a road profile, road conditions, a course of the road, and/or locations where the transportation vehicle accelerates, turns, decelerates, or stops. So, the planned route as well as the information on a current traffic situation, information on one or more present control commands, on the remote driver (e.g., age, gender, etc.), and/or information on driving behavior of the remote driver may indicate when, where, the remote driver drives how fast, when and/or where the transportation vehicle is going through curves, construction sites, and/or how the remote driver accelerates, brakes, stops, turns, etc. It is a finding that it may be unsafe for the transportation vehicle to take over the control while the transportation vehicle accelerates, brakes, and/or turns. Accordingly, the future traffic situation may be a situation where the remote driver does not brake, accelerate, and/or change the direction of the transportation vehicle (too much). Thus, the information on the future traffic situation may bin indicative of a future traffic situation where and/or when the remote driver does not accelerate, brake, and/or turn according to the information on the remote driver and/or on his or her driving behavior, and/or the information on the planned route.
Further, methodcomprises determininga predicted quality of service (pQoS) of a communication link for the remote driving mode to obtain, based on the predicted quality of service, a remote operation interval for which the transportation vehicle is at least operable in the remote driving mode. The pQoS is, e.g., determined from a history of a quality of service (QoS) of the communication link and/or a location of the transportation vehicle. For example, it is known from the history that in preceding situations where the transportation vehicle entered a tunnel the QoS and/or the communication link worsens such that remote driving is not possible for a time in the tunnel. Thus, the pQoS can be determined from the location of the transportation vehicle and the history. The pQoS also may be determined in another way, e.g., from a past development of the QoS. The pQoS, e.g., allows to predict the remote operation interval for which the pQoS is sufficient for remote driving. The remote operation interval, e.g., is indicative of an area, a time, and/or a time interval for which a quality of service (e.g. data rate, latency, etc.) is sufficient for remote driving. The remote operation interval, e.g., is indicative of a time interval or road section when or where the pQoS is sufficient for remote driving between tunnels or other locations where the pQoS is insufficient.
Methodalso comprises obtaininga handover duration for taking over control by the transportation vehicle for switching from the remote driving mode to the automated driving mode. The handover duration comprises, e.g., communication latencies, processing latencies, and/or reaction times for transferring the control from the remote control center to the transportation vehicle, e.g., to a control system of the transportation vehicle for automated driving. The reaction times, e.g., comprise a reaction time of a remote driver operating the transportation vehicle in the remote driving mode, and/or a reaction time of the transportation vehicle for switching from the remote driving mode to the automated driving mode. The reaction time of the remote driver, e.g., is a duration that the remote driver takes to orchestrate the switching in response to a request to switch to automated driving. The reaction time of the transportation vehicle, e.g., is a duration that the transportation vehicle takes to take over the control. The handover duration, e.g., is a predefined duration or derived from previous measurements of it.
Also, methodcomprises decidingfor or against switching from the remote driving mode to the automated driving mode based on the information on the future traffic situation, the remote operation interval, and the handover duration. The information on the future traffic situation, the remote operation interval, and the handover duration allow to determine whether, where, and/or when a safe and seamless transition of control over the transportation vehicle is manageable. Accordingly, it is decided for switching from the remote driving mode to the automated driving mode if a safe and seamless transition is manageable and decided against the switching otherwise.
In some exemplary embodiments, decidingfor switching from the remote driving mode to the automated driving mode comprises selecting a LoA for the automated driving mode based on the information on the future traffic situation and the automated driving preferences of the different LoA.
Unknown
October 14, 2025
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.