Vehicle information display system, vehicle information display device, and vehicle control system

This application is a § 371 U.S. National Phase of International Application Serial No.: PCT Application No.: PCT/JP2020/024794 filed Jun. 24, 2020, which in turn claims priority to Japanese Patent Application Serial No.: 2019-121131 filed Jun. 28, 2019, Japanese Patent Application Serial No.: 2019-121132 filed Jun. 28, 2019, and Japanese Patent Application Serial No.: 2019-121133 filed Jun. 28, 2019. The entire disclosure of all the above documents is herein incorporated by reference.

The present invention relates to a vehicle information display system, a vehicle information display device, and a vehicle control system that display information to users of an automated vehicle.

The present invention relates to a vehicle information display device that displays information to users of an automated vehicle.

Conventionally, technologies for vehicle display systems have been known that display information about a vehicle to pedestrians around the vehicle and the drivers of other vehicles. For example, Patent Document 1 describes a technology having a display that is visible from the outside of the vehicle and a distance sensor that measures the distance from the vehicle to an object around the vehicle, whereby the content of the display changes according to the distance.

In recent years, the development of technologies has also been underway to operate an unmanned autonomous vehicle from the outside thereof and move it to a desired location, such as a parking lot or a dispatch location. For example, Patent Document 2 (paragraphs 0114 to 0115 of the specification andof the drawings, in particular) discloses a technology for receiving an automatic parking instruction signal from a mobile device and executing automatic parking based on the parking location information in the automatic parking instruction signal.

However, according to the technology of Patent Document 1, for example, when it is desirable to have a user confirm information on the use of a share car, the user's personal information and the information on the use of the share car is shown on the display, potentially allowing others in the vicinity to see the privacy and security-related information.

Therefore, an object of the present invention is to provide a vehicle information display system that is capable of displaying information to a user outside of the vehicle while taking into consideration the privacy and security of the user.

In addition, according to the technology of Patent Document 2, even if there appears to be enough space to pull up the car to the human eye, certain autonomous driving systems set a very large intervehicular distance, making it difficult to save parking space. Another problem is that it takes time and effort to reference the method for setting up and operating the mobile device and also to learn how to use it.

Therefore, an object of the present invention is to provide a vehicle control system for an autonomous vehicle that can easily pull the vehicle up to a desired location from the outside of the vehicle.

In order to solve the foregoing problems, a vehicle information display system according to the present invention provides a vehicle information display system for displaying predetermined information to a user, the system characterized by comprising a plurality of display means for displaying the information and a control means for controlling the display means, wherein the control means includes a display destination selection means for selecting the display means according to a content of the information.

The system comprises a sensor for measuring an environment on which information is displayed by the display means, and the display destination selection means is capable of selecting the display destination according to a result of measurement by the sensor.

The display means includes a display and a drawing light for outputting the information and projection objects on which the drawing light projects the information, If the information includes information related to security or privacy, the control means displays an instruction concerning a projection object on the display.

Furthermore, in order to solve the above-described problems, a vehicle information display device according to the present invention provides a vehicle information display device for displaying predetermined information to a user, the device characterized by comprising a drawing light for projecting the information to an outside of a vehicle and a sensor for detecting a user, wherein the drawing light starts projection when the sensor detects at least a part of the body of the user in a projection range of the drawing light.

In order to solve the foregoing problems, a vehicle control system according to the present invention is characterized by comprising a sensor mounted on an autonomous vehicle, a control means for controlling the vehicle based on an input from the sensor, and a vehicle drive mechanism for driving the vehicle based on a control signal that is input from the control means, wherein the sensor detects a gesture of a person in a vicinity of the vehicle, wherein the control means includes a recognition means for recognizing the gesture as an instruction for moving the vehicle, and wherein the vehicle drive mechanism moves the vehicle based on the instruction.

The vehicle information display system of the present invention is provided with a display destination selection means for selecting a display means according to a content of the information displayed. Accordingly, if the information contains information related to the privacy and security of the user, a display means that is not easily visible to a stranger is selected, thus providing an effect of displaying information while taking the privacy and security of the user into consideration.

According to the vehicle information display device of the present invention, the drawing light starts projection when the sensor detects at a least part of the body of a user in a projection range of the drawing light. Accordingly, there is provided an effect of allowing the user to confirm the information displayed on the user's own body and protecting the privacy and security of the user.

Furthermore, according to the vehicle control system of the present invention, a gesture of a person in the vicinity of the autonomous vehicle is detected at the sensor to move the vehicle based on the gesture. An effect is provided of pulling up the vehicle to a desired location based on the user's perception. As an additional effect, as the user can pull up the vehicle using a gesture similar to what has been conventionally made to a driver, there is no need to newly learn how to set up and use a device.

Embodiments of the present invention as a vehicle information display system, a vehicle information display device, and a vehicle control system installed in share autonomous cars will be described hereinafter based on the drawings.

As shown in, a vehicle information display systemof a share car, upon recognizing a user U who is to use the share car, draws an imageon the road surface that contains hospitality information such as “Welcome!” as well as usage information such as the destination and usage time.

As shown in, the vehicle information display systemis mounted on a side moduleto display information mainly to the outside of the vehicle body. An AD marker (autonomous driving marker)for indicating an autonomous driving state is provided on the periphery of the side module.

As shown in, the vehicle information display systemincludes display unitsfor displaying predetermined information to the user U, a camerafor detecting the user U, who is to use the share car, a sensorfor measuring the environment on which a display unitshows information, a memory unitfor storing information to be presented to the user U, an external serverfor delivering, via cloud communication or wired communication, information to be presented to the user U, a control unitfor controlling the display units, an actuatorfor adjusting the position and orientation of display units, and an interfacefor receiving information delivered by the external server. It should be noted that a LiDAR, a millimeter wave radar, a voice sensor, etc., can be employed as the sensor.

The display unitsinclude a display, drawing lightsthat draw images generated by an image generation unit, and projection objectson which the drawing lightsproject the images. The projection objectsinclude a screen, a road surface, and the body of the user U, such as the palm of a hand and the lap. The screenis normally stored in the side moduleand is rolled out of the side moduleduring projection (see). The drawing lightscan be of a single type capable of drawing a fixed image, or a generative type capable of free drawing using a DMD (Digital Micromirror Device) or other devices.

The control unitincludes an image generation unitfor generating an imageto be displayed with the display unitsbased on information input from the memory unitor the external server, and a display destination selection unitfor selecting a display unitwith which to display the information according to the content of the information.

The display destination selection unitperforms face recognition of the user U based on the person photographed by the cameraand the usage information about the share carobtained from the external server. Subsequently, once the user U is detected, it selects a display destination according to the content of the information to be displayed and the environment on which it is to be displayed.

The display destination selection unitselects either the displayor the road surfaceas the display destination if the content of the information to be displayed does not include information related to security or privacy, such as “Welcome!” for example. In addition, the display destination selection unitdetermines whether or not the road surfaceis suitable as a display environment based on the measurement results received from the sensor. The road surfacemay not be suitable as a display environment, for example, if there is a step on the road surfacethat may distort the drawing, or if the road surfaceis wet with rain or covered with snow, making it difficult to read the information drawn thereon.

If the display destination selection unitdetermines that the road surfaceis suitable as a projection object, it selects the drawing lightsand the road surfaceas the display destinations. Then, the image generation unitgenerates an imagefor display based on the information to be displayed to the user U, and the control unitoutputs the imageto the drawing lights. Conversely, if it is determined that the road surfaceis not suitable as a projection object, the displayis selected as the display destination. In this case, the control unitcauses the imageto be shown on the display.

If the content of the information to be displayed includes information related to security or privacy, for example, “Mr./Ms. ______” or “Your destination is ______,” the display destination selection unitfirst shows guidanceon the display. For example, as shown in, it may display “Please hold out your hand”. Then, the display destination selection unitdetects whether or not the designated projection object, i.e., a hand of the user U, is held out in a position where projection is possible, based on the measurement results received from the sensor.

If a hand of the user U is detected, the hand of the user U is selected as the display destination, and the control unitoutputs an imageto be displayed to the drawing lights. In this case, the user U can confirm the imageby looking at his or her palm. On the other hand, if no hand of the user U can be detected, the display destination selection unitselects the displayin security mode as the display destination, as shown in. For example, a display configured to allow the imageto be visible only from the front of the displaycan be employed as the displayin security mode.

As shown in, it is also possible to select the screenas the display destination, show “See the screen” on the display, and then roll out from the side modulethe screenon which the imageis projected.

It should be noted that, for some users U, it may be difficult to hold out their hands or check the screen. As shown in, for example, if it is found that the user U is in a wheelchair based on the information obtained from the external server, guidance, such as “Please move forward” or “Projection will be made on your lap,” is shown on the display. Then, if the display destination selection unitdetects the lap of the user U, the user U's lap is selected as the display destination, and subsequently, the control unitoutputs the imageto the drawing lights. In this way, the guidancecan be displayed according to the state of the user U, and a part of the body of the user U can be selected as required for use as a projection object.

Next, the operation of the vehicle information display systemwill be described with reference to. First, the display destination selection unitdetects the user U based on an image received from the camera(S) and obtains information to be displayed to the user U (S). If the obtained information does not include information related to security or privacy (S: No), it is determined whether or not it is possible to draw an image on the road surfacebased on the measurement results received from the sensor. If it is determined that it is possible (S: Yes), the display destination selection unitselects the road surfaceas the display destination, and the control unitoutputs an imagegenerated at the image generation unitto the drawing lightsbased on the information to be displayed (S, S). Conversely, if it is determined that drawing cannot be performed, the display destination selection unitselects the displayas the display destination, and the control sectiondisplays the imageon the display(S).

On the other hand, if the obtained information includes information related to security or privacy (S: Yes), the process goes into security mode. First, the display destination selection unitshows guidanceconcerning a projection object, such as “Please hold out your hand,” on the display (S). If the display destination selection unitdetects the projection objectbased on the measurement results of the sensor(S: Yes), the specified projection objectis selected as the display destination, and the control unitoutputs the imageto the drawing lights(S, S). If no projection objectis detected (S: No), the imageis shown on the displayin security mode (S).

According to the foregoing configuration of the vehicle information display system, as a display destination is selected based on a plurality of conditions, including the content of the information to be displayed to the user U and the environment on which the information is to be displayed, the system provides the effect of allowing the information to be displayed in a more suitable environment while giving consideration to the privacy and security of the user U.

As shown in, a vehicle information display device, upon recognizing a user U who is to use the share car, displays “Welcome!” and other hospitality information on a display, and outputs from the drawing lightsan imageincluding usage information, such as a destination and a usage schedule. In addition, an AD marker (autonomous driving marker)for indicating an autonomous driving state is provided on the periphery of a vehicle information display device. The vehicle information display deviceis capable of receiving advertisements, news items, etc., from an external serverand successively displaying them on the displaywhile the vehicle is running with the user U aboard.

As shown in, the vehicle information display deviceis provided with the displayfor displaying predetermined information to the user U, the drawing lights, a screen, a camerafor detecting the user U, who is to use the share car, a sensorfor measuring the environment on which the display unitdisplays information, a memory unitfor storing information to be presented to the user U, an external serverfor distributing information to be presented to the user U by cloud communication or wired communication, a control unitfor controlling the vehicle information display device, an actuatorfor adjusting the position in which an image is drawn and the output direction of the drawing lights, and an interfacefor receiving information delivered by the external server. Then, the sensoralso functions as a sensor to detect the user U. It should be noted that a LiDAR, a millimeter wave radar, a voice sensor, etc., can be employed as the sensor.

The display unitsinclude the display, the drawing lightsfor drawing an image generated by the image generation unit, and projection objectson which the drawing lightsproject the image. The projection objectsinclude the screen, a road surface, and at least a part of the user U's body, such as the palms of the hands and the lap. The screenis normally stored in the vehicle information display deviceto be rolled out of the vehicle information display deviceduring projection (see). The drawing lightscan be of a single type capable of drawing a fixed image, or a generative type capable of free drawing using a DMD (Digital Micromirror Device) or other devices.

The control unitincludes an image generation unitfor outputting an imageto be displayed from the displayor the draw lightsbased on information input from the memory unitor the external server, and a display destination selection unitfor selecting a display unitwith which to display the information according to the content of the information.

The display destination selection unitperforms face recognition of the user U based on an image of the user U photographed by the cameraand the usage information about the share carobtained from the external server. Then, once the user U is detected, it selects a display destination according to the content of the information to be displayed and the environment on which it is to be displayed.

The display destination selection unit, for example, selects either the displayor the road surfaceas the display destination if the content of the information to be displayed does not include information related to security or privacy, such as the hospitality image “Welcome!” In addition, the display destination selection unitdetermines whether or not the road surfaceis suitable as a display environment based on the measurement results received from the sensor. The road surfacemay not be suitable as a display environment, for example, if there is a step on the road surfacethat may distort the drawing, or if the road surfaceis wet with rain or covered with snow, making it difficult to read the information drawn thereon.

If the display destination selection unitdetermines that the road surfaceis suitable as a projection object, the unit selects the drawing lightsand the road surfaceas the display destinations. Then, the image generation unitgenerates an imagefor display based on the information to be displayed to the user U, and the control unitoutputs the imageto the drawing lights. Conversely, if it is determined that the road surfaceis not suitable as a projection object, the displayis selected as the display destination. In this case, the control unitcauses the imageto be shown on the display.

If the content of the information to be displayed includes information related to security or privacy, for example, “Mr./Ms. ______,” “Your destination is ______,” credit card information, information about a financial institution the user has transactions with, the user's address, and family information, the display destination selection unitfirst shows guidanceon the display. For example, it may display “Please hold out your hand” as shown in. Then, the display destination selection unitdetects whether or not the designated projection object, i.e., a palm of the user U, is held out in a position where projection is possible, based on the measurement results received from the sensor.

If the sensordetects a hand of the user U, which is at least a part of the body of the User U, in the projection range A of the drawing lights, the hand of the user U is selected as the display destination, and thereupon the control unitoutputs the imageto be displayed to the drawing lights. Subsequently, the drawling lightsstart making projection on the hand of the user U. In this case, the user U can confirm the imageby looking at his or her palm. On the other hand, if no hand of the user U can be detected, the display destination selection unitselects the displayin security mode as the display destination, as shown in. For example, a displayconfigured to allow the imageto be visible only from the front of the displaycan be employed as the displayin security mode.

As shown in, it is also possible to select the screenas the display destination, show “See the screen” on the display, and then roll out from the vehicle information display devicethe screenon which the imageis projected.

It should be noted that, for some users U, it may be difficult to hold out their hands or check the screen. As shown in, for example, if it is found that the user U is in a wheelchair based on the information obtained from the external server, guidance, such as “Please move forward” or “Projection will be made on your lap,” is shown on the display. If the lap of the user U, which is at least a part of the body of the User U, is detected in the projection range A of the drawing lights, the display destination selection unitselects the lap of the user U as the display destination, and thereupon the control unitoutputs the imageto the drawing lights. Subsequently, the drawing lightsstart projection. In this way, the guidancecan be displayed according to the state of the user U, and a part of the body of the user U can be selected as required for use as the projection object.

Next, the operation of the vehicle information display devicewill be described with reference to. First, the display destination selection unitdetects the user U based on the image received from the camera(S) and obtains information to be displayed to the user U (S). If the obtained information does not include information related to security or privacy (S: No), it is determined whether or not it is possible to draw an image on the road surfacebased on the measurement results received from the sensor. If it is determined that it is possible (S: Yes), the display destination selection unitselects the road surfaceas the display destination, and the control unitoutputs the imagegenerated by the image generation unitto the drawing lightsbased on the information to be displayed (S, S). Conversely, if it is determined that drawing cannot be performed, the display destination selection unitselects the displayas the display destination, and the control sectiondisplays the imageon the display(S).

On the other hand, if the obtained information includes information related to security or privacy (S: Yes), the process enters the security mode. First, the display destination selection unitshows guidanceconcerning the projection object, such as “Please hold out your hand,” on the display (S). If the display destination selection unitdetects the projection objectbased on the measurement results of the sensor(S: Yes), the specified projection objectis selected as the display destination, and the control unitoutputs the imageto the drawing lights(S, S). If no projection objectis detected (S: No), the imageis shown on the displayin security mode (S).

According to the vehicle information display devicewith the above configuration, the drawing lightsare configured to start projecting if the sensordetects at least a part of the user's body as the projection objectwithin the projection range A of the drawing lights. Therefore, the user U can check the information while concealing it from the eyes of others with his/her own body. This provides an effect of displaying information about user U's privacy and security in a way that is difficult for others to see.

As shown in, a vehicle control systemincludes a side modulethat includes a sensormounted on an autonomous vehicle, a control unitfor controlling the vehiclebased on the input from the sensor, a vehicle drive mechanismfor driving the vehiclebased on a control signal that is input from the control unit, and a second drawing light(see) for projecting on the road surface an imagethat shows minimum units of movement. The vehicle drive mechanismalso includes a mechanism, such as driving wheels, for moving the vehicle. As used herein, a minimum unit of movement represents a minute movement distance d (see) by which to move the vehicledue to the minute activation of the vehicle drive mechanismaccording to a signal pulse in a control signal generated by the control unit.

The side moduleincludes display units, such as a displayfor displaying predetermined information to a user U, first drawing lights, and a screen, a camerafor performing face recognition of the user U in the vicinity of the vehicle, the sensorfor detecting a gesture and voice of the user U, a memory unitfor storing information to be outputted to the displayand/or the first and second drawing lightsand, and an interfacefor transmitting control signals from the control unitto the vehicle drive mechanismand the second drawing light. The interfacealso includes functionality for receiving information delivered by an external server (not shown).