A driver assistance system according to the present invention has an other-vehicle information acquisition unit that acquires travel direction information of an other-vehicle; a storage unit in which a spot where the visibility of a driver in a vehicle is reduced and information on a direction, associated with the spot, in which the visibility of the driver of the vehicle is reduced are stored in association with each other; a visibility determination unit that determines whether or not the visibility of a driver in the other-vehicle is reduced on the basis of the travel direction information acquired by the other-vehicle information acquisition unit and the information on the direction in which the visibility is reduced stored in the storage unit; and a warning processing unit that warns a driver of an own-vehicle that the visibility of the driver in the other-vehicle is reduced if the visibility determination unit determines that the visibility of the driver in the other-vehicle is reduced.
|
7. A driver assistance system that is mounted on an own-vehicle, the driver assistance system comprising:
processing circuitry to:
acquire travel direction information indicating a travel direction of an other-vehicle;
determine whether or not visibility of a driver in the other-vehicle is reduced on a basis of the acquired travel direction information of the other-vehicle and information on a direction in which visibility is reduced; and
if it is determined that the visibility of the driver in the other-vehicle is reduced, warn a driver of the own-vehicle that the visibility of the driver in the other-vehicle is reduced,
wherein the processing circuitry determines a possibility of a collision between the own-vehicle and the other-vehicle on a basis of travel direction information of the own-vehicle and travel direction information of the other-vehicle, and if it is determined that there is the possibility of the collision, warns that the visibility of the driver in the other-vehicle is reduced.
6. A driver assistance system comprising:
processing circuitry to:
determine whether or not visibility of a driver in a vehicle is reduced, and when the visibility of the driver in the vehicle is reduced, output position information of the vehicle and travel direction information of the vehicle;
store the position information of the vehicle and the travel direction information of the vehicle that are output, in association with each other; and
calculate an orientation of the sun,
wherein when the visibility of the driver in the vehicle is reduced and the vehicle is traveling at a particular spot, the processing circuitry outputs the position information of the vehicle and the travel direction information of the vehicle,
and when the visibility of the driver in the vehicle is reduced and the vehicle is traveling at a spot other than the particular spot, the processing circuitry determines whether or not the driver is directly exposed to light of the sun on a basis of information on the orientation of the sun and the travel direction information of the vehicle, and if the driver is directly exposed to the light of the sun, outputs the position information of the vehicle and the travel direction information of the vehicle.
1. A driver assistance system that is mounted on an own-vehicle, the driver assistance system comprising:
processing circuitry to:
acquire travel direction information indicating a travel direction of an other-vehicle;
store a spot where visibility of a driver in said own-vehicle is reduced and information on a direction, associated with the spot, in which the visibility of the driver in the own-vehicle is reduced, in association with each other;
determine whether or not visibility of a driver in the other-vehicle is reduced on a basis of the acquired travel direction information of the other-vehicle and the stored information on the direction in which the visibility is reduced; and
if it is determined that the visibility of the driver in the other-vehicle is reduced, warn a driver of the own-vehicle that the visibility of the driver in the other-vehicle is reduced,
wherein the processing circuitry determines a possibility of a collision between the own-vehicle and the other-vehicle on a basis of travel direction information of the own-vehicle and the acquired travel direction information of the other-vehicle, and if it is determined that there is the possibility of the collision, warns that the visibility of the driver in the other-vehicle is reduced.
2. The driver assistance system according to
wherein the processing circuitry acquires position information of the other-vehicle, and
determines, using the acquired position information, whether or not the visibility of the driver in the other-vehicle is reduced, the other-vehicle traveling within a specified range from the own-vehicle.
3. The driver assistance system according to
wherein the processing circuitry acquires position information of the other-vehicle, and
determines whether or not the visibility of the driver in the other-vehicle is reduced on a basis of the stored spot where the visibility is reduced, the spot where the visibility is reduced existing within a specified range from a position of the other-vehicle.
4. The driver assistance system according to
wherein the processing circuitry determines a direction in which the visibility of the driver in the other-vehicle is reduced on a basis of information on a road on which the other-vehicle is allowed to travel and the travel direction information of the other-vehicle, and
warns the driver of the own-vehicle about the direction in which the visibility is reduced.
5. The driver assistance system according to
wherein the processing circuitry controls operation of the own-vehicle if it is determined that there is a possibility of a collision between the own-vehicle and the other-vehicle.
|
|||||||||||||||||||||||||||||||||||||||||||||||||
The present invention relates to a driver assistance system that detects that the visibility of a driver in a vehicle is reduced and provides a warning.
Conventionally, there is disclosed a driver assistance device that calculates the position of the sun on the basis of the position of an own-vehicle and the current time, and further calculates the direction in which sunlight enters a driver's seat on the basis of the position of the sun and the travel direction of the own-vehicle (for example, see Patent Literature 1). This driver assistance device can warn in advance that the visibility of the driver in the own-vehicle is reduced by calculating the direction in which the sunlight enters the driver's seat.
Patent Literature 1: JP 2003-121159 A
However, although the driver assistance system described in Patent Literature 1 can detect that the visibility of the driver in the own-vehicle is reduced, it cannot detect that the visibility of a driver in an other-vehicle is reduced. Therefore, a problem is that even if the visibility of the driver in the own-vehicle is not reduced, if the visibility of the driver in the other-vehicle is reduced, there is a possibility that the other-vehicle may collide with the own-vehicle.
A driver assistance system according to the present invention has been made to solve the above-described problem, and aims to detect that the visibility of a driver in an other-vehicle is reduced and warn a driver in an own-vehicle.
A driver assistance system according to the present invention includes:
an other-vehicle information acquisition unit to acquire travel direction information of an other-vehicle;
a storage unit in which a spot where visibility of a driver in a vehicle is reduced and information on a direction, associated with the spot, in which the visibility of the driver in the vehicle is reduced are stored in association with each other;
a visibility determination unit to determine whether or not visibility of a driver in the other-vehicle is reduced on a basis of the travel direction information of the other-vehicle acquired by the other-vehicle information acquisition unit and the information on the direction in which the visibility is reduced stored in the storage unit; and
a warning processing unit to, if the visibility determination unit determines that the visibility of the driver in the other-vehicle is reduced, warn a driver of an own-vehicle that the visibility of the driver in the other-vehicle is reduced.
A driver assistance system according to the present invention includes:
a visibility reduction spot determination unit to determine whether or not visibility of a driver in a vehicle is reduced, and when the visibility of the driver in the vehicle is reduced, output position information of the vehicle and travel direction information of the vehicle; and
a storage unit to store the position information of the vehicle and the travel direction information of the vehicle that are output from the visibility reduction spot determination unit in association with each other.
A driver assistance system according to the present invention detects that the visibility of a driver in an other-vehicle is reduced and warns a driver in an own-vehicle, so that if the visibility of the driver in the other-vehicle is reduced, the driver of the own-vehicle can pay attention to the movement of the other-vehicle while driving.
A driver assistance system according to a first embodiment will be described below with reference to
The vicinity monitoring device 1 is a device that acquires vicinity information for calculating the position of the other-vehicle and the travel direction of the other-vehicle. For example, a radar, a lidar, a camera, and the like correspond to the vicinity monitoring device 1. The vicinity information refers to information on the distance between the own-vehicle and the other-vehicle acquired by the vicinity monitoring device being, for example, a radar or a lidar, image data imaged by a camera, and the like. In the following description, information on the position of the own-vehicle will be expressed as the position information of the own-vehicle, and information on the position of the other-vehicle will be expressed as the position information of the other-vehicle. Information on the travel direction of the own-vehicle will be expressed as the travel direction information of the own-vehicle, and information on the travel direction of the other-vehicle will be expressed as the travel direction information of the other-vehicle.
The processing device 2 is a device to determine whether or not the visibility of a driver in the other-vehicle is reduced. For example, a CPU (Central Processing Unit) corresponds to the processing device 2. Reduction in the visibility refers to a state in which the driver of the other-vehicle finds it difficult to see his or her surroundings when dazzled by sunlight or dazzled by sunlight reflecting off a building, a car, or the like. The processing device 2 has a visibility determination unit 21, an other-vehicle information acquisition unit 22, and a warning processing unit 23. The processing device 2 implements the functions of the other-vehicle information acquisition unit 22, the visibility determination unit 21, and the warning processing unit 23 to be described later by executing a program pre-stored in the storage device 3 or the like. The driver assistance system may be the processing device 2, or may have the processing device 2 and the server 7 to be described later.
The storage device 3 stores image data for warning to be displayed by the display device 4 to be described later and sound data for warning to be output by the speaker 5 to be described later when the processing device 2 determines that the visibility of the driver in the other-vehicle is reduced. In the following description, the image data for warning and the sound data for warning will be expressed as warning data.
The display device 4 displays an image for warning when the processing device 2 determines that the visibility of the driver in the other-vehicle is reduced. For example, a head-up display, an instrument panel, and a display for displaying road information of a car navigation system correspond to the display device 4. In this embodiment, it is described that the display device 4 is a head-up display, an instrumental panel, or a display for displaying road information of a car navigation system. However, the display device 4 is not limited to this, and may be a display of a device such as a smart phone or a tablet which is connected externally.
The speaker 5 outputs a sound for warning when the processing device 2 determines that the visibility of the driver in the other-vehicle is reduced. For example, a speaker or speakers attached to the front or the right and left sides in the vehicle to output music or road information of a car navigation system correspond to the speaker 5. Alternatively, the speaker 5 may be a speaker of a device such as a smart phone or a tablet externally connected to an on-board device such as a car navigation system.
The external communication device 6 communicates with an external device. For example, when the server 7 to be described later is an external server installed outside the vehicle, the external communication device 6 transmits and receives information to and from the server 7.
The server 7 has a visibility reduction spot information database.
The visibility reduction information detection device 8 is a device that acquires information for detecting that the visibility of the driver in the own-vehicle is reduced, and has an on-board camera or the like, for example. When the visibility reduction information detection device 8 is an on-board camera, the information for detecting that the visibility is reduced corresponds to image data of the face of the driver imaged by the on-board camera.
The own-vehicle position acquisition device 9 is a device that acquires the position information of the own-vehicle and the travel direction information of the own-vehicle. For example, the own-vehicle position acquisition device 9 acquires the position information of the own-vehicle a plurality of times at intervals using a GPS (Global Positioning System) or the like, and calculates the travel direction information of the own-vehicle from the position information of the own-vehicle that changes with time. The position information of the own-vehicle is, for example, information on the latitude and longitude where the own-vehicle is located, and the like. Note that the own-vehicle position acquisition device 9 may acquire the travel direction information of the own-vehicle from data of a CAN (Controller Area Network) (for example, information from a gyroscope sensor, a magnetic field sensor, or the like).
The visibility reduction spot determination device 10 determines whether or not the visibility of the driver in the own-vehicle is reduced. When it is determined that the visibility of the driver in the own-vehicle is reduced, the visibility reduction spot determination device 10 transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7.
The configuration of the processing device 2 will now be described in detail with reference to
The other-vehicle information acquisition unit 22 acquires the vicinity information from the vicinity monitoring device 1, and calculates the travel direction of the other-vehicle on the basis of this vicinity information. Note that a method for calculating the travel direction of the other-vehicle will be described later.
The visibility determination unit 21 determines whether or not the visibility of the driver in the other-vehicle is reduced on the basis of the travel direction information of the other-vehicle calculated by the other-vehicle information acquisition unit 22 and orientation information acquired from the server 7.
When the visibility determination unit 21 determines that the visibility of the driver in the other-vehicle is reduced, the warning processing unit 23 acquires at least one of the image data for warning and the sound data for warning from the storage device 3, and outputs it to the display device 4 or the speaker 5.
Note that the functions of the other-vehicle information acquisition unit 22, the visibility determination unit 21, and the warning processing unit 23 described above may be implemented by the processing device 2, or may be implemented in the server 7.
Processing by the driver assistance system according to the first embodiment to store the travel direction information of the own-vehicle in the visibility reduction spot information database will be described below with reference to
In ST100, the visibility reduction spot determination device 10 acquires the information for detecting that the visibility is reduced from the visibility reduction information detection device 8.
In ST200, the visibility reduction spot determination device 10 determines whether or not the visibility of the driver in the own-vehicle is reduced on the basis of the information for detecting that the visibility is reduced. A method for determining whether or not the visibility of the driver in the own-vehicle is reduced will be described in detail below with reference to
With reference to
With reference to
The image analysis unit 101 applies filter processing on the image data using a Sobel filter, and emphasizes edges of eyelids (ST102).
The image analysis unit 101 extracts a maximum value h in a vertical direction and a maximum value w in a horizontal direction from the pixel counts of the emphasized edges, as illustrated in
The image analysis unit 101 outputs information on the ratio h/w to the determination unit 103. The determination unit 103 determines the degree of openness of eyelids on the basis of the information on the ratio h/w acquired from the image analysis unit 101 (ST104). For example, the determination unit 103 is provided with a threshold in advance. If the ratio h/w is more than or equal to the threshold, the determination unit 103 determines that the visibility of the driver in the own-vehicle is reduced. If the ratio h/w is less than or equal to the threshold, the determination unit 103 determines that the visibility of the driver in the own-vehicle is not reduced. If it is determined that the visibility is reduced, the visibility reduction spot determination device 10 executes processing of ST300 in
In ST300, if it has been determined that the visibility of the driver in the own-vehicle is reduced, the visibility reduction spot determination device 10 acquires the position information of the own-vehicle and the travel direction information of the own-vehicle from the own-vehicle position acquisition device 9, and acquires the date and time at which it is determined that the visibility is reduced from time keeping means (not illustrated).
In ST400, the visibility reduction spot determination device 10 transmits information on the position of the own-vehicle, the travel direction of the own-vehicle, the date, and the time to the server 7 via the external communication device 6. The server 7 stores the position information of the own-vehicle, the travel direction information of the own-vehicle, the information on the date, and the information on the time in the visibility reduction spot information database.
For example, in the example in
In
It is assumed that the visibility reduction spot information database according to this embodiment automatically stores the position information of the vehicle and the travel direction information of the vehicle when the visibility of the driver in the own-vehicle or the other-vehicle is reduced. However, the position information of the vehicle and the travel direction information of the vehicle may be pre-stored in the visibility reduction spot information database manually by the designer.
The operation of warning processing of the driver assistance system according to the first embodiment will now be described with reference to
In ST1, the own-vehicle position acquisition device 9 transmits the position information of the own-vehicle at predetermined time intervals to the server 7 via the external communication device 6. The predetermined time interval is set arbitrarily by the designer of the driver assistance system. In the description of
In ST2, the server 7 receives the information of the position of the own-vehicle “33.40N, 131.47E” from the own-vehicle position acquisition device 9. The server 7 searches the time periods stored in the visibility reduction spot information database illustrated in
Then, in the visibility reduction spot information database, the server 7 searches the coordinates associated with the time period “9:00 to 10:00” retrieved from the visibility reduction spot information database to find information on coordinates corresponding to the position of the own-vehicle “33.40N, 131.47E” received from the own-vehicle position acquisition device 9. For example, if a range of coordinates is set in the server 7 and the position of the own-vehicle “33.40N, 131.47E” received from the own-vehicle position acquisition device 9 is included in the range specified by using the coordinates stored in the visibility reduction spot information database as a basis, the coordinates corresponding to the position of the own-vehicle “33.40N, 131.47E” received from the own-vehicle position acquisition device 9 is considered to be the information on the corresponding coordinates. In the example in
It has been described with reference to
In ST3, the visibility determination unit 21 acquires information of orientations “140°, 220°” from the server 7 via the external communication device 6. If the orientation information is acquired, the visibility determination unit 21 executes processing of ST4. On the other hand, if no orientation information is acquired, the visibility determination unit 21 ends the processing.
In ST4, the vicinity monitoring device 1 acquires vicinity information. For example, the vicinity monitoring device 1 acquires information on the distance between the own-vehicle and the other-vehicle using a radar or the like. The other-vehicle information acquisition unit 22 acquires the vicinity information from the vicinity monitoring device 1 and determines whether or not the other-vehicle is present within a predetermined range from the own-vehicle. If the other-vehicle is present within the predetermined range from the own-vehicle, the other-vehicle information acquisition unit 22 calculates the position of the other-vehicle on the basis of the position of the own-vehicle and the information on the distance between the own-vehicle and the other-vehicle. Further, the other-vehicle information acquisition unit 22 calculates the position of the other-vehicle a plurality of times, and calculates the travel direction of the other-vehicle from changes in the position of the other-vehicle calculated the plurality of times. The other-vehicle information acquisition unit 22 outputs the calculated travel direction information of the other-vehicle to the visibility determination unit 21 and executes processing of ST5. On the other hand, if it is determined that the other-vehicle is not present within the predetermined range from the own-vehicle, the other-vehicle information acquisition unit 22 ends the processing. The predetermined range may be a distance-measurable range of a radar or the like, or may be any range defined separately from a distance-measuring range of a radar or the like.
In ST5, the visibility determination unit 21 determines whether or not the visibility of the driver in the other-vehicle is reduced on the basis of the travel direction of the other-vehicle acquired from the other-vehicle information acquisition unit 22 and the information of the orientations “140°, 220°” acquired from the server 7. Specifically, if the travel direction of the other-vehicle corresponds with one of the orientations acquired from the server 7, that is, if the travel direction of the other-vehicle is directed in the direction at the orientation 140° or 220°, the visibility determination unit 21 determines that the visibility of the driver in the other-vehicle is reduced. If the visibility determination unit 21 has determined that the visibility of the driver in the other-vehicle is reduced, the processing device 2 executes processing of ST6. On the other hand, if the visibility determination unit 21 has determined that the visibility of the driver in the other-vehicle is not reduced, the processing device 2 ends the processing. The visibility determination unit 21 may determine whether or not the travel direction of the other-vehicle corresponds with one of the orientations acquired from the server 7, not necessarily depending on whether or not there is a complete match between the travel direction of the other-vehicle and one of the orientations acquired from the server 7. For example, the visibility determination unit 21 may be provided in advance with a threshold for a discrepancy between the travel direction of the other-vehicle and one of the orientations acquired from the server 7, and may determined that the travel direction of the other-vehicle corresponds with one of the directions acquired from the server 7 if the discrepancy between the travel direction of the other-vehicle and one of the orientations acquired from the server 7 is less than or equal to the threshold.
In ST6, if the visibility determination unit 21 has determined that the visibility of the driver in the other-vehicle is reduced, the warning processing unit 23 acquires the image data for warning and the sound data for warning from the storage device 3. The warning processing unit 23 outputs the image data for warning to the display device 4, and outputs the sound data for warning to the speaker 5. In this embodiment, it has been described that the warning processing unit 23 acquires both the image data for warning and the sound data for warning. However, the warning processing unit 23 may acquire only one of these.
In ST7a, the display device 4 acquires the image data for warning from the warning processing unit 23, and displays a warning image.
In ST7b, the speaker 5 acquires the sound data for warning from the warning processing unit 23, and outputs a warning sound. As the warning sound, a voice sound such as “attention to the vehicle in front” or “attention to the vehicle to the right” may be output, or the warning sound may be a buzzer or the like.
As described above, the driver assistance system according to the first embodiment determines whether or not the visibility of the driver in the other-vehicle is reduced, using the visibility reduction spot information database in which a spot at which the visibility of the driver in the vehicle is reduced and information, associated with this spot, on a direction in which the visibility of the driver in the vehicle is reduced are associated with each other, and on the basis of the travel direction information of the other-vehicle and the information on the direction in which the visibility is reduced stored in the visibility reduction spot information database. Further, if it is determined that the visibility of the driver in the other-vehicle is reduced, the driver assistance system warns the driver of the own-vehicle that the visibility of the driver in the other-vehicle is reduced. Therefore, the driver of the own-vehicle can pay attention to the movement of the other-vehicle while driving.
It has been described that the other-vehicle information acquisition unit 22 according to this embodiment acquires the vicinity information for calculating the position information of the other-vehicle and the travel direction information of the other-vehicle from the vicinity monitoring device 1. However, the other-vehicle information acquisition unit 22 may acquire the position information of the other-vehicle and the travel direction information of the other-vehicle from the other-vehicle via the external communication device 6. That is, the other-vehicle information acquisition unit 22 may acquire the position information of the other-vehicle and the travel direction information of the other-vehicle through vehicle-to-vehicle communication. By thus using vehicle-to-vehicle communication, it is possible to acquire the vicinity information of the other-vehicle which is traveling in a place where the vicinity information cannot be acquired by a radar, a lidar, or the like because of a wall or a fence, for example.
It has been described that the visibility determination unit 21 according to this embodiment acquires the travel direction information of the other-vehicle from the other-vehicle information acquisition unit 22 when determining whether or not the visibility of the driver in the other-vehicle is reduced. The visibility determination unit 21 may further acquire the position information of the other-vehicle. If the position information of the other-vehicle is acquired, the visibility determination unit 21 determines whether or not the other-vehicle is present within a specified range from the position of the own-vehicle. If the other-vehicle is present within this range, the visibility determination unit 21 determines that the visibility of the driver in this other-vehicle is reduced. The specified range may be a range which is the same as a range for searching in the database when the server 7 acquires information on the coordinates of the own-vehicle or a range transmitted by the own-vehicle position acquisition device 9 to the server 7, or may be a range different from these. By thus determining whether or not the other-vehicle is present in the specified range from the position of the own-vehicle, if the position information of the other-vehicle is acquired through vehicle-to-vehicle communication, for example, the other-vehicle that is traveling at a significantly remote position from the position of the own-vehicle can be excluded from warning targets. Therefore, the driver assistance system according to this embodiment does not display a warning in such a case where there is a significantly remote possibility of a collision or the like, so that the reliability of warnings can be enhanced.
The driver assistance system according to this embodiment may determine whether or not this other-vehicle is present within a specified range from the coordinates acquired from the server 7. If the other-vehicle is present within the specified range from the coordinates obtained from the server 7, the driver assistance system determines that the visibility of this other-vehicle is reduced. By thus determining that the visibility is reduced with regard to the other-vehicle that is present within the specified range from the coordinates acquired from the server 7, even if a plurality of pieces of coordinates obtained from the server 7 are present within the specified range from the own-vehicle, it is possible to determine that the visibility of the driver in the other-vehicle that is nearer to the coordinates obtained from the server 7 is reduced and to warn the driver of the own-vehicle.
It has been described that the visibility determination unit 21 according to this embodiment acquires the orientation information from the server 7. However, the visibility determination unit 21 may acquire information on the degree of glare associated with the orientation information in the visibility reduction spot information database, and determine whether or not to provide a warning on the basis of this degree of glare. For example, the visibility determination unit 21 has a threshold for the degree of glare. If the degree of glare acquired from the server 7 is more than or equal to the threshold, the visibility determination unit 21 displays the warning image or outputs the warning sound for the driver of the own-vehicle. The driver assistance system according to this embodiment thus acquires the information on the degree of glare, so that it is possible to determine whether or not to warn the driver of the own-vehicle depending on to what degree the visibility of the driver of the other-vehicle is reduced. Therefore, it is possible to perform control such as, not to provide a warning if the visibility is reduced to a significantly low level.
It has been described that the visibility determination unit 21 according to this embodiment acquires orientations on the basis of the visibility reduction spot information database. However, if orientation data is not recorded (see the row of date 9/3 in
In the description of the visibility reduction spot determination device 10 according to this embodiment, the example in which pieces of information on coordinates, an orientation and a degree of glare are stored in association with one another in the server 7 has been described. The visibility reduction spot determination device 10 may determine whether or not to store information on coordinates and an orientation in the visibility reduction spot information database on the basis of the information on the degree of glare. For example, the visibility reduction spot determination device 10 has a threshold for the degree of glare. If the information on the degree of glare acquired from the visibility reduction information detection device 8 is more than or equal to the threshold, the visibility reduction spot determination device 10 transmits the information on the coordinates, the orientation, and the degree of glare to the server 7. On the other hand, if the degree of glare acquired from the visibility reduction information detection device 8 is less than or equal to the threshold, the visibility reduction spot determination device 10 does not transmit the information on the coordinates, the orientation, and the degree of glare to the server 7. The driver assistance system thus determines whether or not to store the information on the coordinates, the orientation, and the degree of glare depending on the degree of glare, so that in such a case where the visibility is reduced to a small degree, it is possible to not store the information on the coordinates, the orientation and the degree of glare. Therefore, the accuracy of the visibility reduction spot information database can be enhanced.
It has been described that the visibility reduction spot determination device 10 according to this embodiment determines whether or not the visibility of the driver in the own-vehicle is reduced on the basis of the degree of openness of eyelids. However, it is not limited to this, and the visibility reduction spot determination device 10 may determine whether or not the visibility of the driver in the own-vehicle is reduced on the basis of a line of sight of the driver or the state of a sun visor provided in the vehicle.
When lines of sight of the driver in the own-vehicle can be detected, the line-of-sight detection unit 82 may detect that the visibility is reduced depending on whether or not the lines of sight avoid a particular region to which attention should be paid.
The visibility reduction spot determination device 10 may determine whether or not the visibility of the driver in the own-vehicle is reduced on the basis of a sun visor sensor 83 provided in the vehicle.
With reference to
The sun visor orientation sensor 831 is provided in the proximity of a part of the hinge portion to be connected to a roof part of the vehicle. The sun visor orientation sensor detects rotation of the hinge shaft in a vertical shaft direction. The sun visor orientation sensor 831 detects in which direction the sun visor faces by detecting rotation of the hinge shaft 831 in the vertical shaft direction. The sun visor orientation sensor 831 corresponds, for example, to a rotary encoder.
The illumination sensor 832 is provided at a lower portion of a surface, of the two surfaces of the sun visor, which faces the outside of the vehicle, and detects the intensity of light entering the driver's seat.
A vehicle information management unit 102 can detect the driver's intention to use the sun visor and the entrance direction and intensity of external light on the basis of information detected by the sun visor orientation sensor 831, the sun visor use determination sensor 834, and the illumination sensor 832, and deduces whether or not the visibility of the driver in the own-vehicle is reduced. The vehicle information management unit 102 outputs information on whether or not the visibility is reduced to the determination unit 103. The determination unit 103 determines whether or not the visibility is reduced on the basis of the information from the vehicle information management unit 102 or the line-of-sight detection unit 82, and transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7 if it is determined that the visibility is reduced.
A driver assistance system according to a second embodiment is characterized in that the driver assistance system warns the driver of the own-vehicle about a direction in which the visibility of the driver in the other-vehicle is reduced regardless of whether or not the other-vehicle is actually traveling, on the basis of information on orientations in a visibility reduction spot information database and road information in map data. The configuration of the driver assistance system according to the second embodiment will be described below with reference to
The driver assistance system according to the second embodiment has a map database 11. The map database 11 stores information on roads on which vehicles travel (hereinafter referred to as road information). In an example in
In the driver assistance system according to this embodiment, a visibility determination unit 21 acquires the position information of the own-vehicle from an own-vehicle position acquisition device 9. The visibility determination unit 21 acquires the road information in the map database 11 on the basis of the position information of the own-vehicle, and determines a road on which there is a possibility that the visibility of the driver in the other-vehicle may be reduced, on the basis of this road information and orientation information acquired from a server 7. The road information refers to information on roads on which vehicles can travel. For example, it is assumed that the road information includes at least road directions and information on directions in which the vehicles are allowed to travel on the roads (hereinafter referred to as allowed travel direction information). The road on which there is a possibility that the visibility of the driver may be reduced refers to a road on which when the other-vehicle travels thereon, there is a risk that the visibility of the driver in this other-vehicle may be reduced.
An example of the map database 11 will be described here with reference to
The operation of the driver assistance system according to the second embodiment will now be described with reference to
In ST501, the visibility determination unit 21 acquires the position information of the own-vehicle from the own-vehicle position acquisition device 9. The visibility determination unit 21 acquires the road information regarding the vicinity of the position of the own-vehicle from the map database 11, on the basis of the position information of the own-vehicle.
In ST502, the visibility determination unit 21 determines a road on which there is a possibility that the visibility of a driver is reduced (hereinafter referred to as a direction in which the visibility is reduced), on the basis of this road information and the orientation information acquired from the visibility reduction spot information database. For example, when the own-vehicle is at the intersection as illustrated in
In ST6b, on the basis of the information on the road on which there is a possibility that the visibility of the driver is reduced which is acquired from the visibility determination unit 21, the warning processing unit 23 acquires corresponding image data or sound data for warning from the storage device 3, and outputs it to the display device 4 or the speaker 5.
In ST7a, the display device 4 acquires the image data for warning and displays this image.
In ST6b, the speaker 5 acquires the sound data for warning and outputs this sound.
As described above, the driver assistance system according to the second embodiment determines a direction in which the visibility of the driver in the other-vehicle is reduced on the basis of the information on roads on which vehicles are allowed to travel and the travel direction information of the vehicle, and warns the driver of the own-vehicle about the direction in which the visibility is reduced. Therefore, even in a case where the presence of the other-vehicle cannot be detected, the direction in which the visibility is reduced can be predicted in advance and the driver can pay attention thereto while driving.
It has been described with reference to
A driver assistance system according to a third embodiment is characterized in that when there is a strong possibility that the own-vehicle and the other-vehicle may collide on the basis of the travel direction information of the own-vehicle and the travel direction information of the other-vehicle, the driver assistance system warns that the visibility of the driver in the other-vehicle is reduced. The configuration of the driver assistance system according to the third embodiment will be described below with reference to
The driver assistance system according to the third embodiment has a driving monitoring device 12 and an own-vehicle information acquisition unit 24.
The driving monitoring device 12 is a device that monitors own-vehicle information, such as brakes, an accelerator, turn signals, and a travel direction of the own-vehicle, using a vehicle information acquisition system such as a CAN.
The own-vehicle information acquisition unit 24 is a device that acquires the own-vehicle information from the driving monitoring device 12, and determines therefrom a direction in which the own-vehicle is going to advance.
In this embodiment, it is assumed that an other-vehicle information acquisition unit 22 acquires vicinity information from a vicinity monitoring device 1, and estimates therefrom a direction in which the other-vehicle is going to advance.
A visibility determination unit 21 determines whether or not the visibility of the driver in the other-vehicle is reduced, and acquires the travel direction information of the other-vehicle from the other-vehicle information acquisition unit 22 and acquires the travel direction information of the own-vehicle from the own-vehicle information acquisition unit 24 to determine whether or not there is a strong possibility that the own-vehicle and the other-vehicle may collide.
The operation of the driver assistance system according to the third embodiment will now be described with reference to
In ST51, the driving monitoring device 12 acquires the own-vehicle information. The driving monitoring device 12 outputs this own-vehicle information to the visibility determination unit 21. The visibility determination unit 21 acquires the own-vehicle information, and predicts a direction in which the own-vehicle is going to advance. For example, when the own-vehicle is at rest at the intersection, the visibility determination unit 21 can easily predict the direction in which the own-vehicle is going to advance from the direction of the turn signals or the like. Further, the visibility determination unit 21 determines whether or not there is a possibility that the own-vehicle and the other-vehicle may collide on the basis of the travel direction of the own-vehicle and the travel direction of the other-vehicle. For example, when the own-vehicle is at rest at the intersection and the other-vehicle is at rest in the opposing lane, if the other-vehicle is next going to advance straight ahead and the own-vehicle is going to make a right turn, there is a strong possibility that the own-vehicle and the other-vehicle may collide. If the visibility determination unit 21 thus determines that there is a strong possibility that the own-vehicle and the other-vehicle may collide, the visibility determination unit 21 notifies a warning processing unit 23 that the visibility of the driver in the other-vehicle is reduced, which has been determined in ST5, and then proceeds to ST6. On the other hand, for example, if the other-vehicle is going to advance straight ahead and the own-vehicle is going to make a left turn, there is a remote possibility that the own-vehicle and the other-vehicle may collide. Thus, the visibility determination unit 21 ends the processing without notifying the warning processing unit 23 that the visibility of the driver in the other-vehicle is reduced, which has been determined in ST5. Whether or not there is a strong possibility that the own-vehicle and the other-vehicle may collide if the own-vehicle and the other-vehicle advance in which directions can be designed arbitrarily by the designer of the driver assistance system.
As described above, the driver assistance system according to the third embodiment determines a possibility of a collision between the own-vehicle and the other-vehicle on the basis of the travel direction information of the own-vehicle and the travel direction information of the other-vehicle, and warns that the visibility of the driver in the other-vehicle is reduced if it is determined that there is a possibility of a collision. Therefore, it is possible to prevent providing a warning each time the visibility of the other-vehicle is reduced and to warn the driver of the own-vehicle only when necessary.
In this embodiment, the other-vehicle information acquisition unit 22 determines in which direction the other-vehicle advances on the basis of the vicinity information acquired from the vicinity monitoring device 1. However, the other-vehicle information acquisition unit 22 may acquire information on the direction in which the other-vehicle travels from the external communication device 6 through vehicle-to-vehicle communication, and estimate the direction in which the other-vehicle is going to advance on the basis of the vicinity information and the information acquired from the external communication device 6.
The visibility determination unit 21 according to this embodiment, which determines a possibility of a collision on the basis of the travel direction of the own-vehicle and the travel direction of the other-vehicle, may further determine a possibility that the other-vehicle behind may collide with the own-vehicle on the basis of information on the speed of the own-vehicle and the speed of the other-vehicle. In a case in which a possibility of a collision is determined on the basis of the information on the speed of the own-vehicle and the speed of the other-vehicle, the driving monitoring device 12 outputs the information on the speed of the own-vehicle (hereinafter referred to as speed information of the own-vehicle) to the visibility determination unit 21 via the own-vehicle information acquisition unit 24. The vicinity monitoring device 1 also outputs information on the speed of the other-vehicle (hereinafter referred to as speed information of the other-vehicle) in addition to the vicinity information to the visibility determination unit 21 via the other-vehicle information acquisition unit 22. The visibility determination unit 21 determines whether or not the other-vehicle behind will collide with the own-vehicle on the basis of a relative speed of the speed of the own-vehicle and the speed of the other-vehicle behind. If it is determined that there is a possibility that the vehicle behind may collide with the own-vehicle, the visibility determination unit 21 outputs information indicating that the visibility of the vehicle behind is reduced to the warning processing unit 23.
A driver assistance system according to a fourth embodiment is characterized in that when there is a strong possibility that the own-vehicle and the other-vehicle may collide on the basis of the travel direction of the own-vehicle and the travel direction information of the other-vehicle, the driver assistance system controls the vehicle. The configuration of the driver assistance system according to the fourth embodiment will be described below with reference to
The driver assistance system according to the fourth embodiment has a vehicle control unit 14. The vehicle control unit 14 controls the operation of the own-vehicle when a visibility determination unit 21 determines that there is a strong possibility of a collision on the basis of the travel direction of the own-vehicle and the travel direction of the other-vehicle. The vehicle control unit 14 controls, for example, a seat belt and brakes.
The operation of the driver assistance system according to the fourth embodiment will now be described with reference to
In ST7c, if the visibility determination unit 21 has determined that there is a possibility that the vehicle behind may collide with the own-vehicle, the vehicle control unit 14 tightens the seat belt to reduce an impact applied upon the collision with the vehicle behind. The vehicle control unit 14 also performs control to forcibly apply the brakes to prevent the own-vehicle from springing forward by the impact of the collision.
As described above, the driver assistance system according to the fourth embodiment controls the operation of the own-vehicle if it is determined that there is a possibility that the own-vehicle and the other-vehicle may collide. Therefore, it is possible to detect that the visibility is reduced and to reduce damage when the own-vehicle and the other-vehicle collide.
The driver assistance system according to the first embodiment transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7 to have them stored therein if the visibility reduction spot determination device 10 determines that the visibility of the driver in the own-vehicle is reduced. However, in the driver assistance system, if the position information of the own-vehicle and the travel direction information of the own-vehicle are stored in the server 7 every time the visibility reduction spot determination device 10 determines that the visibility of the driver in the own-vehicle is reduced, there is a risk that an enormous amount of data may be stored. Therefore, a driver assistance system according to a fifth embodiment is characterized in that at a specified spot such as an intersection, for example, the driver assistance system transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to a server 7, and at a spot other than the specified spot, such as a straight road, transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7 when the driver in the own-vehicle is exposed to light reflecting off a building or the like.
The configuration of the driver assistance system according to the fifth embodiment will be described below with reference to
With reference to
In this embodiment, a visibility reduction spot determination device 10 acquires the position information of the own-vehicle from the own-vehicle position acquisition device 9, and determines whether or not the own-vehicle is located at a specified spot. If it is determined that the own-vehicle is located at the specified spot, the visibility reduction spot determination device 10 transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7. The specified spot can be set arbitrarily by the designer of the driver assistance system, and corresponds to an intersection or the like, for example.
On the other hand, if it is determined that the own-vehicle is not located at the specified spot, the visibility reduction spot determination device 10 acquires the travel direction of the own-vehicle from the own-vehicle position acquisition device 9 and information on the orientation of the sun (hereinafter referred to as solar orientation information) from the solar orientation calculation device 15, and determines whether the cause by which the visibility of the driver in the own-vehicle is reduced is that the driver is directly exposed to the sunlight or that the driver is indirectly exposed to the sunlight through reflection. The visibility reduction spot determination device 10 does not transmit the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7 if the cause by which the visibility of the driver in the own-vehicle is reduced is direct exposure to the sunlight, and transmits the position information of the own-vehicle and the travel direction information of the own-vehicle if the cause is indirect exposure to the sunlight through reflection.
The operation of the driver assistance system according to the fifth embodiment will be described below with reference to
In ST311, the visibility reduction spot determination device 10 acquires information about the position of the own-vehicle from the own-vehicle position acquisition device 9, and determines whether or not the own-vehicle is located at the specified spot, that is, an intersection. If the own-vehicle is located at an intersection, processing of ST400 is executed. On the other hand, if the own-vehicle is not located at an intersection, for example, when the own-vehicle is traveling on a straight road on which right and left turns cannot be made, the visibility reduction spot determination device 10 executes processing of ST312.
In ST312, the solar orientation calculation device 15 acquires the information about the position of the own-vehicle from the own-vehicle position acquisition device 9. The solar orientation calculation device 15 calculates the orientation of the sun on the basis of the information about the position of the own-vehicle and the current time.
Then, the visibility reduction spot determination device 10 acquires the travel direction of the own-vehicle from the own-vehicle position acquisition device 9, acquires the solar orientation information from the solar orientation calculation device 15, and determines whether or not the travel direction of the own-vehicle coincides with the orientation of the sun. If the travel direction of the own-vehicle coincides with the orientation of the sun, the visibility reduction spot determination device 10 determines that the cause by which the visibility of the driver in the own-vehicle is reduced is direct exposure to the sunlight. On the other hand, if the travel direction of the own-vehicle does not coincide with the orientation of the sun, the visibility reduction spot determination device 10 determines that the cause by which the visibility of the driver in the own-vehicle is reduced is the sunlight reflecting off a building or the like. If it is determined that the cause by which the visibility of the driver in the own-vehicle is reduced is direct exposure to the sunlight, the driver assistance system ends the processing. If it is determined that that the cause by which the visibility of the driver in the own-vehicle is reduced is the sunlight reflecting off a building or the like, the driver assistance system performs ST400.
In ST400, the visibility reduction spot determination device 10 transmits the position information of the own-vehicle, the travel direction information of the own-vehicle, information on the date, and information on the time acquired in ST300 to the server 7 via the external communication device 6. The server 7 stores the position information of the own-vehicle, the travel direction information of the own-vehicle, the information on the date, and the information on the time in a visibility reduction spot information database.
As described above, the driver assistance system according to the fifth embodiment determines whether the cause by which the visibility of the driver in the own-vehicle is reduced is that the driver is directly exposed to the sunlight or that the driver is indirectly exposed to the sunlight through reflection, on the basis of the travel direction of the own-vehicle and the solar orientation information. If it is determined that the cause is indirect exposure to the sunlight through reflection, the driver assistance system transmits the position information of the own-vehicle and the travel direction information of the own-vehicle, so that the amount of information on visibility reduction spots stored in the server 7 can be reduced. For example, when the own-vehicle is traveling on a straight road on which right and left turns cannot be made and the relation between the travel direction of the own-vehicle and the orientation of the sun as seen from the position of the own-vehicle remain unchanged for a long period of time, the driver assistance system according to the first embodiment stores the position information of the own-vehicle and the travel direction information of the travel direction information in the server 7 a plurality of times, causing an enormous amount of data to be stored. The driver assistance system according to this embodiment transmits the position information of the own-vehicle and the travel direction information of the own-vehicle to the server 7 when the visibility of the driver is reduced because of indirect exposure to light through reflection of the sunlight, so that the amount of data stored in the server 7 can be reduced.
1: vicinity monitoring device, 2: processing device, 3: storage device, 4: display device, 5: speaker. 6: external communication device, 7: server, 8: visibility reduction information detection device, 9: own-vehicle position acquisition device, 10: visibility reduction spot determination device, 12: driving monitoring device, 14: vehicle control unit, 15: solar orientation calculation device, 21: visibility determination unit, 22: other-vehicle information acquisition unit, 23: warning processing unit, 24: own-vehicle position information acquisition unit, 81: on-board camera, 82: line-of-sight detection unit, 83: sun visor sensor, 101: image analysis unit, 103: determination unit, 831: sun visor orientation sensor, 834: sun visor use determination sensor, 832: illumination sensor
Tsushima, Naoyuki, Abukawa, Masahiro, Murayama, Shu, Yoshida, Michinori, Yonezawa, Eisuke
| Patent | Priority | Assignee | Title |
| Patent | Priority | Assignee | Title |
| 5955941, | Oct 10 1997 | Robert Bosch GmbH | Method and device for controlling a velocity of a motor vehicle |
| 7151467, | Jan 09 2004 | Nissan Motor Co., Ltd. | Vehicular communications apparatus and method |
| 8903603, | Jul 11 2011 | Clarion Co., Ltd. | Environment recognizing device for a vehicle and vehicle control system using the same |
| 20050156756, | |||
| 20130018547, | |||
| 20160046237, | |||
| JP10166895, | |||
| JP11222113, | |||
| JP11296799, | |||
| JP2002181554, | |||
| JP2003121159, | |||
| JP200417731, | |||
| JP2004191093, | |||
| JP2005196651, | |||
| JP200562060, | |||
| JP2006268475, | |||
| JP2006277538, | |||
| JP2008210058, | |||
| JP200852453, | |||
| JP200870998, | |||
| JP2009269461, | |||
| JP200937493, | |||
| JP2011118601, | |||
| JP2011158281, | |||
| JP201268040, | |||
| JP201320417, | |||
| JP201354545, | |||
| JP201397677, | |||
| JP2014178971, | |||
| JP2014203186, | |||
| WO2014167701, |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Mar 26 2015 | Mitsubishi Electric Corporation | (assignment on the face of the patent) | / | |||
| May 30 2017 | YONEZAWA, EISUKE | Mitsubishi Electric Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 043474 | /0802 | |
| May 31 2017 | ABUKAWA, MASAHIRO | Mitsubishi Electric Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 043474 | /0802 | |
| May 31 2017 | TSUSHIMA, NAOYUKI | Mitsubishi Electric Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 043474 | /0802 | |
| May 31 2017 | YOSHIDA, MICHINORI | Mitsubishi Electric Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 043474 | /0802 | |
| May 31 2017 | MURAYAMA, SHU | Mitsubishi Electric Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 043474 | /0802 |
| Date | Maintenance Fee Events |
| Aug 31 2017 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
| Nov 07 2022 | REM: Maintenance Fee Reminder Mailed. |
| Apr 24 2023 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
| Date | Maintenance Schedule |
| Mar 19 2022 | 4 years fee payment window open |
| Sep 19 2022 | 6 months grace period start (w surcharge) |
| Mar 19 2023 | patent expiry (for year 4) |
| Mar 19 2025 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Mar 19 2026 | 8 years fee payment window open |
| Sep 19 2026 | 6 months grace period start (w surcharge) |
| Mar 19 2027 | patent expiry (for year 8) |
| Mar 19 2029 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Mar 19 2030 | 12 years fee payment window open |
| Sep 19 2030 | 6 months grace period start (w surcharge) |
| Mar 19 2031 | patent expiry (for year 12) |
| Mar 19 2033 | 2 years to revive unintentionally abandoned end. (for year 12) |