A work vehicle periphery monitoring system which monitors a periphery of a work vehicle including a vehicle body frame supporting front and rear wheels and a vessel loading a load thereon, the work vehicle periphery monitoring system includes: an object detecting device which is attached to the work vehicle and detects an object existing at a rear side of the work vehicle; and a controller which notifies an alarm based on a detection result of the object detecting device and switches between a notification mode for notifying the alarm and a standby mode for stopping the notification of the alarm based on a state of the work vehicle.

Patent
   9457715
Priority
Sep 21 2012
Filed
Nov 29 2012
Issued
Oct 04 2016
Expiry
Nov 29 2032
Assg.orig
Entity
Large
0
10
currently ok
11. A work vehicle periphery monitoring method which monitors a periphery of a work vehicle including a vessel loading a load thereon, the work vehicle periphery monitoring method comprising:
detecting an object existing at a rear side of the work vehicle; and
notifying an alarm based on a detection result of the object detecting device and switching between a notification mode for notifying the alarm and a standby mode for stopping the notification of the alarm,
wherein the standby mode is set when the vessel stands up and the load loaded on the vessel is discharged.
1. A work vehicle periphery monitoring system which monitors a periphery of a work vehicle including a vehicle body frame supporting front and rear wheels and a vessel loading a load thereon, the work vehicle periphery monitoring system comprising:
an object detecting device which is attached to the work vehicle and detects an object existing at a rear side of the work vehicle; and
a controller which notifies an alarm based on a detection result of the object detecting device and switches between a notification mode for notifying the alarm and a standby mode for stopping the notification of the alarm,
wherein the controller sets the standby mode when the vessel stands up.
8. The A work vehicle periphery monitoring system which monitors a periphery of a work vehicle including a vehicle body frame supporting front and rear wheels and a vessel loading a load thereon, the work vehicle periphery monitoring system comprising:
an object detecting device which is attached to the work vehicle and detects an object existing at a rear side of the work vehicle; and
a controller which notifies an alarm based on a detection result of the object detecting device and switches between a notification mode for notifying the alarm and a standby mode for stopping the notification of the alarm,
wherein the controller sets the notification mode when the vessel returns to an original position after standing up.
9. A work vehicle periphery monitoring system which monitors a periphery of a work vehicle including a vehicle body frame supporting front and rear wheels and a vessel loading a load thereon, the work vehicle periphery monitoring system comprising:
an object detecting device which is attached to the work vehicle and detects an object existing at a rear side of the work vehicle; and
a controller which notifies an alarm based on a detection result of the object detecting device and switches, based on a detection signal indicating of discharging the load loaded on the vessel, a notification mode for notifying the alarm to a standby mode for stopping the notification of the alarm by stopping an operation of the object detecting device and switches the standby mode to the notification mode based on a detection signal indicating that the vessel returns to an original position after discharging the load.
2. The work vehicle periphery monitoring system according to claim 1, wherein the controller sets the notification mode when a loading of the load of the vessel becomes a predetermined threshold value or less.
3. The work vehicle periphery monitoring system according to claim 1, wherein the controller stops an operation of the object detecting device to set the standby mode.
4. The work vehicle periphery monitoring system according to claim 1, wherein the controller causes the detection result of the object detecting device not to be input to set the standby mode.
5. A work vehicle comprising:
the work vehicle periphery monitoring system according to claim 1.
6. The work vehicle periphery monitoring system according to claim 1,
wherein the controller switches between the notification mode and the standby mode based on a detection signal indicating of discharging the load loaded on the vessel, and
wherein the controller sets the standby mode based on a detection signal from a dump lever position sensor, a payload control device, or a vessel sitting sensor.
7. The work vehicle periphery monitoring system according to claim 1, wherein the controller sets the standby mode when the vessel starts to stand up.
10. A work vehicle comprising:
the work vehicle periphery monitoring system according to claim 9.
12. The work vehicle periphery monitoring method according to claim 11, wherein the standby mode is set when the vessel starts to stand up.
13. The work vehicle periphery monitoring method according to claim 11, wherein the standby mode is set based on a detection signal from a dump lever position sensor, a playload control device, or a vessel sitting sensor.

The present invention relates to a technology of monitoring a periphery of a work vehicle.

In a civil engineering construction site or a quarry site of a mine, various work vehicles such as a dump truck and an excavator are operated. In such work vehicles, the dump truck includes a vessel for loading a load thereon. Since the vessel stands to discharge the load, the dump truck increases in height when the vessel stands. For example, Patent Literature 1 discloses a technique of operating an alarm lamp and an alarm buzzer when a vessel's dumping state is detected upon operating a gear shifting lever for outputting a gear shifting signal to a running gear shifting device in order to avoid the vessel's contact and the like in a case where a dump truck enters a narrow space while the vessel stands.

Patent Literature 1: Japanese Patent Application Laid-open No. 2009-166669

Incidentally, a superjumbo work vehicle is used particularly in a mine. Since such a work vehicle has a vehicle width, a vehicle height, and a longitudinal length which are noticeably larger than those of a general vehicle, it is difficult for an operator to check and recognize a peripheral environment by a side mirror and the like. For this reason, there is proposed a periphery monitoring system which monitors a periphery of a vehicle as a technique for assisting a driving operation by helping an operator to simply recognize a peripheral environment of a vehicle by using an image capturing device or a radar device.

As such a periphery monitoring system, there is known a system which detects an object existing around a work vehicle by a radar device and notifies an alarm if necessary. In a case where the work vehicle with the periphery monitoring system is a dump truck, for example, when a vessel stands up to discharge a load, the radar device may detect a load or the like as an object existing around the work vehicle. As a result, the periphery monitoring system keeps notifying an alarm or the radar device existing at a position near the discharged load receives a radio wave of excessively large reflection intensity, which has a possibility that the periphery monitoring system may be influenced.

It is an object of the invention to reduce an influence on a periphery monitoring system caused when a vessel stands up in a work vehicle with a vessel for loading a load thereon and a periphery monitoring system.

According to the present invention, a work vehicle periphery monitoring system which monitors a periphery of a work vehicle including a vehicle body frame supporting front and rear wheels and a vessel loading a load thereon, the work vehicle periphery monitoring system comprises: an object detecting device which is attached to the work vehicle and detects an object existing at a rear side of the work vehicle; and a controller which notifies an alarm based on a detection result of the object detecting device and switches between a notification mode for notifying the alarm and a standby mode for stopping the notification of the alarm based on a state of the work vehicle.

In the present invention, it is preferable that the controller sets the standby mode when the vessel stands up.

In the present invention, it is preferable that the controller sets the standby mode when the load loaded on the vessel is discharged.

In the present invention, it is preferable that the controller sets the notification mode when the vessel returns to an original position after standing up to discharge the load.

In the present invention, it is preferable that the controller sets the standby mode when a brake of the work vehicle is operated.

In the present invention, it is preferable that the controller sets the notification mode when a loading of the load of the vessel becomes a predetermined threshold value or less.

In the present invention, it is preferable that the controller stops an operation of the object detecting device to set the standby mode.

In the present invention, it is preferable that the controller causes the detection result of the object detecting device not to be input to set the standby mode.

According to the present invention, a work vehicle periphery monitoring system which monitors a periphery of a work vehicle including a vehicle body frame supporting front and rear wheels and a vessel loading a load thereon, the work vehicle periphery monitoring system comprises: an object detecting device which is attached to the work vehicle and detects an object existing at a rear side of the work vehicle; and a controller which notifies an alarm based on a detection result of the object detecting device and switches, when the vessel stands up to discharge the load loaded on the vessel, a notification mode for notifying the alarm to a standby mode for stopping the notification of the alarm by stopping an operation of the object detecting device and switches the standby mode to the notification mode when the vessel returns to an original position after discharging the load.

According to the present invention, a work vehicle comprises: the work vehicle periphery monitoring system.

According to the invention, it is possible to reduce an influence on a periphery monitoring system caused when a vessel stands up in a work vehicle with a vessel for loading a load thereon and a periphery monitoring system.

FIG. 1 is a perspective view illustrating a work vehicle according to an embodiment.

FIG. 2 is a diagram illustrating a structure and an inside of a cab 3 included in the work vehicle according to the embodiment.

FIG. 3 is a diagram illustrating a periphery monitoring system 10 according to the embodiment.

FIG. 4 is a perspective view of a dump truck 1 equipped with image capturing devices 11 to 16 included in the periphery monitoring system 10 according to the embodiment.

FIG. 5 is a schematic diagram illustrating regions which are captured by a plurality of image capturing devices 11 to 16 and an bird's eye image 200 which is generated based on information of images captured by the plurality of image capturing devices 11 to 16.

FIG. 6 is a perspective view illustrating an arrangement of radar devices 21 to 28.

FIG. 7 is a diagram illustrating detection ranges of the respective radar devices 21 to 28.

FIG. 8 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the front side of the dump truck 1.

FIG. 9 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the left side of the dump truck 1.

FIG. 10 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the right side of the dump truck 1.

FIG. 11 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the rear side of the dump truck 1.

FIG. 12 is a diagram illustrating a left side surface of the dump truck 1 and an irradiation state of the radar devices 21 to 28.

FIG. 13 is a diagram illustrating a rear side of the dump truck 1 and an irradiation state of the radar devices 21 to 28.

FIG. 14 is a diagram illustrating an example of an image which is displayed on a monitor 50 by a controller 100.

FIG. 15 is a diagram illustrating a state where a load is loaded from a loading machine 65 onto a vessel 4 of the dump truck 1.

FIG. 16 is a flowchart illustrating a procedure of the load discharging alarm control executed by the controller 100.

A mode for carrying out the invention (embodiment) will be described in detail by referring to the drawings. In the description below, the front side, the rear side, the left side, and the right side are terms based on an operator who sits on a driver seat. For example, the front side indicates the side where the visual line of the operator as the manipulator sitting on the driver seat is directed and the side directed from the driver seat toward a steering wheel operated by the operator. The rear side indicates the opposite side to the front side and the side directed from the steering wheel toward the driver seat. The vehicle width direction of the work vehicle is identical to the left and right direction of the work vehicle.

<Work Vehicle>

FIG. 1 is a perspective view illustrating a work vehicle according to the embodiment. FIG. 2 is a diagram illustrating a structure and an interior of a cab 3 which is included in the work vehicle according to the embodiment. In the embodiment, a self-propelled dump truck (called an off-highway truck) 1 as the work vehicle is a superjumbo vehicle which is used for an operation in a mine. In the embodiment, the work vehicle may not include an upper turning body and a working machine. Further, the type of the dump truck as the work vehicle is not limited.

The dump truck 1 may be of, for example, an articulated type or the like. The dump truck 1 includes a vehicle body portion 2, the cab 3, a vessel 4, a pair of left and right front wheels 5, and a pair of left and right rear wheels 6 of which each pair includes two wheels. The vehicle body portion 2 includes an upper deck 2b and a frame 2f disposed along the front and rear direction. Further, the dump truck 1 includes a periphery monitoring system which monitors the periphery thereof and displays the result. The periphery monitoring system will be described in detail later.

In the embodiment, the dump truck 1 drives an electric motor by the power generated when an internal combustion engine such as a diesel engine drives a generator, so that the rear wheels 6 are driven. In this way, the dump truck 1 is of a so-called electric driving type, but the driving type of the dump truck 1 is not limited thereto. For example, the dump truck 1 may transmit the power of the internal combustion engine to the rear wheels 6 through a transmission so as to drive the rear wheels or may drive an electric motor by the power supplied through a trolley from a line so as to drive the rear wheels 6 by the motor.

The frame 2f supports power generating mechanisms such as the internal combustion engine and the generator and auxiliary machines thereof. The left and right front wheels 5 (only the right front wheel is illustrated in FIG. 1) are supported by the front portion of the frame 2f. The left and right rear wheels 6 (only the right rear wheel is illustrated in FIG. 1) are supported by the rear portion of the frame 2f. Each of the front wheels 5 and the rear wheels 6 has a diameter of about 2 m (meter) to 4 m (meter). As for the rear wheels 6, the inside position of the vessel 4 in the width direction or the outside position of the vessel 4 in the width direction is substantially disposed at the same position as the outside of the rear wheel 6 in the width direction. The frame 2f includes a lower deck 2a and the upper deck 2b. The lower deck 2a is provided near a ground surface and the upper deck 2b is provided above the lower deck 2a. In this way, the dump truck 1 which is used in a mine is formed as a double deck structure with the lower deck 2a and the upper deck 2b.

The lower deck 2a is attached to the lower portion of the front surface of the frame 2f. The upper deck 2b is disposed above the lower deck 2a. A movable ladder 2c which is used to elevate, for example, the cab 3 is disposed below the lower deck 2a. An inclined ladder 2d is disposed between the lower deck 2a and the upper deck 2b so that the operator moves therebetween. Further, a radiator is disposed between the lower deck 2a and the upper deck 2b. A palisade guardrail 2e is disposed on the upper deck 2b. In the embodiment, the ladder 2c and the inclined ladder 2d are set as a part of the upper deck 2b and the lower deck 2a.

As illustrated in FIG. 1, the cab (operating room) 3 is disposed on the upper deck 2b. The cab 3 is disposed on the upper deck 2b so as to be shifted to one side in the vehicle width direction in relation to the center in the vehicle width direction. Specifically, the cab 3 is disposed on the upper deck 2b so as to be positioned at the left side in the vehicle width direction in relation to the center. The arrangement of the cab 3 is not limited to the left side in relation to the center in the vehicle width direction. For example, the cab 3 may be disposed at the right side in the vehicle width direction in relation to the center, and may be disposed at the center in the vehicle width direction. Operation members such as a driver seat, a steering wheel, a shift lever, an accelerator pedal, and a brake pedal are arranged inside the cab 3.

As illustrated in FIG. 2, the cab 3 includes a ROPS (Roll-Over Protection System) with a plurality of (in the embodiment, four) pillars 3a, 3b, 3c, and 3d. The ROPS protects the operator inside the cab 3 if the dump truck 1 rolls over. The driver of the dump truck 1 drives the dump truck in a state where a road shoulder at the left side of the vehicle body portion 2 may be easily checked, but the operator's head needs to be largely moved so as to check the periphery of the vehicle body portion 2. Further, the upper deck 2b is provided with a plurality of side mirrors (not illustrated) which check the periphery of the dump truck 1. Since the side mirrors are arranged at positions away from the cab 3, the driver needs to largely move his/her head even when checking the periphery of the vehicle body portion 2 using the side mirrors.

As illustrated in FIG. 2, the cab 3 includes therein a driver seat 31, a steering wheel 32, a dash cover 33, a wireless device 34, an accelerator pedal 35A, a brake pedal 35Bf, a secondary brake pedal 35Bs, a retarder 36, a shift lever 37, a parking brake operation switch 37P, a dump lever 38, a controller (to be described later in detail) as a monitoring control device which is not illustrated in FIG. 2, a monitor 50, and the like. In FIG. 2, the monitor 50 is assembled in the dash cover 33, but may be installed on the dash cover 33 or may be hung on the ceiling inside the cab 3. That is, the monitor may be installed at any position where the operator may see the monitor 50. Furthermore, the controller not illustrated in FIG. 2 is a part of a periphery monitoring system 10 to be described later. The shift lever 37 is a device which causes the operator of the dump truck 1 to change the advancing direction of the dump truck 1 or the speed gear thereof.

The vessel 4 illustrated in FIG. 1 is a container which loads load such as crushed stones thereon. The rear portion of the bottom surface of the vessel 4 is rotatably connected to the rear portion of the frame 2f through a rotary pin. The vessel 4 may take a loading posture and a standing posture by an actuator such as a hydraulic cylinder. As illustrated in FIG. 1, the loading posture indicates a posture in which the front portion of the vessel 4 is positioned at the upper portion of the cab 3. The standing posture indicates a posture in which the load is discharged and the vessel 4 is inclined rearward and downward. When the front portion of the vessel 4 rotates upward, the vessel 4 changes from the loading posture to the standing posture. The vessel 4 includes a flange portion 4F formed at the front portion thereof. The flange portion 4F is called a protector and extends to the upper side of the cab 3 so as to cover the cab 3. The flange portion 4F which extends to the upper side of the cab 3 protects the cab 3 from the collision with crushed stones and the like.

<Periphery Monitoring System>

FIG. 3 is a diagram illustrating the periphery monitoring system 10 according to the embodiment. FIG. 4 is a perspective view of the dump truck 1 equipped with image capturing devices 11 to 16 which are included in the periphery monitoring system 10 according to the embodiment. FIG. 5 is a schematic diagram illustrating regions which are captured by a plurality of image capturing devices 11 to 16 and an bird's eye image 200 which is generated based on the information of the images captured by the plurality of image capturing devices 11 to 16. The regions which are captured by the plurality of image capturing devices illustrated in FIG. 5 are regions based on the ground surface. As illustrated in FIG. 3, the periphery monitoring system 10 includes a plurality of (in the embodiment, six) image capturing devices 11 to 16, a plurality of (in the embodiment, eight) radar devices 21, 22, 23, 24, 25, 26, 27, and 28, the monitor 50, and a controller 100 as a monitoring control device. Furthermore, in the embodiment, the periphery monitoring system 10 may not be essentially provided with the image capturing devices 11, 12, 13, 14, 15, and 16.

<Image Capturing Device>

The image capturing devices 11, 12, 13, 14, 15, and 16 are attached to the dump truck 1. The image capturing devices 11, 12, 13, 14, 15, and 16 are, for example, a wide dynamic range (WDR) camera. The wide dynamic range camera is a camera that has a function of brightly correcting a dark portion to a level in which a bright portion is visible and adjusting the entire portion so as to be visible.

The image capturing devices 11, 12, 13, 14, 15, and 16 capture the periphery of the dump truck 1 and output the result as image information. In the description below, the image capturing device 11 is appropriately referred to as the first image capturing device 11, the image capturing device 12 is appropriately referred to as the second image capturing device 12, the image capturing device 13 is appropriately referred to as the third image capturing device 13, the image capturing device 14 is appropriately referred to as the fourth image capturing device 14, the image capturing device 15 is appropriately referred to as the fifth image capturing device 15, and the image capturing device 16 is appropriately referred to as the sixth image capturing device 16. Further, when there is no need to distinguish these image capturing devices, these image capturing devices are appropriately referred to as the image capturing devices 11 to 16.

As illustrated in FIG. 4, six image capturing devices 11 to 16 are respectively attached to the outer peripheral portion of the dump truck 1 so as to capture the images in the periphery of the dump truck 1 by 360°. In the embodiment, each of the image capturing devices 11 to 16 has a viewing range of 120° (±60° at each of the left and right sides) in the left and right direction and 96° in the height direction, but the viewing range is not limited thereto. Further, the respective image capturing devices 11 to 16 are indicated by the arrows in FIG. 4, but the directions indicated by the arrows indicate the directions in which the respective image capturing devices 11 to 16 face.

As illustrated in FIG. 4, the first image capturing device 11 is attached to the front surface of the dump truck 1. Specifically, the first image capturing device 11 is disposed at the upper end of the inclined ladder 2d, and more specifically, the lower side of the landing portion of the uppermost stage. The first image capturing device 11 is fixed through the bracket which is attached to the upper deck 2b so as to face the front side of the dump truck 1. As illustrated in FIG. 5, the first image capturing device 11 captures a first region 11C in the region existing in the periphery of the dump truck 1 and outputs first image information as image information. The first region 11C is a region which is broadened toward the front side of the vehicle body portion 2 of the dump truck 1.

As illustrated in FIG. 4, the second image capturing device 12 is attached to one side portion of the front surface of the dump truck 1. Specifically, the second image capturing device 12 is disposed at the right portion of the front surface of the upper deck 2b. The second image capturing device 12 is fixed through the bracket attached to the upper deck 2b so as to face the diagonally forward right side of the dump truck 1. As illustrated in FIG. 5, the second image capturing device 12 captures a second region 12C in the region existing in the periphery of the dump truck 1 and outputs second image information as image information. The second region 12C is a region which is broadened toward the diagonally forward right side of the vehicle body portion 2 of the dump truck 1.

As illustrated in FIG. 4, the third image capturing device 13 is attached to the other side of the front surface of the dump truck 1. Specifically, the third image capturing device 13 is disposed at the left portion of the front surface of the upper deck 2b. Then, the third image capturing device 13 is disposed so as to be bilaterally symmetric to the second image capturing device 12 about the axis passing the center of the dump truck 1 in the vehicle width direction. The third image capturing device 13 is fixed through the bracket attached to the upper deck 2b so as to face the diagonally forward left side of the dump truck 1. As illustrated in FIG. 5, the third image capturing device 13 captures a third region 13C in the region existing in the periphery of the dump truck 1 and outputs third image information as image information. The third region 13C is a region which is broadened toward the diagonally forward left side of the vehicle body portion 2 of the dump truck 1.

As illustrated in FIG. 4, the fourth image capturing device 14 is attached to one side surface of the dump truck 1. Specifically, the fourth image capturing device 14 is disposed at the front portion of the right side surface of the upper deck 2b. The fourth image capturing device 14 is fixed through the bracket attached to the upper deck 2b so as to face the diagonally backward right side of the dump truck 1. As illustrated in FIG. 5, the fourth image capturing device 14 captures a fourth region 14C in the region existing in the periphery of the dump truck 1 and outputs fourth image information as image information. The fourth region 14C is a region which is broadened toward the diagonally backward right side of the vehicle body portion 2 of the dump truck 1.

As illustrated in FIG. 4, the fifth image capturing device 15 is attached to the other side surface of the dump truck 1. Specifically, the fifth image capturing device 15 is disposed at the front portion of the left side surface of the upper deck 2b. Then, the fifth image capturing device 15 is disposed so as to be bilaterally symmetric to the fourth image capturing device 14 about the axis passing the center of the dump truck 1 in the vehicle width direction. As illustrated in FIG. 5, the fifth image capturing device 15 captures a fifth region 15C in the region existing in the periphery of the dump truck 1 and outputs fifth image information as image information. The fifth region 15C is a region which is broadened toward the diagonally backward left side of the vehicle body portion 2 of the dump truck 1.

As illustrated in FIG. 4, the sixth image capturing device 16 is attached to the rear portion of the dump truck 1. Specifically, the sixth image capturing device 16 is disposed above an axle housing connecting two rear wheels 6 and 6 at the rear end of the frame 2f and near the rotary shaft of the vessel 4. The sixth image capturing device 16 is fixed toward the rear side of the dump truck 1 through the bracket which is attached to a crossbar connecting the left and right frames 2f. As illustrated in FIG. 5, the sixth image capturing device 16 captures a sixth region 16C in the region existing in the periphery of the dump truck 1 and outputs sixth image information as image information. The sixth region 16C is a region which is broadened toward the rear side of the vehicle body portion 2 of the dump truck 1.

By using the above-described six image capturing devices 11 to 16, the periphery monitoring system 10 according to the embodiment may capture the images in the entire circumference of the dump truck 1 by 360° and acquire the image information as illustrated in FIG. 5. Six image capturing devices 11 to 16 transmit the first image information to the sixth image information as the respectively captured image information items to the controller 100 illustrated in FIG. 3.

The first image capturing device 11, the second image capturing device 12, the third image capturing device 13, the fourth image capturing device 14, and the fifth image capturing device 15 are provided in the upper deck 2b which exists at the relatively high position. For this reason, the controller 100 may obtain an image which is seen from the bird's eye position toward the ground surface by the first image capturing device 11 to the fifth image capturing device 15 and hence may capture a subject (hereinafter, referred to as an appropriate object) such as a vehicle existing on the ground surface in abroad range. Further, even when the viewing point is changed upon causing the controller 100 to generate the bird's eye image 200 illustrated in FIG. 5 from the first image information to the sixth image information acquired by the first image capturing device 11 to the sixth image capturing device 16, the deformation degree of the three-dimensional object is suppressed since the first image information to the fifth image information in the first image information to the sixth image information are information items captured from the bird's eye position.

The periphery monitoring system 10 uses wide dynamic range cameras as the image capturing devices 11 to 16. For this reason, the image capturing devices 11 to 16 may brightly correct a dark portion such as a shadow of the dump truck 1 while maintaining a level at which a bright portion is visible. Accordingly, the over-exposure and under-exposure hardly occur in the images which are captured by the image capturing devices 11 to 16, and hence the images may be easily understood as a whole. As a result, the periphery monitoring system 10 with the image capturing devices 11 to 16 may display the bird's eye image 200 in which an object such as a vehicle existing in a region as a shadow of the dump truck 1 is easily visible on the monitor 50. In this way, even in an environment in which a contrast difference in contrast is large when the periphery monitoring system 10 monitors the periphery of the dump truck 1 by using the images captured by the image capturing devices 11 to 16, the periphery monitoring system may display the object around the dump truck 1 in the bird's eye image 200. As a result, the operator of the dump truck 1 may reliably see the object existing in the periphery of the dump truck 1, and particularly, the shadow region regardless of the environment.

In this way, since the periphery monitoring system 10 may generate the bird's eye image 200 which reliably displays the object around the dump truck 1 even in an environment in which a contrast difference in contrast is large, the object existing in the blind angle of the operator may be reliably recognized by the bird's eye image 200. Accordingly, the periphery monitoring system 10 may be very effectively used to monitor the periphery of the above-described superjumbo dump truck 1 used in a mine. That is, there is a case in which the dump truck 1 forms a very large shadow region. Further, there is a case in which the dump truck moves while forming its shadow region and the shadow region largely changes by the elevation of the vessel 4. Further, there is a case in which the dead angle region is large. In such a dump truck 1, the periphery monitoring system 10 may provide the accurate information around the dump truck 1 for the operator of the dump truck 1 by generating the bird's eye image 200 reliably displaying the object around the dump truck 1. Further, the periphery monitoring system 10 may provided the accurate information around the dump truck 1 for the operator of the dump truck 1 with respect to the dump truck 1 which is operated in a place having a very large illumination difference between a sunny place and a shadow place like an equatorial region.

<Radar Device>

FIG. 6 is a perspective view illustrating an arrangement of the radar devices 21 to 28. FIG. 7 is a diagram illustrating detection ranges of the respective radar devices 21 to 28. FIG. 8 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the front side of the dump truck 1. FIG. 9 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the left side of the dump truck 1. FIG. 10 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the right side of the dump truck 1. FIG. 11 is a diagram illustrating a specific arrangement of the radar devices 21 to 28 which detect the rear side of the dump truck 1. FIG. 12 is a diagram illustrating a left side surface of the dump truck 1 and an irradiation state of the radar devices 21 to 28. FIG. 13 is a diagram illustrating a rear side of the dump truck 1 and an irradiation state of the radar devices 21 to 28.

In the embodiment, each of the radar devices 21, 22, 23, 24, 25, 26, 27, and 28 (hereinafter, referred to as appropriate radar devices 21 to 28) as the object detecting device is a ultra wide band (UWB) radar which has, for example, a detection angle of 80° (±40°) in the orientation (horizontal) direction and 16° (±8°) in the up and down (vertical) direction and a maximum detection distance of 15 m or more. The radar devices 21 to 28 detect a position (relative position) of the object existing in the periphery of the dump truck 1 relative to the dump truck 1. The respective radar devices 21 to 28 are attached to the outer peripheral portion of the dump truck 1 as in the image capturing devices 11 to 16. The detection angle of each of the radar devices 21 to 28 in the orientation (horizontal) direction is set to 80° (±40°), but the radar device may have a larger detection angle. Further, the respective radar devices 21 to 28 are indicated by the arrows in FIG. 6, but the direction indicated by the arrows indicate the detection ranges of the respective radar devices 21 to 28.

The radar devices 21 and 22 will be described by mainly referring to FIG. 6 and FIG. 8 illustrating the front side view of the dump truck 1. The radar devices 21 and 22 are provided below the inclined ladder 2d and on the lower deck 2a which is positioned below the upper deck 2b and is positioned at the height of about 1 m from the ground surface. The radar devices 21 and 22 are respectively attached so as to be bilaterally symmetric to each other about the vehicle center plane C through the brackets B21 and B22. Here, as the axis inside the vehicle center plane C, a line connecting two points placed at the same height from the ground surface inside the dump truck 1 and extending forward from the rear side of the dump truck 1 inside the vehicle center plane C is defined as the reference axis. The one-dotted chain line CH illustrated in FIG. 7 indicates the line which is parallel to the reference axis inside the vehicle center plane C with respect to the left and right direction of the dump truck 1. Hereinafter, a specific example of attaching the radar devices 21 and 22 will be described.

The radar device 21 is disposed toward the diagonally forward left side and the radar device 22 is disposed toward the diagonally forward right side. Specifically, as illustrated in FIG. 7, the irradiation center axis C21 of the radar device 21 in the horizontal direction is inclined by 45° toward the left side of the dump truck 1 in the counter-clockwise direction from the reference axis as the reference axis inside the center plane (hereinafter, referred to as an appropriate vehicle center plane) C of the dump truck 1. The irradiation center axis C22 of the radar device 22 in the horizontal direction is inclined by 45° toward the right side of the dump truck 1 in the clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. The respective irradiation center axes C21 and C22 intersect each other. Further, each of the irradiation center axes of the radar devices 21 and 22 in the vertical direction has a depression angle of about 5°. With such a configuration, it is possible to detect all obstacles in a front region from the front end of the dump truck 1.

The radar device 28 and the radar device 23 which are disposed so as to be bilaterally symmetric to each other about the vehicle center plane C will be described by referring to FIG. 6, FIG. 9 illustrating the left side view of the dump truck 1, and FIG. 10 illustrating the right side view of the dump truck 1. The radar device 28 is provided at the left end of the lower deck 2a and near the upper end of the ladder 2c positioned below the upper deck 2b which is provided with the image capturing devices 13 and 15 mainly capturing the left side of the radar devices 21 and 22. The radar device 28 is attached to the lower deck 2b through the bracket B28, and is disposed so as to face the left side and the outside of the radar devices 21 and 22.

The radar device 23 is provided at a position bilaterally symmetric to the radar device 28 about the vehicle center plane C as illustrated in FIG. 10 illustrating the right side view of the dump truck 1 or FIG. 7 to be described later in detail. The radar device 23 is provided at the position of the right end of the lower deck 2a and of the ladder 2c provided at the right side of the dump truck 1 positioned below the upper deck 2b which is provided with the image capturing devices 12 and 14 mainly capturing the right side of the dump truck 1. The radar device 23 is attached to the lower deck 2a through the bracket B23 so as to face the right side and the outside of the dump truck 1.

FIG. 7 illustrates detection ranges of the radar devices 21 to 28. First, a specific attachment example of the radar devices 23 and 28 disposed so as to be bilaterally symmetric to each other about the vehicle center plane C will be described. The irradiation center axis C23 of the radar device 23 in the horizontal direction is inclined by 70° toward the right side of the dump truck 1 in the counter-clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. The irradiation center axis C28 of the radar device 28 in the horizontal direction is inclined by 70° toward the left side of the dump truck 1 in the clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. Further, each of the irradiation center axes of the radar devices 23 and 28 in the vertical direction has a depression angle of about 5°.

The radar devices 23 and 28 detect the object which exists at the side of the dump truck 1, and particularly, at the front side of the front wheel 5 and the rear wheel 6. Further, since the radar devices 23 and 28 are positioned below the vessel 4 and the upper deck 2b, the radar devices are not easily influenced by the collision with rocks flying out from the vessel 4 during the loading operation.

The radar device 27 and the radar device 24 which are disposed so as to be bilaterally symmetric to each other about the vehicle center plane C will be described by referring to FIG. 6, FIG. 9 illustrating the left side view of the dump truck 1, and FIG. 10 illustrating the right side view of the dump truck 1. The radar device 27 is disposed at the side end of an air cleaner 62. The air cleaner 62 is provided at a position protruding toward a left side from a front fender 2g which is positioned at the left side of the dump truck 1 and extends toward the lower deck 2a positioned below the upper deck 2b. The upper deck 2b is provided with the image capturing devices 13 and 15 which mainly capture the left side of the dump truck 1. The radar device 27 is attached to the front fender 2g through the bracket B27 so as face backward. In the embodiment, the attachment height of the radar device 27 is away from the ground surface by about 2.5 m, but the attachment height may be appropriately defined depending on the attachment height of the dump truck 1. The attachment heights of the other radar devices 21 to 26 and 28 may be appropriately defined depending on the size of the dump truck 1.

As illustrated in FIGS. 6 and 7, the radar device 24 is provided at a position which is bilaterally symmetric to the radar device 27 about the vehicle center plane C. The radar device 24 is disposed at the side end of the air cleaner 62. The air cleaner 62 is provided at a position protruding rightward from the right front fender 2g, extending toward the lower deck 2a positioned below the upper deck 2b, of the dump truck 1. The upper deck 2b includes the image capturing devices 12 and 14 which mainly capture the right side of the dump truck 1. The radar device 24 is attached to the front fender 2g through the bracket B24 so as to face backward.

Next, a specific attachment example of the radar devices 24 and 27 will be described. The irradiation center axis C24 of the radar device 24 in the horizontal direction is inclined by 30° toward the right side of the dump truck 1 in the counter-clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. The irradiation center axis C27 of the radar device 27 in the horizontal direction is inclined by 30° toward the left side of the dump truck 1 in the clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. Such an angle is not limited to 30° and may be 45° or less. That is, the angle may be set such that the rear limit lines L24 and L27 in the horizontal detection range face the vehicle center plane C and the irradiation region is provided with a vehicle overlapping region E1 including the front wheel 5 and the rear wheel 6. It is desirable to direct the irradiation center axes C24 and C27 so that the front wheel 5 is slightly included in the irradiation region and the ground contact portion of the rear wheel 6 is included in the irradiation region. Each of the irradiation center axes of the radar devices 24 and 27 in the vertical direction has a depression angle of about 15°. The vehicle overlapping region E1 is a region in which the region inside the dump truck 1 overlaps the irradiation region and is included in the vehicle region to be described later.

The radar devices 24 and 27 detect the object which exists at the side of the dump truck 1, and particularly, the rear region corresponding to the entire region at the side of the vessel. Further, since the respective radar devices 24 and 27 are positioned below the vessel 4 and the upper deck 2b, the radar devices are not easily influenced by the collision with rocks flying out from the vessel 4 during the loading operation.

As illustrated in FIG. 7, the side detection ranges of the radar devices 23 and 24 in the horizontal direction and the side detection ranges of the radar devices 27 and 28 in the horizontal direction respectively include overlapping regions. For this reason, the radar devices 23, 24, 27, and 28 may completely detect the object which exists in both side regions from the front end of the dump truck 1 to the rear end thereof. Further, the radar devices 23 and 24 which are disposed at the right side of the dump truck 1 at the left symmetric position of the dump truck 1 provided with the cab 3 may detect the object which exists at the right side of the dump truck 1 and is not easily seen from the cab 3.

The radar devices 25 and 26 will be described by referring to FIG. 6 and FIG. 11 illustrating the rear side view of the dump truck 1. The radar devices 25 and 26 are disposed at the height of about 2 m from the ground surface and are disposed at the rear side of a casing of a rear axle 71 of a driving shaft of the rear wheel 6 position positioned below a cross member 70 provided with the image capturing device 16 of the vessel 4. Furthermore, the attachment heights of the radar devices 25 and 26 may be appropriately defined depending on the size of the dump truck 1. The radar devices 25 and 26 are respectively attached through the brackets B25 and B26 so as to be bilaterally symmetric to each other about the vehicle center plane C. Further, the radar devices 25 and 26 are provided between bonding portions 73 of rear suspension cylinders 72. The radar device 25 is disposed so as to face the diagonally backward right side and the radar device 26 is disposed so as to face the diagonally backward left side.

As illustrated in FIG. 7, the irradiation center axis C25 of the radar device 25 in the horizontal direction is inclined by 45° toward the right side of the dump truck 1 in the counter-clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. The irradiation center axis C26 of the radar device 26 in the horizontal direction is inclined by 45° toward the left side of the dump truck 1 in the clockwise direction from the reference axis as the reference axis inside the vehicle center plane C. The respective irradiation center axes C25 and C26 intersect each other on the vehicle center plane C below the vessel 4. Further, each of the irradiation center axes of the radar devices 25 and 26 in the vertical direction has a depression angle of 0 to 10°, and in the embodiment, about 5° in the depression angle direction.

The respective radar devices 25 and 26 are attached so as to be bilaterally symmetric to each other about the vehicle center plane C and the respective irradiation center axes C25 and C26 intersect each other. For this reason, it is possible to completely detect the object which exists in the rear region in the rear end of the dump truck 1. In particular, the radar devices 25 and 26 are disposed in the casing of the rear axle 71 lower than the cross member 70 so as to have a small depression angle. As illustrated in FIGS. 12 and 13, the radar devices 25 and 26 which are provided at the low position of the dump truck 1 so as to have a small depression angle may simultaneously detect the object far from the dump truck 1 and the object hidden at the lower side or the rear side of the vessel 4. In the embodiment, the irradiation center axis C25 of the radar device 25 in the horizontal direction and the irradiation center axis C26 of the radar device 26 in the horizontal direction are set to 45° with respect to the vehicle center plane C, but may be 45° or less. For example, the angle may be 30°. The value may be defined depending on the backward projection degree of the radar devices 25 and 26 with respect to the rear end of the rear wheel 6.

Eight radar devices 21 to 28 may detect the relative position between the dump truck 1 and the object in the detection range in the entire circumference of the dump truck 1 by 360°. Eight radar devices 21 to 28 respectively transmit the relative position information items representing the relative positions between the respectively detected objects and the dump truck 1 to the controller 100. In this way, a plurality of (eight) radar devices 21 to 28 are provided in the vehicle body portion 2, and may detect the object which exists in the entire circumference of the vehicle body portion 2.

The radar devices 21 to 28 which detect the objects existing in the respective directions of the dump truck 1 are attached to the members lower than the respective image capturing devices 11 to 16 which capture the respective directions of the dump truck 1 so as to generate the bird's eye image 200. It is possible to reduce a sense of discomfort for the generated bird's eye image 200 when the respective image capturing devices 11 to 16 are disposed at a high position so as to generate the bird's eye image 200. Further, even when using a radar device of which an irradiation region has a narrow angle in the perpendicular direction, it is possible to detect the objects from the near position to the far position of the dump truck 1 by providing the radar device at a position lower than the image capturing devices 11 to 16. As a result, it is possible to display a mark corresponding to the object position information detected by the radar devices 21 to 28 in the bird's eye image 200 which is generated by the capturing operation of the image capturing devices 11 to 16 in the bird's eye image 200.

<Controller>

The controller 100 illustrated in FIG. 3 displays the existence of the object in the periphery of the dump truck 1 in the bird's eye image 200 by using the image capturing devices 11 to 16 and the radar devices 21 to 28 and notifies the existence of the object to the operator. As illustrated in FIG. 3, the controller 100 includes an bird's eye image synthesizing unit 110, a camera image switching/viewing point changing unit 120, an object position information generating unit 130, a display control unit 140, an alarm control unit 150, an object information collecting unit 210, and an object processing unit 220.

The bird's eye image synthesizing unit 110 is connected to the image capturing devices 11 to 16 as illustrated in FIG. 3. The bird's eye image synthesizing unit 110 receives a plurality of image information items (the first image information to the sixth image information) which are respectively generated by the capturing of the respective image capturing devices 11 to 16. Then, the bird's eye image synthesizing unit 110 synthesizes the images corresponding to the received plurality of image information items and generates the bird's eye image 200 including the entire periphery of the dump truck 1. Specifically, the bird's eye image synthesizing unit 110 generates the bird's eye image information for displaying the bird's eye image 200, obtained by projecting a plurality of images onto a predetermined projection plane, on the monitor 50 by respectively changing the coordinates of the plurality of image information items.

As illustrated in FIG. 3, the camera image switching/viewing point changing unit 120 is connected to the image capturing devices 11 to 16. Then, the camera image switching/viewing point changing unit 120 switches the bird's eye image 200 and the images captured by the respective image capturing devices 11 to 16 and displayed on the screen of the monitor 50 in response to, for example, the obstacle detection result by the radar devices 21 to 28. Further, the camera image switching/viewing point changing unit 120 changes the image information items acquired by the respective image capturing devices 11 to 16 to the image information from the viewing point of the upward infinity.

As illustrated in FIG. 3, the object position information generating unit 130 is configured to transmit the control information, the control data, and the like to the camera image switching/viewing point changing unit 120, the display control unit 140, and the alarm control unit 150. The object position information generating unit 130 generates the object position information for synthesizing and displaying the object position information acquired by the radar devices 21 to 28 in the bird's eye image 200 which is formed by synthesizing the image information acquired by the respective image capturing devices 11 to 16 and transmits the result to the camera image switching/viewing point changing unit 120 and the display control unit 140.

As illustrated in FIG. 3, the display control unit 140 is configured to receive the control information, the control data, and the like from the bird's eye image synthesizing unit 110, the camera image switching/viewing point changing unit 120, the object position information generating unit 130, and the alarm control unit 150. The display control unit 140 generates the bird's eye image 200 including the position of the object based on the bird's eye image information in the entire periphery of the dump truck 1 generated by the bird's eye image synthesizing unit 110 and the object position information in the entire periphery of the dump truck 1 acquired by the radar devices 21 to 28. The image is displayed on the monitor 50. In this way, the display control unit 140 may notify the existence of the object in the periphery of the dump truck 1 as an alarm to the operator of the dump truck 1 by displaying the mark representing the object existing in the periphery of the dump truck 1 on the monitor 50 based on the object position information. Furthermore, the display control unit 140 may display the mark representing the object existing in the periphery of the dump truck 1 on the monitor 50 together with the image generated by the image information acquired by the image capturing devices 11 to 16.

The alarm control unit 150 acquires the respective outputs (the detection signals, the control signals, or the like) from the object position information generating unit 130, a shift lever position sensor 37S, the parking brake operation switch 37P, a dump lever position sensor 38S, a payload control device 40, and a vessel sitting sensor 43. Further, the alarm control unit 150 transmits the respective control signals to an alarm sounding device 51 with a speaker and the like, the display control unit 140, and the radar devices 21 to 28.

The alarm control unit 150 acquires the information of the object, transmitted from the object position information generating unit 130, detected by the radar devices 21 to 28, and existing around the dump truck 1. The information of the object includes the object position information and the information of the object which is detected by the radar devices 21 to 28. The alarm control unit 150 which acquires the information of the object generates, for example, an alarm sound using the alarm sounding device 51. Further, the alarm control unit 150 transmits an instruction for displaying a mark as control information to the display control unit 140. The display control unit 140 which receives the instruction displays a mark corresponding to the detected object in the bird's eye image 200 displayed on the monitor 50. In this way, the alarm control unit 150 generates an alarm, that is, an alarm with respect to the existence of the object around the dump truck 1 based on the detection results of the radar devices 21 to 28.

The alarm control unit 150 selects a notification mode for notifying an alarm or a standby mode for stopping the notification of the alarm in response to the state of the dump truck 1. For example, the alarm control unit 150 acquires a detection signal from the shift lever position sensor 37S, the parking brake operation switch 37P, the dump lever position sensor 38S, the payload control device 40, or the vessel sitting sensor 43. The detection signal is the information (appropriately referred to as the vehicle state information) on the state of the dump truck 1. The alarm control unit 150 selects the notification mode or the standby mode based on the acquired work vehicle state information.

The notification mode is a mode for generating an alarm in a manner such that the alarm control unit 150 generates an alarm sound or displays a mark on the monitor 50 when the radar devices 21 to 28 detect the object existing around the dump truck 1. The restriction mode is a mode in which the alarm control unit 150 restricts the notification of the alarm corresponding to the object detected by the radar devices 21 to 28 when the radar devices 21 to 28 detect the object existing around the dump truck 1. For example, it is possible to restrict the generation of the alarm sound and the display of the mark on the monitor 50. The restriction of the notification of the alarm includes, for example, a case where the alarm is notified by the sound and the mark, a case where the alarm is notified only by the mark while stopping the notification of the sound, a case where the alarm is generated only by the sound while stopping the notification of the mark, and a case where the notification of both the sound and the mark is stopped. That is, in the embodiment, the restriction of the notification of the alarm indicates a case where at least one of the notification with respect to the sound and the notification with respect to the vision is stopped. In this way, the alarm control unit 150 controls the notification of the alarm.

The payload control device 40 which is connected to the alarm control unit 150 is a device which obtains the weight (the loading amount) of the load loaded on the vessel 4, that is, the payload and outputs the result. The payload control device 40 is electrically connected with a pressure sensor 41. A suspension (not illustrated) is provided in each of the left and right front wheels 5 and the left and right rear wheels 6 of the dump truck 1. That is, the dump truck 1 includes four suspensions, and each suspension includes a suspension cylinder enclosing oil therein. The pressure sensor 41 is attached to each suspension cylinder. That is, the dump truck 1 is equipped with four pressure sensors 41. Then, four pressure sensors 41 detect the pressures (for example, the bottom pressures) of the oils inside the respective suspension cylinders. The payload control device 40 obtains the payload based on the detection result of the pressure sensor 41 and outputs the result. The vessel sitting sensor 43 is a sensor which detects a state in which the vessel 4 stands from the frame 2f of the dump truck 1, is lowered toward the frame 2f, and is returned to the original position so as to become the loading posture. As the vessel sitting sensor 43, various position detecting sensors such as a limit switch or an ultrasonic sensor may be used.

The shift lever position sensor 37S detects the position of the shift lever 37. For this reason, it is possible to recognize any one of the running modes such as a forward running mode, a backward running mode, a neutral mode, and a parking mode of the dump truck 1 and the gear shift stage of the dump truck 1 from the detection result of the shift lever position sensor 37S. The parking brake operation switch 37P is operated so as to operate the parking brake when the dump truck 1 is parked. Even by the output of the parking brake operation switch 37P, the parking of the dump truck 1 may be recognized. The dump lever position sensor 38S detects the position of the dump lever 38. For this reason, the controller 100 may recognize whether the dump truck 1 discharges a load from the detection result of the dump lever position sensor 38S.

The storage unit 160 stores a computer program for executing the control of the alarm when the dump truck 1 loads a load thereon and data necessary for the control of the alarm. The alarm control unit 150, the display control unit 140, and the like execute the control of the alarm by reading and executing the computer program stored in the storage unit 160 or reading the data necessary for the control of the alarm.

As illustrated in FIG. 3, the object information collecting unit 210 is connected to the radar devices 21 to 28. Further, the object information collecting unit 210 is configured to transmit the control information, the control data, and the like to the object processing unit 220. The object information, collecting unit 210 receives the object detection result in the respective detection ranges of the radar devices 21 to 28 and transmits the object detection result to the object processing unit 220.

The object processing unit 220 transmits the object position information received from the object information collecting unit 210 to the object position information generating unit 130.

The controller 100 is configured by the combination of, for example, a computer including a CPU (Central Processing Unit) as a calculation device and a storage device and an image processing device (for example, an image board) executing an image process such as a synthesis of the bird's eye image. The image processing device is equipped with, for example, an exclusive IC (for example, FPGA: Field-Programmable Gate Array) executing an image process such as a synthesis of the bird's eye image, a memory (for example, VRAM: Video Random Access Memory), and the like.

In the embodiment, as illustrated in FIG. 4, the image capturing devices 11 to 16 are disposed at the front surface and the side surface of the upper deck 2b and below the vessel 4. Then, the controller 100 generates the bird's eye image 200 illustrated in FIG. 5 by synthesizing the first image information to the sixth image information captured and acquired by the image capturing devices 11 to 16 and displays the result on the monitor 50 which is disposed at the front side of the driver seat 31 inside the cab 3. At this time, the monitor 50 displays an image such as the bird's eye image 200 in response to the control of the controller 100. The bird's eye image 200 may be obtained by the controller 100 through the synthesizing of the first image information to the sixth image information corresponding to the first region 11C to the sixth region 16C captured by the image capturing devices 11 to 16. The periphery monitoring system 10, and more specifically, the display control unit 140 of the controller 100 displays the bird's eye image 200 on the monitor 50. Further, the display control unit 140 acquires the object position information generated by the object position information generating unit 130 and displays the mark representing the object existing in the periphery of the dump truck 1 in, for example, the bird's eye image 200 of the monitor 50. By using the periphery monitoring system 10, the operator of the dump truck 1 may monitor the entire range of 360° in the periphery of the dump truck 1 just by seeing the bird's eye image 200 displayed on the monitor 50.

<Example of Image Displayed on Monitor 50 by Controller 100>

FIG. 14 is a diagram illustrating an example of an image displayed on the monitor 50 by the controller 100. In FIG. 14, the upper side UP, the lower side UN, the left side L, and the right side R of the monitor 50 are illustrated. The front side F and the rear side B of the dump truck 1 are illustrated. The dump truck 1 is displayed on the monitor 50 so that the upper side of the monitor 50 becomes the front side of the dump truck 1 and the lower side of the monitor 50 becomes the rear side of the dump truck 1. In the embodiment, the monitor 50 displays a first image 2A, a second image 2B, and a third image 2C on the same screen. In a case where the alarm is notified, at least one of the first image 2A, the second image 2B, and the third image 2C may be displayed on the monitor 50.

The first image 2A includes alarm regions C11 to C16 corresponding to the first region 11C to the sixth region 16C existing around the dump truck 1 illustrated in FIG. 5. The alarm regions C11 to C16 respectively include boundaries OL1 to OL6 with respect to the adjacent alarm regions. In the alarm regions C11 to C16, the boundaries OL1 to OL6 are highlighted when the mark indicating the object existing around the dump truck 1 exists inside the boundaries OL1 to OL6. In the example illustrated in FIG. 14, since the marks MKa, MKb, and MKc respectively exist in the alarm regions C11, C14, and C16, the boundaries OL1, OL4, and OL6 are highlighted. The boundaries OL1, OL4, and OL6 are emphasized by, for example, displaying the boundaries in red or in a flickering state.

In the first image 2A, the dotted lines RL1, RL2, and RL3 are displayed around the dump truck 1. The dotted line RL1 is displayed at a position close to the dump truck 1 and the dotted line RL3 is displayed at a position far from the dump truck 1. The dotted line RL2 is displayed between the dotted line RL1 and the dotted line RL3. The dotted lines RL1, RL2, and RL3 respectively indicate positions away from the dump truck 1 by a predetermined distance. The operator of the dump truck 1 may recognize each distance of the marks MKa, MKb, and MKc displayed on the first image 2B with respect to the dump truck 1 by the dotted lines RL1, RL2, and RL3.

The second image 2B is an image which is captured by at least one of the plurality of image capturing devices 11 to 16. The periphery monitoring system 10 displays an image captured by the image capturing devices 11 to 16 as the second image 2B on the monitor 50. In this way, the operator of the dump truck 1 may see the peripheral environment of the dump truck 1. In the example illustrated in FIG. 14, a vehicle 60 existing before the dump truck 1 is displayed in the second image 2A. The vehicle 60 corresponds to the mark MKa.

In the third image 2C, the dump truck 1 and the first alarm region C11 to the sixth alarm region C16 are simply depicted and displayed. The third image 2C illustrates at least one of the position as the subject of the alarm and the position displayed by the second image 2B. By such an image structure, the third image 2C has a function of illustrating the relation between the first image 2A and the second image 2B. The position as the subject of the alarm is a region where the marks MKa, MKb, and MKc exist. In this example, the first alarm region C11, the fourth alarm region C14, and the sixth alarm region C16 are provided. In the example illustrated in FIG. 14, the regions are indicated by a mesh or a hatching.

The position in which the second image 2B is displayed is the first alarm region C11. In the example illustrated in FIG. 14, the region is indicated by a mesh. In this way, the third image 2C displays the alarm region which becomes the subject of the alarm and the alarm region in which the images captured by the image capturing devices 11 to 16 are displayed as the second image 2B in different manners. The operator of the dump truck 1 may intuitively recognize the region in which the object exists and the alarm region which is displayed as the second image 2B by seeing the third image 2C displayed on the monitor 50. For this reason, it is becomes easier for the operator to further reliably and accurately recognize the positional relation between the dump truck 1 and the object. Next, the control (appropriately referred to as the load discharging alarm control) of the alarm when the dump truck 1 discharges the load will be described.

<Load Discharging Alarm Control>

FIG. 15 is a diagram illustrating a state where the dump truck 1 discharges a load PL from the vessel 4. The dump truck 1 discharges the load PL loaded on the vessel 4 to a soil disposal field. At this time, the operator of the dump truck 1 causes the vessel 4 to stand up by operating a dump lever 38 illustrated in FIGS. 2 and 3. When the dump lever 38 is operated, hydraulic oil flows from a hydraulic pump (not illustrated) to an actuator 75 as a hydraulic cylinder, so that a cylinder rod of a hydraulic cylinder moves in a telescopic manner. The front end of the cylinder rod is connected to a flange at the bottom portion of the vessel 4 through a pin. Further, the rear end of the cylinder tube of the hydraulic cylinder (the actuator 75) is connected to a flange provided in the frame 2f of the dump truck 1 through a pin. When the dump lever 38 is operated in a direction in which the vessel 4 stands up (for example, the upward direction), the cylinder rod of the hydraulic cylinder (the actuator 75) protrudes, and the vessel 4 stands up about the rear end side of the dump truck 1, so that the load PL is discharged from the rear side.

The load PL is discharged from the rear portion of the vessel 4. The radar devices 25 and 26 which detect the object existing at the rear side of the dump truck 1 are disposed below the vessel 4 and between both rear wheels 6. For this reason, the radar devices 25 and 26 also detect the load PL discharged from the rear side of the vessel 4 when discharging the load PL. The other radar devices 21 to 24, 27, and 28 (the radar devices 27 and 28 illustrated in FIG. 15) do not detect the discharging of the load PL since the rear side of the dump truck 1, that is, the rear side of the vessel 4 is not the detection range.

When the radar devices 25 and 26 detect the load PL when discharging the load PL and the controller 100 notifies the alarm based on the detection result, the notification of the alarm is very complicated. In particular, the alarm is particularly complicated when the alarm sound is notified. When the notification of the alarm becomes complicated, there is a possibility that the operator of the dump truck 1 may feel bothered and turn off the periphery monitoring system 10 so as to disable the operation. Further, the amount of the load PL discharged from the vessel 4 is large and the load is close to the radar devices 25 and 26. For this reason, the reflection intensity of the radio wave is very large, and hence there is a possibility that the radar devices 25 and 26 may receive a radio wave with excessively large reflection intensity. In a case where the controller 100 displays a mark on the monitor 50 along with the bird's eye image 200 and the like, when the output of the radar devices 25 and 26 which receive a radio wave with excessively large reflection intensity is used, an event occurs in which the monitor 50 displays erroneous information that an erroneous mark is displayed as an object, that is, an image (a false image) representing the existence of the object is displayed. When an illusion image is displayed on the monitor 50, the operator is misguided as if the object exists and hence the other information such as the bird's eye image 200 may not be easily seen. There is a possibility that such an illusion image may be displayed when the load PL is discharged. However, even when the vessel 4 just stands up, the radar devices 25 and 26 detect the rear end of the vessel 4, and hence there is a possibility that such an event may occur. That is, the radar devices 25 and 26 detect the rear end of the vessel 4 as the object. In this way, there is a possibility that the load PL or the rear end of the vessel 4 may influence the periphery monitoring system 10 when the vessel 4 stands up.

In order to prevent the above-described event, the periphery monitoring system 10 illustrated in FIG. 3, more specifically, the controller 100 executes the load discharging alarm control and selects the notification mode or the standby mode in response to the state of the dump truck 1. As the state of the dump truck 1, there is a state of the vessel 4 or a state when the load PL is discharged, but the vessel 4 needs to stand up when discharging the load PL. For this reason, in the embodiment, the notification mode or the standby mode is mainly selected based on the state of the vessel 4. Furthermore, the state of the dump truck 1 used for the selection of the notification mode or the standby mode is not limited thereto. Next, a procedure in which the controller 100 executes the load discharging alarm control will be described.

FIG. 16 is a flowchart illustrating a procedure of the load discharging alarm control which is executed by the controller 100. The periphery monitoring system 10 is normally in the notification mode. That is, when the radar devices 21 to 28 detect the object around the dump truck 1, the controller 100 selects a mode for notifying the alarm. When executing the load discharging alarm control, in step S101, the alarm control unit 150 of the controller 100 illustrated in FIG. 3 acquires the information of the dump truck 1. The information is information (hereinafter, appropriately referred to as the vehicle state information) on the state of the dump truck 1, and the alarm control unit 150 may acquire the information from, for example, the control device of the dump truck 1 through a communication line provided in the vehicle.

Next, the routine proceeds to step S102, and the alarm control unit 150 determines whether to switch the alarm notification mode based on the vehicle state information acquired in step S101. Whether to switch the alarm notification mode may be determined based on, for example, the state of the vessel 4 or the running mode of the dump truck 1. In a case where whether to switch the alarm notification mode is determined based on the state of the vessel 4, the alarm control unit 150 may switch the alarm notification mode, for example, at a timing in which the vessel 4 starts to stand up. The timing in which the vessel 4 starts to stand up may be set to, for example, the timing in which the dump lever position sensor 38S detecting the position or the operation of the dump lever 38 operating the vessel 4 outputs a signal corresponding to the operation of causing the vessel 4 to stand up to the dump lever 38. Since the operation of the vessel 4 is directly concerned with the discharging of the load PL, it is possible to reliably determine whether to switch the alarm notification mode by using the state of the vessel 4.

In a case where whether to switch the alarm notification mode is determined based on the running mode of the dump truck 1, the alarm control unit 150 may switch the alarm notification mode, for example, when the brake of the dump truck 1, that is, the parking brake in the embodiment is operated (a parking mode) or the wheel lock brake (a wheel lock mode) is operated. This is because there is a high possibility that the load PL may be discharged when the brake is operated. Since the parking brake or the wheel lock brake is also concerned with the discharging of the load PL, it is possible to improve the accuracy of determining whether to switch the alarm notification mode by using such a state.

The parking brake is operated when the shift lever 37 illustrated in FIGS. 2 and 3 is set to the parking position or the parking brake operation switch 37P illustrated in FIG. 3 is turned on. The parking brake applies the braking force only to the rear wheel 6 by using a spring. Since the braking force is a spring force, the braking force is weaker than that of the hydraulic brake. In many cases, the wheel lock brake is generally used for a so-called electric dump in which the dump truck 1 drives a motor by receiving power from a line and runs by the driving force or drives a generator by an engine, drives a motor by the generated power, and runs by the driving force. The wheel lock brake generates an electric signal by an operation of a wheel lock switch (not illustrated), operates a hydraulic valve, and applies the braking force obtained by the hydraulic brake only to the rear wheel 6.

Further, whether to switch the alarm notification mode may be determined based on, for example, the current position of the dump truck 1. For example, when it is determined that the current position of the dump truck 1 detected by the GPS sensor is the soil disposal field in a state where the GPS (Global Positioning System) sensor is mounted on the dump truck 1 and the geometrical information of the soil disposal field is stored in advance in the storage unit 160 of the controller 100, the alarm control unit 150 may switch the alarm notification mode. This is because the dump truck 1 discharges the load PL of the vessel 4 in the soil disposal field. Since there is a very high possibility that the load PL may be discharged when the current position of the dump truck 1 is the soil disposal field, it is possible to improve the accuracy of determining whether to switch the alarm notification mode by using the information. Furthermore, the position information representing an arbitrary position may be stored in advance in the storage unit 160 in addition to the position information representing the position of the soil disposal field stored in the storage unit 160. The arbitrary position may be a place where the vessel 4 stands up, for example, a place which is provided inside a mine so as to examine or repair the dump truck 1.

Hereinafter, the process after step S102 of the load discharging alarm control will be described. For example, when the information on the state of the vessel 4 is used as the vehicle state information used to determine whether to switch the alarm notification mode, the alarm control unit 150 acquires the output of the dump lever position sensor 38S illustrated in FIG. 3. When the alarm control unit 150 acquires the signal corresponding to the operation of causing the vessel 4 to stand up from the dump lever position sensor 38S, it is determined that the alarm notification mode needs to be switched (Yes in step S102). In this case, the alarm control unit 150 causes the process to proceed to step S103. Further, when the alarm control unit 150 does not acquire the signal corresponding to the operation of causing the vessel 4 to stand up from the dump lever position sensor 38S, it is determined that the alarm notification mode does not need to be switched (No in step S102). In this case, the alarm control unit 150 ends the load discharging alarm control while keeping the notification mode.

In step S103, the alarm control unit 150 stops the notification of the alarm. That is, the alarm control unit 150 switches the notification mode to the standby mode. In the embodiment, in the standby mode, the notification of the alarm corresponding to the detection subjects of the radar devices 25 and 26, that is, the notification of the alarm sound and the display of the mark on the monitor 50 are stopped. Since the stopping of the notification of the alarm in the standby mode corresponds to the detection subjects of the radar devices 25 and 26, the alarm with respect to the detection subject of the other radar devices 21 to 24, 27, and 28 is not stopped. Accordingly, when the radar devices 21 to 24, 27, and 28 detect the object around the dump truck 1 in the standby mode, the corresponding alarm is notified.

The alarm control unit 150 may set the standby mode by stopping the notification of the alarm corresponding to the detection subjects of the radar devices 25 and 26 through the stopping of the operation of the radar devices 25 and 26. In order to stop the operation of the radar devices 25 and 26, for example, there is known a method of stopping the supply of power to the radar devices 25 and 26, that is, a method of turning off the radar devices 25 and 26. Further, the alarm control unit 150 may set the standby mode by stopping the notification of the alarm corresponding to the detection subjects of the radar devices 25 and 26 as a state where the detection results of the radar devices 25 and 26 are not input to the controller 100.

Further, the alarm control unit 150 may set the standby mode in a manner such that the alarm is not notified even when the detection results of the radar devices 25 and 26 are input to the controller 100. Specifically, the alarm control unit 150 sets the standby mode in a manner such that the alarm sound is not notified, the alarm region C16 corresponding to the detection ranges of the radar devices 25 and 26 and illustrated in FIG. 14 is not highlighted, and the mark is not displayed. Among these, the standby mode may be realized in accordance with any method.

In a case where the operation of the radar devices 25 and 26 is stopped, the radar devices 25 and 26 do not output the detection results, and hence no detection result is input to the controller 100. Meanwhile, in a case where the detection results of the radar devices 25 and 26 are not input to the controller 100, the controller 100 does not receive the input even when the radar devices 25 and 26 output the detection result when the object is detected. Alternatively, in a case where the alarm control unit 150 does not notify the alarm, the controller 100 receives the detection result when the radar devices 25 and 26 detect the object.

In a case where the standby mode is realized in a manner such that the alarm control unit 150 does not notify the alarm, the alarm is not notified, but the saturated outputs of the radar devices 25 and 26 are input to the controller 100. For this reason, there is a possibility that the controller 100 may give a certain influence on a computer program or the like for realizing the periphery monitoring system 10 by the outputs of the radar devices 25 and 26 receiving a radio wave with excessively large reflection intensity. In a case where the standby mode is realized in a manner such that the detection results of the radar devices 25 and 26 are not input to the controller 100, the saturated outputs of the radar devices 25 and 26 are not input to the controller 100. However, since the radar devices 25 and 26 are operated, there is a possibility that the radar devices may receive a radio wave with excessively large reflection intensity. As a result, there is a possibility, for example, that the durability of the radar devices 25 and 26 may be degraded. In a case where the standby mode is realized by stopping the operation of the radar devices 25 and 26, the radar devices 25 and 26 are not operated, and hence may not receive a radio wave with excessively large reflection intensity. In this way, when the influence on the periphery monitoring system 10 is considered, it is most desirable to realize the standby mode by stopping the operation of the radar devices 25 and 26. This does not mean that the other two methods are excluded.

When the notification mode is switched to the standby mode, the routine proceeds to step S104, and the alarm control unit 150 determines whether the return condition is satisfied. For example, it is possible to mention that the return condition is established in a case where the vessel 4 stands up to discharge the load PL and returns to the original position or the loading of the load PL of the vessel 4 becomes a predetermined threshold value or less when the load PL of the vessel 4 is completely discharged.

The time in which the vessel 4 completely discharges the load PL may be set to, for example, the time in which the dump lever position sensor 38S detects a state where an operation of returning the standing vessel 4 to the loading posture is input to the dump lever 38 illustrated in FIG. 3. Further, the time in which the loading of the load PL of the vessel 4 becomes a predetermined threshold value or less may be set to the time in which the vessel 4 completely discharges the load PL. The loading of the load PL of the vessel 4 may be obtained by the payload control device 40 illustrated in FIG. 3. The predetermined threshold value may be set to a value which may be regarded that the load PL is discharged. The state where the vessel 4 stands up to discharge the load PL and returns to the original position may be detected by, for example, the vessel sitting sensor 43 illustrated in FIG. 3.

Further, for example, it is possible to mention that the return condition is established in a case where the parking brake of the dump truck 1 is released or the wheel lock brake is released particularly in a case of an electric dump. The parking brake is released when the shift lever 37 is moved from the parking position or the parking brake operation switch 37P is turned off. The wheel lock brake is released by the operation of the wheel lock switch (not illustrated).

In a case where the return condition is not established (No in step S104), the alarm control unit 150 repeats the processes in step S103 and step S104. In a case where the return condition is established (Yes in step S104), the routine proceeds to step S105, and the alarm control unit 150 switches the standby mode to the notification mode and releases the stopping of the alarm. In this way, when the load PL is discharged and the influence of the load PL with respect to the radar devices 25 and 26 is reduced, the alarm with respect to the object existing at the rear side of the dump truck 1 is notified. As a result, it is possible to reduce the influence on the periphery monitoring system 10 due to the state where the vessel 4 stands up to discharge the load PL. Furthermore, when the vessel 4 stands up, the rear end of the vessel 4 influences the periphery monitoring system 10 as in the load PL. For this reason, it is more desirable to mention that the return condition is established when the radar devices 25 and 26 do not detect the rear end of the vessel 4 in step S104. For example, it is possible to mention that the return condition is established when the vessel 4 sits on the original position. In this way, it is possible to reduce the influence in which the rear end of the vessel 4 and the load PL influence the periphery monitoring system 10.

As described above, the periphery monitoring system 10 selects the notification mode or the standby mode in response to the state of the dump truck 1 (the vehicle state information representing the work vehicle state). In this way, since the notification mode for setting the alarm notification state may be switched to the standby mode for stopping the notification of the alarm at the timing in which the dump truck 1 causes the vessel 4 to stand up, it is possible to reduce the influence in which at least one of the load PL and the end of the vessel 4 influences the periphery monitoring system 10.

While the embodiment has been described, the embodiment is not limited to the above-described content. Further, the constituents that are described above include a constituent that is easily supposed by the person skilled in the art, a constituent that has substantially the same configuration, and a constituent that is included in a so-called equivalent scope. Further, the above-described constituents may be appropriately combined with each other. Furthermore, the constituents may be omitted, replaced, or modified in various forms in the scope without departing from the spirit of the embodiment.

Mitsuta, Shinji, Nakanishi, Yukihiro, Kurihara, Takeshi

Patent Priority Assignee Title
Patent Priority Assignee Title
4797673, Feb 10 1984 WIESEMAN, DALE Driver alerting device
20060049927,
20080048886,
20080086349,
20120209502,
CN1744133,
JP2004251024,
JP2007085091,
JP2008303648,
JP2009166669,
////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Nov 29 2012Komatsu Ltd.(assignment on the face of the patent)
Jun 19 2013MITSUTA, SHINJIKomatsu LtdASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0310160376 pdf
Jun 19 2013NAKANISHI, YUKIHIROKomatsu LtdASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0310160376 pdf
Jun 19 2013KURIHARA, TAKESHIKomatsu LtdASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0310160376 pdf
Date Maintenance Fee Events
Mar 19 2020M1551: Payment of Maintenance Fee, 4th Year, Large Entity.
Mar 20 2024M1552: Payment of Maintenance Fee, 8th Year, Large Entity.


Date Maintenance Schedule
Oct 04 20194 years fee payment window open
Apr 04 20206 months grace period start (w surcharge)
Oct 04 2020patent expiry (for year 4)
Oct 04 20222 years to revive unintentionally abandoned end. (for year 4)
Oct 04 20238 years fee payment window open
Apr 04 20246 months grace period start (w surcharge)
Oct 04 2024patent expiry (for year 8)
Oct 04 20262 years to revive unintentionally abandoned end. (for year 8)
Oct 04 202712 years fee payment window open
Apr 04 20286 months grace period start (w surcharge)
Oct 04 2028patent expiry (for year 12)
Oct 04 20302 years to revive unintentionally abandoned end. (for year 12)