A control device for a vehicle camera may include: a wiper relay connected to a multi-function switch to operate a vehicle wiper at a predetermined cycle; a camera controller connected to the wiper relay, and synchronizing the operation cycle of the wiper with an imaging cycle of the vehicle camera such that the vehicle camera images the front of the vehicle according to the operation period of the wiper; and an image filter connected to the camera controller, estimating the position of the wiper from edge information of the images taken by the camera, and searching and removing the wiper in the taken images.
|
5. A control device for a vehicle camera, comprising:
a wiper relay connected to a multi-function switch to operate a vehicle wiper at a predetermined cycle;
a camera controller connected to the wiper relay, and synchronizing the operation cycle of the wiper with an imaging cycle of the vehicle camera such that the vehicle camera images the front of the vehicle according to the operation period of the wiper; and
an image filter connected to the camera controller, estimating a position of the wiper based on the operation cycle, setting the estimated position of the wiper as a region of interest, and removing the wiper in an image taken by the vehicle camera by extracting an edge within the region of interest.
1. A control method of a vehicle camera, comprising:
manipulating a multi-function switch to operate a wiper connected to a wiper relay at a predetermined cycle;
synchronizing, by a camera controller connected to the vehicle camera, an imaging operation of the vehicle camera to image the front of the vehicle with the operation of the wiper;
estimating, by an image filter connected to the camera controller, a position of the wiper based on a cycle of the operation of the wiper; and
when the position of the wiper is estimated, setting, by the image filter, the estimated position of the wiper as a region of interest, and removing the wiper in an image taken by the vehicle camera by extracting an edge within the region of interest.
2. The control method according to
an imaging cycle at which the vehicle camera images the front of the vehicle is synchronized with an operation period in which the wiper reciprocates on the front windshield glass of the vehicle and a suspension period in which the operation of the wiper is suspended after the operation period.
3. The control method according to
the time during which the vehicle camera images the front of the vehicle is equal to the sum total of a first imaging period corresponding to 1/n multiple of the time required for the operation period in which the wiper reciprocates on the front windshield of the vehicle and a second imaging period corresponding to 1/n multiple of the time required for the suspension period in which the operation of the wiper is suspended after the operation period, where n is a positive integer equal to or larger than 2, and
the position of the wiper is estimated through image information based on the sum total.
4. The control method according to
½ cycle of a reciprocation signal transmitted to the wiper from the wiper relay, or a cycle at which the wiper is moved from the left side to the right side or from the right side to the left side.
6. The control device of
7. The control device of
8. The control device of
|
This application claims priority to Korean Patent Application No. 10-2013-0165319, filed on Dec. 27, 2013, the disclosure of which is incorporated herein by reference in its entirety.
Field of the Invention
Exemplary embodiments of the present invention relate to a controlling device and method of a vehicle camera, and more particularly, to a controlling device and method of a vehicle camera, which is capable of handling a situation in which it is difficult acquire an image due to a wiper operation of the vehicle in case of bad weather.
Description of the Related Art
When a vehicle camera takes images while a wiper is operated due to an external factor such as rain or snow, the quality of the images may be degraded by interference of the wiper operation or the rain or snow in the images.
The operation of the conventional vehicle camera is set in a fixed mode or an automatic mode (exposure, gain and the like) depending on external illuminance. Thus, when the above-described external factor occurs, the performance of a front-view camera system cannot be stably secured.
In particular, when an external factor occurs in the fixed mode, the operation of an intelligent driver assistance system may be limited in a situation where the stability of a driver is required due to the operation of the wiper.
In the automatic mode, the camera may be controlled depending on the external illuminance, and thus provide an image of which the quality is improved more than in the fixed mode. Under the condition where the external illuminance is hardly changed, however, the camera may not properly handle a situation in which an external factor such as the amount of rain or the operation speed of the wiper is changed.
From the above-described point of view, Japanese Patent Laid-open Publication No. H08-72641 has disclosed an image recognizing device for vehicle, which includes an imaging control unit to prevent the reception of image signals during a period of time corresponding to the operation of a wiper, in order to secure the precision of image information. In such an image recognizing device, however, since the imaging control unit prevents the reception of image signals during the period of time corresponding to the operation of the wiper, the input image information is inevitably limited.
The present invention has been made in view of the above problems, and it is an object of the present invention to provide a control device of a vehicle camera, which is capable of handling a situation in which it is difficult to acquire an image due to a wiper operation of a vehicle in case of bad weather.
Other objects and advantages of the present invention can be understood by the following description, and become apparent with reference to the embodiments of the present invention. Also, it is obvious to those skilled in the art to which the present invention pertains that the objects and advantages of the present invention can be realized by the means as claimed and combinations thereof.
In accordance with one aspect of the present invention, a control device for a vehicle camera may include: a wiper relay connected to a multi-function switch to operate a vehicle wiper at a predetermined cycle; a camera controller connected to the wiper relay, and synchronizing the operation cycle of the wiper with an imaging cycle of the vehicle camera such that the vehicle camera images the front of the vehicle according to the operation period of the wiper; and an image filter connected to the camera controller, estimating the position of the wiper from edge information of the images taken by the camera, and searching and removing the wiper in the taken images.
In accordance with another aspect of the present invention, a control method of a vehicle camera may include: manipulating a multi-function switch to operate a wiper connected to a wiper relay at a predetermined cycle; synchronizing, by a camera controller connected to the vehicle camera, an imaging operation of the vehicle camera to image the front of the vehicle with the operation of the wiper; and searching and removing, by an image filter connected to the camera controller, the wiper in the images taken by the camera through edge information of the taken images, based on the estimated position of the wiper.
In the synchronizing of the imaging operation of the vehicle camera with the operation of the wiper, an imaging cycle at which the vehicle camera images the front of the vehicle may be synchronized with an operation period in which the wiper reciprocates on the front windshield glass of the vehicle and a suspension period in which the operation of the wiper is suspended after the operation period.
In the synchronizing of the imaging operation of the vehicle camera with the operation of the wiper, the time during which the vehicle camera images the front of the vehicle may be equal to the sum total of a first imaging period corresponding to 1/n multiple of the time required for the operation period in which the wiper reciprocates on the front windshield of the vehicle and a second imaging period corresponding to 1/n multiple of the time required for the suspension period in which the operation of the wiper is suspended after the operation period, where n is a positive integer equal to or larger than 2, and the position of the wiper may be estimated through image information based on the sum total.
The searching and removing of the wiper in the taken images may include: estimating the position of the wiper, based on ½ cycle of a reciprocation signal transmitted to the wiper from the wiper relay, that is, the cycle at which the wiper is moved from the left side to the right side or from the right side to the left side; and setting the estimated position of the wiper to a region of interest when the position of the wiper is estimated, and removing the wiper in the taken images while extracting an edge within the region of interest.
It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
The advantages and features of the present invention and a method for achieving the advantages and features will be clarified through embodiments which are described below with reference to the accompanying drawings.
However, the present invention is not limited to the embodiments, but may be embodied into another form.
The embodiments disclosed herein may be provided to make the disclosure thorough and perfect and to sufficiently deliver the spirit of the present invention to those skilled in the art.
The terms used in the present specification are used to describe only specific embodiments, and do not limit the present invention.
Hereafter, exemplary embodiments of the present invention will be described below in more detail with reference to the accompanying drawings.
As illustrated in
The wiper relay 10 is connected to a multi-function switch 40 to operate a vehicle wiper 50 at a predetermined cycle.
The camera controller 20 is connected to the wiper relay 10, and synchronizes the operation cycle of the wiper 50 with the imaging cycle of the vehicle camera 60 such that the vehicle camera 60 images the front of the vehicle according to the operation cycle of the wiper 50.
The image filter 30 is connected to the camera controller 20, estimates the position of the wiper 50 from edge information of the images taken by the camera 60, and searches and removes the wiper 50 in the taken images.
The image filter 30 may recognize the operation of the wiper 50 in the images taken by the vehicle camera 60 as a signal, when an external factor such as rain or snow occurs.
The operation cycle of the wiper 50 needs to be matched with the imaging cycle of the vehicle camera 60 as illustrated in
When the amount of rain or snow is changed to vary the operation cycle of the wiper 50, it is more difficult to predict the interference of the wiper 50 within the images taken by the vehicle camera 60.
Thus, as illustrated in
That is, the image filter 30 receives the operation signal of the vehicle camera 60 by the camera controller 20, the state information of the multi-function switch 40, and the information of the wiper relay 10 and the like, and comprehensively analyzes the synchronization.
Therefore, the control device of a vehicle camera according to the embodiment of the present invention may provide clearer, more precise, and more reliable image information to a driver and a passenger.
A process of editing images from the control device according to the embodiment of the present invention will be described as follows.
At first step S1, the multi-function switch 40 is manipulated to operate the wiper 50 connected to the wiper relay 10 at a predetermined cycle.
At second step S2, the camera controller 20 connected to the vehicle camera 60 synchronizes an imaging operation of the vehicle camera 60 to image the front of the vehicle with the operation of the wiper 50.
At third step S3, the image filter 30 connected to the camera controller 20 searches and removes the wiper 50 in the images taken by the camera through edge information of the images, based on the estimated position of the wiper 50.
Referring to
That is, the imaging time of the vehicle camera to image the front of the vehicle may correspond to the sum total of the first imaging period 73 and the second imaging period 74. The first imaging period 73 may correspond to 1/n multiple of the time required for the operation period 71 during which the wiper 50 reciprocates on the front windshield glass of the vehicle, and the second imaging period 74 may correspond to 1/n multiple of the time required for the suspension period 72 during which the operation of the wiper 50 is suspended after the operation period 71, where n is a positive integer equal to or larger than 2.
Thus, the position of the wiper 50 may be estimated from the image information based on the above-described sum total.
At the third step S3, the image editing is performed through the following process.
First, the position of the wiper 50 is estimated on the basis of ½ cycle of a reciprocation signal transmitted to the wiper 50 from the wiper relay 10, that is, the cycle at which the wiper 50 is moved from the left side to the right side or from the right side to the left side.
When the position of the wiper 50 is estimated, the estimated position of the wiper 50 is set to a region of interest. Then, while an edge is extracted within the region of interest, the wiper 50 is removed from the taken images.
According to the control device and method of a vehicle camera, the camera controller may synchronize the imaging cycle of the vehicle camera with the operation cycle of the wiper, and the image filter may estimate the position of the wiper from the taken images and remove the wiper in the taken image. Therefore, clearer, more precise, and more reliable image information may be provided to a driver and a passenger.
While the present invention has been described with respect to the specific embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.
Patent | Priority | Assignee | Title |
11180117, | Aug 31 2019 | BLUE RIVER TECHNOLOGY INC ; LGT ABC , LLC | Methods and apparatus for capturing and using images in a system including wipers |
11312336, | May 02 2018 | Honda Motor Co., Ltd.; HONDA MOTOR CO , LTD | Methods of operating a rear wiper system and a full display mirror system of a vehicle |
11410430, | Mar 09 2018 | Conti Temic Microelectronic GmbH | Surround view system having an adapted projection surface |
Patent | Priority | Assignee | Title |
20020181240, | |||
20110043624, | |||
20140169695, | |||
JP2006107314, | |||
JP8072641, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jun 26 2014 | Mando Corporation | (assignment on the face of the patent) | / | |||
Jul 10 2014 | KIM, KYONG WON | Mando Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 033450 | /0688 | |
Oct 26 2021 | Mando Corporation | Mando Mobility Solutions Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 058158 | /0300 | |
Dec 02 2021 | Mando Mobility Solutions Corporation | HL KLEMOVE CORP | MERGER SEE DOCUMENT FOR DETAILS | 061375 | /0680 | |
Sep 05 2022 | Mando Corporation | HL Mando Corporation | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 062152 | /0127 |
Date | Maintenance Fee Events |
Jun 27 2017 | ASPN: Payor Number Assigned. |
May 21 2020 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jun 10 2024 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Jan 03 2020 | 4 years fee payment window open |
Jul 03 2020 | 6 months grace period start (w surcharge) |
Jan 03 2021 | patent expiry (for year 4) |
Jan 03 2023 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 03 2024 | 8 years fee payment window open |
Jul 03 2024 | 6 months grace period start (w surcharge) |
Jan 03 2025 | patent expiry (for year 8) |
Jan 03 2027 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 03 2028 | 12 years fee payment window open |
Jul 03 2028 | 6 months grace period start (w surcharge) |
Jan 03 2029 | patent expiry (for year 12) |
Jan 03 2031 | 2 years to revive unintentionally abandoned end. (for year 12) |