A viewing system for a vehicle, in particular a commercial vehicle, includes an image capture unit, a computing unit, and a reproducing unit. The image capture unit includes a lens, which has an optical axis, and a digital image sensing unit, and is configured to be attached to the vehicle such that a viewing area on the side of the vehicle is sensed with at least one part of a first legally-prescribed field of view and with at least one part of a second legally-prescribed field of view. The lens is disposed with respect to the digital image sensing unit such that the optical axis extends through the part of the first legally-prescribed field of view that is reproduced on the digital image sensing unit.

Patent
   RE48017
Priority
Feb 08 2013
Filed
Dec 21 2017
Issued
May 26 2020
Expiry
Feb 06 2034
Assg.orig
Entity
Large
0
100
currently ok
19. #4# A vehicle equipped with a viewing system, the viewing system comprising:
an image capture unit, a computing unit connected to the image capture unit, and a reproducing unit connected to the computing unit,
wherein the image capture unit comprises a lens, which has an optical axis, and a digital image sensing unit, and is attached to the vehicle such that, in use, a viewing area on the side of the vehicle is sensed with at least a part of a first legally-prescribed field of view and at least a part of a second legally-prescribed field of view,
wherein the first legally-prescribed field of view is a view from a perspective of a driver of the vehicle of at least a 4 meter wide, flat, horizontal portion of a road bounded on one side by a plane that a) is parallel to a median longitudinal vertical plane of the vehicle, b) passes through an outermost point of the vehicle on a driver's side of the vehicle or a passenger's side of the vehicle, and c) extends from a location 20 meters behind an eye of the driver of the vehicle to the horizon, and of a 1 meter wide portion of the road bounded by a plane a) parallel to the median longitudinal vertical plane of the vehicle, b) passing through the outermost point of the vehicle, and c) extending from a location 4 meters behind a vertical plane passing through the eye of the driver of the vehicle, and
wherein the lens is disposed with respect to the digital image sensing unit such that the optical axis extends through the part of the first legally-prescribed field of view that is reproduced on the digital image sensing unit.
2. The vehicle according to claim 1 #4# , wherein the digital image sensing unit is substantially symmetric and has at least one axis of symmetry.
3. The vehicle according to claim 2 #4# , wherein the optical axis extends skewed with respect to at least one of the axes of symmetry of the digital image sensing unit.
4. The vehicle according to claim 1 #4# , wherein the optical axis extends through the vertical center of the part of the first legally-prescribed field of view that is reproduced on the digital image sensing unit.
5. The vehicle according to claim 1 #4# , wherein the optical axis extends through the horizontal center of the part of the first legally-prescribed field of view that is reproduced on the digital image sensing unit.
6. The vehicle according to claim 1 #4# , wherein the optical axis extends through the surface center of the part of the first legally-prescribed field of view that is reproduced on the digital image sensing unit.
7. The vehicle according to claim 1 #4# , wherein the first legally-prescribed field of view corresponds to the field of view II defined in the UN/ECE Regulation No. 46 for main exterior mirrors, and the second legally-prescribed field of view corresponds to the field of view IV defined in the UN/ECE Regulation No. 46 for wide-angle exterior mirrors.
9. The vehicle #4# viewing system according to claim 8, wherein the image capture unit further includes a housing, in which the digital image sensing unit and a holding device for the digital image sensing unit are disposed, and wherein the lens is attached to the housing.
10. The vehicle #4# viewing system according to claim 9, wherein the lens is disposed eccentric with respect not centered relative to the holding device and with respect is not centered relative to the digital image sensing unit.
11. The vehicle #4# viewing system according to claim 9, wherein the digital image sensing unit is disposed eccentric with respect not centered relative to the holding device and is not centered relative to the lens.
12. The vehicle according to claim 1 #4# , wherein the digital image sensing unit is a CMOS or CCD sensor.
13. The vehicle according to claim 1 #4# , wherein the image capture unit is further configured to sense the viewing area from a birds-eye perspective.
14. The vehicle according to claim 1 #4# , wherein the image capture unit is attached to a side of the vehicle such that the viewing area is sensed from front to rear in the forward driving direction of the vehicle.
15. The vehicle according to claim 1 #4# , wherein the image capture unit comprises a single digital image sensing unit for sensing the parts of the first and second legally-prescribed field of view.
16. The vehicle according to claim 1 #4# , wherein the optical axis is offset from a center of the digital image sensing unit.
17. The vehicle #4# viewing system according to claim 8, wherein the reproducing unit is configured to permanently display the reproduced image received from the computing unit.
18. The viewing system according to claim 8 #4# , wherein the image capture unit is configured to capture an image of a side of a vehicle to which the image sensor is attached and wherein the optical axis intersects the sensor surface at a location substantially midway between a first line including the side of the vehicle and a second, parallel, line including the center point of the sensor surface.
20. The vehicle according to claim 19 #4# , wherein the optical axis extends through the vertical center of the part of the first legally-prescribed field of view that is reproduced on the digital image sensing unit.
0. 21. The vehicle according to claim 1, wherein #4# the computing unit is configured to receive an image sensed by the image capture unit and to modify it into a reproduced image such that the part of the first legally-prescribed field of view sensed by the image capture unit and the sensed part of the second legally-prescribed field of view are contained in the reproduced image, and
the reproducing unit is configured to be disposed in the interior of the vehicle so as to be viewable by the driver and to display the reproduced image received from the computing unit.
0. 22. The vehicle according to claim 21, wherein the reproducing unit is configured to permanently display the reproduced image received from the computing unit. #4#
0. 23. The vehicle according to claim 21, wherein the image capture unit further includes a housing, in which the digital image sensing unit and a holding device for the digital image sensing unit are disposed, and wherein the lens is attached to the housing. #4#
0. 24. The vehicle according to claim 23, wherein the lens is not centered relative to the holding device and is not centered relative to the digital image sensing unit. #4#
0. 25. The vehicle according to claim 23, wherein the digital image sensing unit is not centered relative to the holding device and is not centered relative to the lens. #4#

The present application claims priority from German patent application no. DE 10 2013 002 111.1 filed Feb. 8, 2013, the entire contents of which is incorporated by reference herein.

The present disclosure is directed to a viewing system for vehicles, in particular commercial vehicles, and, more specifically, to a viewing system including an image capture unit for use in commercial vehicles. Moreover, the present disclosure relates to a vehicle, in particular a commercial vehicle, which is equipped with a viewing system disclosed herein.

Fields of view (fields of vision) are legally prescribed (defined) for different types of motor vehicles, such as e.g., motorcycles, motor vehicles for transporting passengers, motor vehicles for transporting goods, etc. The fields of view must be provided by a device for indirect viewing, conventionally a mirror, and must be viewable permanently (continuously) and reliably at all times by a driver sitting in the driver's seat of the vehicle using the device for indirect viewing. Specific fields of view have been prescribed or defined by various countries, organizations and/or standards-setting bodies. For example, fields of view (vision) for rear-view mirrors, which must be viewable by the driver in a permanent an/or continuous and reliable manner, are legally prescribed in UN/ECE Regulation No. 46 for the European region.

For commercial vehicles, such as e.g., trucks or delivery vehicles, a primary (main) mirror is currently provided on each of the driver's side and the passenger's side as a device for indirect viewing. Using the primary (main) mirror, the vehicle driver can see a level (flat) and horizontal part of the road surface of a certain width that extends from a stipulated distance behind the vehicle driver's eye (ocular) points back to the horizon behind the vehicle. In addition, a narrower band of the road surface must also be viewable using this mirror, which band begins a shorter distance behind the driver's eye (ocular) points. Such legally-prescribed areas, which must be viewable permanently and at all times by the driver with the use of the devices for indirect viewing, will be designated as “fields of view (vision)”. The area in the vicinity of the vehicle that is legally prescribed or required to be viewable using the primary mirror will be designated hereinafter as the “field of view of the primary (main) mirror.” Such an area is also defined as field of view II (Class II) in UN/ECE Regulation No. 46.

In addition to these primary (main) mirrors, fields of view (vision), which are reproduced (shown or depicted) by wide-angle mirrors, are required to be viewable on both sides of the commercial vehicle. An area behind the eye (ocular) points of the driver is viewed with the wide-angle mirrors; this area is wider than the area that must be viewable in the primary mirrors, but it only extends a limited length along the vehicle—not to the horizon as is the case with the field of view of the primary (main) mirror. This area, the area viewable in the wide-angle mirrors, is defined as field of view IV (Class IV) in UN/ECE Regulation No. 46.

Various organizations may establish legally required fields of view for a main mirror. Currently, according to the field of view of Class II of UN/ECE Regulation No. 46, the field of vision of the exterior rear-view mirror on the driver's side and the exterior rear-view mirror on the passenger's side must allow the driver to see at least a 4 m wide, flat, horizontal portion of the road. This road portion is bounded on one side by a plane that a) is parallel to the median longitudinal vertical plane of the vehicle, b) passes through the outermost point of the vehicle on the driver's side and the passenger's side of the vehicle, respectively, and c) extends from a location 20 m behind the driver's eye (ocular points) to the horizon. In addition, a 1 m wide portion of the road must be visible to the driver in an area that is bounded by a plane a) parallel to the median longitudinal vertical plane of the vehicle, b) passing through the outermost point of the vehicle and c) extending from a location 4 m behind a vertical plane passing through the driver's eye (ocular points). In other words, the primary mirror must enable the driver to see a long wide portion of the road relatively far from the driver and a shorter, narrower portion of the road that is closer to the driver.

Various organizations may establish legally required fields of view for a wide-angle mirror. For example, Class IV of UN/ECE Regulation No. 46 defines a field of vision of the “wide-angle” exterior mirror on the driver's side and the “wide-angle” exterior mirror on the passenger's side. This wide angle field of view must allow the driver to see at least a 15 m wide, flat, horizontal portion of the road, that is bounded by a plane a) parallel to the median longitudinal vertical plane of the vehicle, b) passing through the outermost point of the vehicle on the driver's side and the passenger's side of the vehicle, respectively, and c) extending from a location at least 10 m to 25 m behind the driver's eye (ocular points). In addition, a 4.5 m portion of the road must be visible to the driver in an area that is bounded by a plane a) parallel to the median longitudinal vertical plane of the vehicle, b) passing through the outermost point of the vehicle, and c) extending from a point (location) 1.5 m behind a vertical plane passing through the driver's eye (ocular points).

Despite the use of prescribed mirrors or devices for indirect viewing (vision), however, it may be very difficult or nearly impossible for a vehicle driver to adequately keep accident-critical (accident-prone) areas around a commercial vehicle in view. In addition, the presence of multiple mirrors on typical vehicles makes it harder for the driver to keep all mirrors in view at the same time. The reproduction (depiction) of the fields of view using mirrors also has the consequence of an influence of the mirrors on the airflow around the vehicle.

With commercial vehicles such as trucks, buses, etc., the viewability on the driver's side is critical. Obstacles and other vehicles are often difficult to quickly and accurately identify in a mirror because, despite the specifications of legally-prescribed fields of view, relatively large blind spots still exist. The orientation of the driver relative to the multiple devices for indirect viewing changes as the driver moves his head and/or shifts his position in his seat, and this increases the likelihood that obstacles will be overlooked, in particular while turning or changing lanes, even though they are reproduced (shown) in the device for indirect viewing (and would be visible to the driver if his head were positioned in an ideal position). Accidents are thus frequently caused by the fact that drivers of commercial vehicles do not have sufficient viewability into lateral areas of the vehicle, in particular into the one or more blind spots, which are lateral areas adjacent to the vehicle. Even using the external mirrors described above, these lateral areas (the blind spots) are only barely visible by the driver, or are not visible at all.

It is becoming increasingly common to consider using camera systems or image capture systems as devices for indirect viewing, either in addition to conventional mirrors or as replacements therefor. In such camera systems or image capture systems an image capture unit continuously senses an image. The (video-) data sensed by the image capture unit are transmitted, e.g., using a computing unit, to a reproducing (display) device located in the driver's cabin. Optional further processing may be performed on the image before it is displayed. The reproducing (display) device depicts the corresponding legally-required field of view or a plurality of fields of view and optionally supplemental information, such as e.g., collision indications, distances and the like, for the area around the vehicle in a manner that is permanent (continuous) and viewable at all times by the driver.

DE 10 2011 010 624 A1 (corresponding to U.S. 2012/0200664) discloses a display device for legally-prescribed fields of view in a driver's cabin of a commercial vehicle. The display device includes at least one display adapted to display at least two of the legally-prescribed fields of view, permanently and in real time, on the display unit in the driver's cabin.

A camera unit and a device for monitoring a vehicle's surroundings are disclosed by DE 10 2004 043 257 B4 (corresponding to U.S. US 2005/083427). In this system a change of the image height with respect to a change of the image angle at a peripheral portion of the image is greater than in a center portion of the image.

It is also known to sense (capture) each of multiple legally-prescribed fields of view of a commercial vehicle using separate image capture units, respectively. In this case the image capture units are each aligned such that their optical axes, respectively, extend substantially through the centers of each of the sensed (captured) fields of view. The area of the image captured by the image capture unit has the highest reproduction quality at the optical axis, and the distortion, i.e. the optical distortion, increases with increasing distance from the optical axis.

Different requirements with respect to distortion are also placed on the image capture units for sensing (capturing) different legally-prescribed fields of view. For example, a first field of view must have only minimal distortion, whereas the distortion of a second field of view is less critical and thus it can be more distorted.

Furthermore, it is known to sense (capture) more than one legally-prescribed field of view using only one image capture unit. In this case the optical axis extends centrally through the viewing area captured by the image capture unit. However, this can lead to a distortion in each of the respective co-captured fields of view, because these co-captured fields of view do not necessarily lie in the central area.

Starting therefrom, it is an aspect of the present disclosure to provide a simple viewing system for a vehicle, in particular, for a commercial vehicle, that provides an optimal view of areas that are located laterally adjacent to the vehicle and that can depict the fields of view (fields of vision) with a desired reproduction quality in terms of optical distortion.

In the description of this invention, indications of the direction of a vehicle, in particular a commercial vehicle, are made with reference to the normal forward driving direction. Thus, “in the lateral direction” means the direction that is perpendicular to a forward driving direction vector of the motor vehicle and corresponds to the left-right direction. Furthermore, the term “viewing area” describes a maximum area which can be sensed (captured) by an image capture unit, for example by a camera. The term “field of view (vision)” differs therefrom in that it indicates an area which is legally prescribed to be seen by the driver. Therefore a “viewing area” generally describes an area which is larger than a legally-prescribed “field of view (vision)”, and more than one field of view may be present in a viewing area.

An aspect of the present disclosure is to provide a viewing system for a vehicle, in particular a commercial vehicle, comprising an image capture unit, a computing unit connected to the image capture unit, and a reproducing (display) unit connected to the computing unit. It should be noted here that the image capture unit, the computing unit, and the reproducing unit are connected to one another in a communicative manner, and that the image capture unit, the computing unit, and the reproducing unit are not necessarily physically separate units. For example, the computing unit can be integrated in the image capture unit or in the reproducing unit. Furthermore, the term “image capture unit” should be understood to include any photographic device for capturing static or moving images, for example a camera or a wide-angle camera. The image capture unit comprises a lens (objective), which has an optical axis, and a digital image sensing unit, and is configured to be attached to the vehicle such that a viewing area on the side of the vehicle is sensed (captured), which viewing area includes at least one part of a first legally-prescribed field of view and at least one part of a second legally-prescribed field of view. Accordingly, the image capture unit can be attached, for example, to a front portion of a passenger's side of the vehicle, in order to capture the described first and second legally-prescribed fields of view on the passenger's side of the vehicle. The lens is disposed with respect to the digital image sensing unit such that the optical axis of the lens extends through the part of the first legally-prescribed field of view that is reproduced on (projected or mapped onto) the digital image sensing unit. This means that the optical axis does not usually lie in the image center of the image that is sensed (captured) on the image sensing unit, but rather is shifted towards the vehicle and/or possibly towards the driver's cabin of the vehicle (forwards; in accordance with the top of the picture). In other words, the portion of the image where the optical axis meets the image sensing unit, which portion is generally the least optically distorted, is not centered on the image sensing unit but rather is offset from the center of the image sensing unit.

Moreover, according to the present disclosure, a single image capture unit is used to capture two legally-prescribed fields of view which are located laterally adjacent to the vehicle while still keeping a level of distortion in critical areas of the captured image as low as possible. For this purpose, the optical axis is shifted such that the optical axis falls in the critical area, i.e. the optical axis does not lie in the center of the sensed and displayed captured image. The field of view II (Main exterior rear-view mirrors Class II) defined in the UN/ECE Regulation No. 46 can for example be referred to as the critical area; it is located laterally directly adjacent to the vehicle. It is desired that the distortion of the displayed field of view II (or similar field of view located laterally directly adjacent to the vehicle) be as low as possible. In order to achieve this, the optical axis is shifted towards the vehicle such that the optical axis extends through the legally-prescribed field of view II.

The use of a single image capture unit, which is configured for sensing (capturing) both lateral fields of view II and IV (or a first field of view laterally near the vehicle and a second field of view laterally further out from the vehicle), on one vehicle side leads to a simplified viewing system. Thus the computing unit is required to process a smaller amount of (video-) data and can therefore, e.g., improve the real-time display of the captured image. In addition, fewer data connections to the vehicle are needed, since only one image capture unit is provided per vehicle side, which image capture unit is communicatively connected to the computing unit.

The image capture unit is preferably connected to the computing unit via a first connection, for example a data cable suitable for digital transmission of the images sensed by the image capture unit. The computing unit is further connected to the reproducing (display) unit via a second connection, for example a data cable suitable for digital transmission of images. Alternatively, one or both of the above-mentioned connections can also be embodied in a wireless manner, for example via Bluetooth®, wireless local area network (WLAN), or an infrared connection.

The viewing system disclosed herein can sense (capture) a viewing area with at least parts of a first and second legally-prescribed field of view using a single image capture unit, and do so in a manner such that the distortion in the captured parts of the first and second legally prescribed field of view corresponds to specific requirements of reproduction quality, since the optical axis extends through the part of the particular field of view that is reproduced on (projected or mapped onto) the digital image capture unit and that is critical with respect to distortion and must have a low distortion. Altogether the viewing area sensed (captured) by the image capture unit preferably contains the entire first and second legally-prescribed field of view.

The image sensed by the image capture unit is generally a two-dimensional image which substantially corresponds to the shape of the digital image sensing unit. In the following discussion, the digital image sensing unit is considered to be an object having a negligible thickness, i.e. the digital image sensing unit can be considered to be a two-dimensional object.

The optical axis extends substantially orthogonally through the digital image sensing unit, so that a high-quality image can be sensed in terms of the resolution. The optical axis preferably extends eccentrically with respect to (is offset relative to) the geometric center of gravity of the digital image sensing unit, i.e. the optical axis does not extend through the geometric center of gravity of the digital image sensing unit. As a two-dimensional object, the digital image sensing unit thus has a centroid (center) which is preferably not traversed by the optical axis.

Furthermore, it is preferable that the digital image sensing unit has a substantially symmetric shape, and consequently has at least one axis of symmetry which extends in the plane defined by the digital image sensing unit. The term “substantially symmetric shape” is understood to mean, for example, regular polygons, such as for example rectangles and squares, circles, ellipses, etc. which have at least one axis of symmetry. In addition, the term “substantially symmetric shape” can also include shapes which deviate slightly from a symmetric shape. For example, a rectangle having, e.g., one or more obliquely truncated corners should be included within the term “substantially symmetric shape.”

The optical axis is preferably displaced or offset or skewed or out of square with respect to at least one of the axes of symmetry of the digital image sensing unit, i.e. the optical axis does not intersect at least one axis of symmetry of the digital image sensing unit.

In other embodiments, it may be preferable that the optical axis extends through the vertical center, of a height-depth direction, of the part of the first legally-prescribed field of view that is reproduced on (projected or mapped onto) the digital image sensing unit. This leads to a uniformly low distortion in the horizontal direction in the part of the first legally prescribed field of view that is reproduced by the digital image sensing unit. Moreover, it is preferred that the optical axis extends through the horizontal center, i.e. of a center in the left-right direction, of the part of the first legally-prescribed field of view that is reproduced on (projected or mapped onto) the digital image sensing unit. This leads to a uniformly low distortion in the vertical direction in the part of the first legally-prescribed field of view that is reproduced by the digital image sensing unit, in particular in the part of the image which is preferably to be displayed nearly distortion-free. Furthermore it is preferable that the optical axis extend through the surface center of the part of the first legally-prescribed field of view that is reproduced on (projected or mapped onto) the digital image sensing unit. This leads to a uniformly low distortion in the vertical and horizontal directions in the part of the first legally-prescribed field of view that is reproduced by the digital image sensing unit in the part of the image which is to be displayed as distortion-free as possible.

The first legally-prescribed field of view preferably corresponds to a primary (main) mirror field of view, for example, the field of view II (Class II) defined in the UN/ECE Regulation No. 46 for primary (main) mirrors, and the second legally-prescribed field of view preferably corresponds to a wide-angle mirror field of view, for example, the field of view IV for wide-angle exterior mirrors (“Wide-angle” exterior mirror (Class IV)) defined in the UN/ECE Regulation No. 46. Here it is preferred that the main exterior mirror field of view II have only a small amount of distortion, whereas the distortion in the wide-angle external mirror field of view IV is less critical. Since the optical axis extends through the part of the main exterior mirror field of view II that is reproduced on (projected or mapped onto) the digital image sensing unit, the distortion in this part is lowest and can be provided to the driver of the vehicle in the desired degree of quality. The distortion in the wide-angle exterior mirror field of view IV is indeed greater, but due to the above-described fact that this distortion is less critical, the lesser reproduction quality of the wide-angle exterior mirror field of view IV is more acceptable.

The computing unit is preferably configured to receive an image sensed by the image capture unit and to modify it into a reproduced image containing the part of the first legally-prescribed field of view sensed by the image capture unit and the sensed part of the second legally-prescribed field of view in the reproduced image. The reproducing (display) unit is configured to be disposed in the interior of the vehicle so that it is visible by the driver and to display the reproduced image received from the computing unit. The computing unit can be integrally embodied with the image capture unit, the reproducing unit, or the control unit of the vehicle. Furthermore, the computing unit can be attached as a separate unit in or on the vehicle, e.g. integrally with an onboard computer. The reproducing unit can be a unit which visibly displays, in a manner suitable for the driver of the vehicle, the reproduced image provided by the computing unit. For example, the reproducing unit can be a separate device, for example an LCD, an LED, a projector, or the like. In addition, the reproducing unit can be integrally embodied with the so-called Central Information Display which is already located in the vehicle as a standard part.

Furthermore, it is preferred that the reproducing unit is configured to permanently (continuously) display the received reproduced image. Herein, “permanently” means that the display of the field of view is not (temporally) interrupted by other information, so that the driver can view the first and second legally-prescribed field of view by looking at the reproducing (display) unit. However, “permanently” also means that the display of the fields of view is consistently present at least during the driving operation of the commercial vehicle. The state described as and comprising “permanent” can also optionally be broadened to include the ignition state of the vehicle or, for example, a state in which a driver can be found in the vehicle, e.g. dependent on the detection (sensing) of a key device located in the vicinity of or inside the vehicle.

The image capture unit preferably includes a housing inside which the digital image sensing unit and a holding device for the digital image sensing unit are disposed and attached, and the lens or “objective”, which for example can be an anamorphic lens, is also attached to the housing. The digital image sensing unit is preferably attached to the holding device by adhesion, welding, soldering, etc. The lens is preferably attached to the housing via a thread. In the sense used herein, the terms “lens” and “objective” encompass a lens system having at least one lens for focusing the image to be sensed (captured), and, in some embodiments, an aperture for taking a photograph. The aperture preferably has an opening, and the optical axis extends through the center of this opening. It should be noted that the extension of the optical axis can also be influenced by a special arrangement of the at least one lens and, as described above, the aperture, if present. In addition, the axial distance (spacing) between the lens and the digital image capture unit can be adjusted by turning (rotating) the lens in the thread such that the focusing of the image to be sensed (captured) is optimal. However, this adjustment is usually performed during manufacture and thus only once, when the lens (objective) is attached.

In order to achieve (ensure) that the optical axis extends through the part of the first legally-prescribed field of view that is reproduced on (projected or mapped onto) the digital image sensing unit, the digital image sensing unit may be attached so that it is centered on the holding device. The lens (objective) is attached to the housing such that it is disposed eccentric with respect to (off-center relative to) the holding device and accordingly also eccentric or off center with respect to the digital image sensing unit. In this case, the lens can be attached to the housing via a lens holder which includes a thread disposed eccentric with respect to the digital image capture unit; the thread can accommodate the lens in a screw-type manner. Alternatively, the lens can be attached to the lens holder by adhesion, welding, screws, or the like, wherein preferably the connection between lens and lens holder is such that it can be adjusted and aligned at least once during manufacture. In a further preferred design, the holding device and the lens are aligned concentric to each other, and the digital image sensing unit is attached to the holding device in a concentric manner, i.e. the centroid (center) of the attachment surface of the holding device is eccentric with respect to (offset relative to) the centroid (center) of the digital image sensing unit.

The digital image sensing unit is preferably a CMOS sensor which includes light-sensitive electronic components that are based on the internal photoelectric effect. The CMOS sensor can have a negligible thickness, so that the CMOS sensor can be considered to be a two-dimensional digital image sensing unit which is attached to the holding device. The digital image sensing unit preferably has a resolution of at least two megapixels.

The disclosed viewing system is preferably attached to a vehicle, in particular a commercial vehicle, with the digital image capture unit attached to the vehicle such that it can sense a viewing area on one side of the vehicle with at least one part of a first legally-prescribed field of view and with at least one part of a second legally-prescribed field of view. The image capture unit preferably senses the viewing area with the parts of the first and second legally prescribed field of view from a “bird's-eye” perspective, i.e. an object located in the viewing area is viewed from an eye (ocular) point located obliquely above the object. Using the capture (sensing) of the viewing area from a birds-eye perspective, the driver of the vehicle can view the first and second legally-prescribed field of view in an improved manner and, due to the improved image quality in the reproduced (displayed) part of the first legally-prescribed field of view, recognize traffic obstacles such as pedestrians and other vehicles in a timely manner.

Furthermore, it is preferable that the image capture unit is attached to the vehicle, in particular a commercial vehicle, such that the viewing area in the forward direction of the vehicle is sensed from front to rear. A sensing (capturing) of a viewing area “from front to rear” means that the viewing-area sensing (capture) is in a direction which is substantially parallel to a longitudinal direction of the vehicle and/or to a rearward driving direction of the vehicle.

The disclosed viewing system preferably includes an image capture unit with a single digital image sensing unit that is configured for sensing (capturing) at least one part of a first legally-prescribed field of view and at least one part of a second legally-prescribed field of view. The image capture unit thus does not include two image sensor units which would be formed for separate sensing (capturing) of the parts of the first and second fields of view.

Furthermore, it can be advantageous that the viewing system includes a further image capture unit that also includes a lens (objective) having an optical axis and a single digital image sensing unit on the opposite side of the vehicle from the first image capture unit. In this case, the further image capture unit is configured to sense a viewing area on the opposite side of the vehicle from the first image capture unit, which area includes at least one part of a first legally-prescribed field of view and at least one part of a second legally-prescribed field of view. In this case, the reproducing (display) unit can be further configured to display the two sensed (captured) viewing areas in a split-screen method so as to be viewable by the driver in the interior of the vehicle. In this case, the sensed viewing area of the driver's side is displayed on the driver's-side on the reproducing unit, and the sensed viewing area of the passenger's side is displayed on the passenger's-side on the reproducing unit. Thus, by looking at the reproducing (display) unit, the driver can view both viewing areas lateral to the vehicle. Alternatively, the viewing areas sensed (captured) on the two sides can be displayed separately from each other on two reproducing (display) units.

Using the viewing system disclosed herein, it is possible to sense (capture) a first legally-prescribed field of view and a second legally-prescribed field of view, for example the fields of view II and IV (Classes II and IV) defined in the UN/ECE Regulation No. 46, using only one digital image sensing unit, for example a CMOS sensor, while still meeting the requirements of the respective image reproduction qualities. By using only one digital image sensing unit, an economical system is thus disclosed, which further also results in fewer technical implementation costs, since the eccentric arrangement of the above-described elements of the image capture unit can already be incorporated in the development phase. In addition, the adjustment (change-over) for the driver from a wide-angle mirror to the viewing system disclosed herein is non-critical, since using the viewing system disclosed herein, the wide-angle field of view is displayed to the driver with the usual degree of distortion.

The invention will be described in an exemplary manner in the following detailed description with reference to the accompanying figures:

FIG. 1 shows a schematic illustration of a viewing system;

FIG. 2 shows a schematic illustration of a viewing system attached to a commercial vehicle and two legally-prescribed fields of view;

FIG. 3 shows a schematic illustration of an image capture unit of the viewing system; and

FIG. 4 shows a schematic illustration of a viewing area captured by the image capture unit of FIG. 3.

FIG. 1 schematically shows a viewing system 10. The viewing system 10, which for example can be used in a commercial vehicle such as a truck, comprises at least one image capture unit 30, a computing unit 20, and a reproducing (display) unit 40. The viewing area sensed (captured) by the image capture unit 30 is provided to a computing unit 20 via a first connection 21, for example a data cable suitable for digital transmission of the images captured by the image capture unit 30. The computing unit 20 can be configured to modify the sensed images in a desired manner into a reproduced (displayable) image. For example, the computing unit 20 can process one of the images received from the image capture unit 30 so that certain traffic objects are recognized and identified in the displayed image. The reproduced image modified by the computing unit 20 is then provided to the reproducing unit 40 via a second connection 31, for example a data cable suitable for digital transmission of images. The reproducing unit 40 is adapted to display the reproduced image to a driver of the commercial vehicle 50 in an easily viewable and photorealistic manner.

The computing unit 20 need not necessarily process the image sensed by the image capture unit 30. In some embodiments, the computing unit 20 is configured such that the image sensed by the image capture unit 30 is provided in an unaltered state as the reproduced image of the reproducing unit 40.

With reference to FIG. 2, a commercial vehicle 50 is shown which has a longitudinal axis 52 that extends substantially parallel to the forward driving direction, represented by an arrow 54. As shown in FIG. 2, the image capture unit 30 is located on the passenger's side of the commercial vehicle 50. The commercial vehicle 50 shown in FIG. 2 is a left-hand drive vehicle. However, the commercial vehicle 50 can also be a right-hand drive vehicle. In addition, for reasons of simplification, only one image capture unit 30 is shown. However, the disclosed viewing system 10 can also include a further image capture unit on the driver's side of the commercial vehicle 50, which further image capture unit has a similar configuration to the described passenger's-side image capture unit 30.

The image capture unit 30 shown in FIG. 2 is attached to the commercial vehicle 50 such that it can sense (capture) a viewing area 60 which is located laterally adjacent to the commercial vehicle 50, and that extends substantially from front to rear up to the horizon. Here the image capture unit 30 is configured such that the viewing area 60 includes at least one part of a legally-prescribed field of view (vision) 62, which for example corresponds to the field of view (vision) II (Class II) defined in the UN/ECE Regulation No. 46 for primary (main) exterior mirrors, and at least one part of a second legally-prescribed field of view (vision) 64, which for example corresponds to the field of view IV (Class IV) defined in the UN/ECE Regulation No. 46 for wide-angle exterior mirrors. As shown in FIG. 2, the viewing area 60 captured by the image capture unit 30 completely includes the first and second legally-prescribed fields of view (vision) 62, 64.

The image capture unit 30 further has an optical axis 32 which extends substantially parallel to the longitudinal axis 52 of the commercial vehicle 50. As shown in FIG. 2, the optical axis 32 extends through the first legally-prescribed field of view 62 and consequently need not necessarily extend centrally through the viewing area 60. Since the optical axis 32 extends through the first legally-prescribed field of view 62, the area of the sensed part, displayed by the reproducing unit 40 to the driver of the commercial vehicle 50, of the first legally-prescribed field of view 62 has a lesser distortion and higher reproduced image quality than the area of the sensed part of the second legally-prescribed field of view 64.

With reference to FIG. 3, the individual components of the image capture unit 30 are shown in an exemplary manner. The image capture unit 30 includes a lens (objective) 34, a digital image sensing unit 36, a holding device 38, and a housing 39 in which the digital image sensing unit 36 and the holding device 38 are disposed. The lens (objective) 34 includes a lens and aperture system 35 which substantially define the extension of the optical axis 32 and can influence it by their arrangement. The lens 34 is attached to the housing 39 for example via a thread (not shown). As shown in FIG. 3, the digital image capture unit 36 is attached to the holding device 38, which is in turn attached to an interior side of the housing 39 in order to hold the digital image sensing unit 36 in a defined manner. The digital image sensing unit 36 shown in FIG. 3 is attached to the holding device 38 in an eccentric/off-center manner so that the digital image sensing unit 36 is also attached in an eccentric manner with respect to the lens 34. Here the dashed line 33 shows an axis orthogonal to the digital image sensing unit 36, which extends through the centroid (center) of the digital image capture unit and is spaced from the optical axis 32.

FIG. 4 shows a viewing area 60 sensed by the image capture unit 30 in an exemplary manner, which viewing area 60 completely encompasses the first legally-prescribed field of view (vision) 62 and the second legally-prescribed field of view (vision) 64. The viewing area 60 can be depicted by the reproducing unit 40 as a reproduced image modified by the computing unit 20 or, as shown in FIG. 4, unaltered. In FIG. 4, the horizon 66 is shown as well as a portion of the commercial vehicle 50 which is also sensed by the image capture unit 30, so that the driver of the commercial vehicle 50 can quickly and easily understand the orientation of the reproduced (displayed) image.

In addition, in FIG. 4 it is also apparent that the optical axis 32 is shifted from the center 68 of the viewing area 60 by an eccentricity or distance 69. In this case, the center of the viewing area 60 is a first distance from a plane at the side of the commercial vehicle 50, and the distance between the plane at the side of the vehicle and the optical axis 32 is about half the distance between the plane at the side of the commercial vehicle 50 and a parallel plane that includes the center 68. The center 68 lies within the second legally-prescribed field of view 64, but outside the first legally-prescribed field of view 62, which is the critical field of view. As was already mentioned, the optical axis 32 should be shifted from the center 68 of the viewing area 60 such that the optical axis 32 extends through the first legally-prescribed field of view 62 which is critical with respect to distortion. According to FIG. 4 an embodiment is shown in which the optical axis 32 lies close to the horizontal center of the legally-prescribed field of view 62. Consequently the optical distortion of the first legally-prescribed field of view 62 displayed on the reproduced image is low and the display of the first legally-prescribed and critical field of view 62 is better. The optical axis 32 is preferably shifted so far that it extends through the center of the first legally-prescribed field of view 62, which center is formed by the centroid.

10 Viewing system

20 Computing unit

21 First connection

20 Computing unit

30 Image capture unit

31 Second connection

32 Optical axis

33 Axis of the digital image sensing unit

34 Lens (Objective)

35 Lens and aperture system

36 Digital image sensing unit

38 Holding device

39 Housing

40 Reproducing (Display) unit

50 Commercial vehicle

52 Longitudinal axis of the commercial vehicle

54 Forward driving direction

60 Viewing area

62 First legally-prescribed-field of view (vision)

64 Second legally-prescribed field of view (vision)

66 Horizon

68 Center of the viewing area

69 Eccentricity

Lang, Werner, Kunz, Manuel

Patent Priority Assignee Title
Patent Priority Assignee Title
5760828, Jun 03 1994 Idesa Accesorios, S.A. Back-vision system for vehicles
6292111, Mar 01 1999 Yazaki Corporation Vehicle-applied rear-and-side monitoring system and vehicle-applied rear-and-side monitoring and alarming system
6693524, Jun 02 1998 Vehicle backup monitoring and alarm system
6744380, Oct 10 2001 Denso Corporation; Nippon Soken, Inc. Apparatus for monitoring area adjacent to vehicle
7031142, Apr 12 2000 Autonetworks Technologies, Ltd.; Sumitomo Wiring Systems, Ltd.; Sumitomo Electric Industries, Ltd. On-vehicle image pick-up apparatus and method of setting image pick-up direction
7079017, Apr 23 2001 Lang-Mekra North America, LLC Warning device in motor vehicles
7176960, Sep 20 1999 COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK, THE TRUSTEES OF System and methods for generating spherical mosaic images
7253833, Nov 16 2001 Autonetworks Technologies, Ltd.; Sumitomo Wiring Systems, Ltd.; Sumitomo Electric Industries, Ltd. Vehicle periphery visual recognition system, camera and vehicle periphery monitoring apparatus and vehicle periphery monitoring system
7454128, Mar 22 2005 Lang-Mekra North America, LLC; Lang Mekra North America, LLC Exterior vehicle camera
7574287, Sep 22 2004 Lang-Mekra North America, LLC; Lang Mekra North America, LLC System for transmitting signals in a motor vehicle
7697055, Sep 08 2003 Autonetworks Technologies, Ltd; Sumitomo Wiring Systems, Ltd; SUMITOMO ELECTRIC INDUSTRIES, LTD Camera unit and apparatus for monitoring vehicle periphery
7825951, Sep 22 2004 Lang-Mekra North America, LLC; Lang Mekra North America, LLC Large vehicle camera assembly for monitoring dead spots
7973821, Nov 20 2003 LG INNOTEK CO , LTD Method for controlling masking block in monitoring camera
8199975, Dec 12 2006 Cognex Corporation System and method for side vision detection of obstacles for vehicles
8284258, Sep 18 2008 GRANDEYE LTD Unusual event detection in wide-angle video (based on moving object trajectories)
8624716, Nov 07 2006 Rosco Inc. Camera system for large vehicles
8953011, Feb 08 2011 MEKRA LANG GMBH & CO KG Display device for visually-depicting fields of view of a commercial vehicle
20010052845,
20020163589,
20030011597,
20030085999,
20030122930,
20030214733,
20040004541,
20040036768,
20040169762,
20040223074,
20050002545,
20050083405,
20050083427,
20060203085,
20060215020,
20060251502,
20070209436,
20080122597,
20080151048,
20080180351,
20080246843,
20080276191,
20090146051,
20090213037,
20090290369,
20100091379,
20100110189,
20100117815,
20100238288,
20110080277,
20110115913,
20110317049,
20120013742,
20120069184,
20120154591,
20120194652,
20120200664,
20120300075,
20130038735,
20130314539,
20140036081,
20140058653,
20140114534,
CN101636297,
CN102823240,
DE10043099,
DE102004043257,
DE102005028144,
DE102006020511,
DE102008034606,
DE102011010624,
DE10254035,
DE19539642,
DE19900498,
DE69509040,
EP1018839,
EP1705623,
EP2484558,
EP2555518,
GB2351055,
JP1020100089362,
JP2001114048,
JP2002022463,
JP2002109697,
JP2002325191,
JP2003219226,
JP2003320911,
JP2003327048,
JP2007091186,
JP2007110572,
JP2007112368,
JP2007282098,
JP2007320359,
JP2008054030,
JP2008149764,
JP2009141844,
JP2011095321,
JP2011193485,
JP2012178150,
JP396938,
JP471939,
JP675932,
JP884277,
/
Executed onAssignorAssigneeConveyanceFrameReelDoc
Dec 21 2017MEKRA LANG GMBH & CO. KG(assignment on the face of the patent)
Date Maintenance Fee Events
Dec 21 2017BIG: Entity status set to Undiscounted (note the period is included in the code).
Nov 23 2020M1551: Payment of Maintenance Fee, 4th Year, Large Entity.
Nov 18 2024M1552: Payment of Maintenance Fee, 8th Year, Large Entity.


Date Maintenance Schedule
May 26 20234 years fee payment window open
Nov 26 20236 months grace period start (w surcharge)
May 26 2024patent expiry (for year 4)
May 26 20262 years to revive unintentionally abandoned end. (for year 4)
May 26 20278 years fee payment window open
Nov 26 20276 months grace period start (w surcharge)
May 26 2028patent expiry (for year 8)
May 26 20302 years to revive unintentionally abandoned end. (for year 8)
May 26 203112 years fee payment window open
Nov 26 20316 months grace period start (w surcharge)
May 26 2032patent expiry (for year 12)
May 26 20342 years to revive unintentionally abandoned end. (for year 12)