A method, an imaging and light source module insertable in a reverse vending machine, and a reverse vending machine including an opening for entering objects into a chamber, a plurality of light sources and a plurality of imaging devices allowing at least one feature of an object in the chamber to be read, wherein the plurality of imaging devices and the plurality of light sources are arranged as a plurality of imaging and light units around the perimeter of the chamber, wherein each imaging and light unit including one 2d imaging device and one light source, the 2d imaging device and the light source is viewing and illuminating the object at a first and a second oblique angle, respectively, wherein the first and second oblique angles are in the range 45-75° relative to a center-symmetrical line of the imaging and light units.
|
1. A reverse vending machine comprising an opening for inserting objects into an interior of the machine, a plurality of light sources and a plurality of 2d imaging devices, wherein the plurality of 2d imaging devices and the plurality of light sources are arranged as a plurality of imaging and light units around a perimeter of the interior, said imaging and light units each comprise one 2d imaging device and one light source, the 2d imaging device and the light source are viewing and illuminating the object at a first and a second oblique angle, respectively, and wherein the first and second oblique angles are in the range 45-75° relative to a centre-symmetrical line of the imaging and light units,
wherein the reverse vending machine is provided with a transparent or translucent layer positioned to have each of the imaging and light source units on a first side of the layer, and to have a location, where the object is situated when being viewed and illuminated, on a second side of the layer, the second side being opposite the first side;
wherein the transparent or translucent layer is arranged substantially orthogonal relative to the centre-symmetrical line of the imaging and light units.
29. An imaging and light source module insertable in a reverse vending machine, comprising:
a plurality of imaging and light units, wherein said imaging and light units each comprise one 2d imaging device and one light source, the plurality of imaging and light units arranged around the perimeter of an opening in a cartridge, the cartridge opening being adapted to fit around an opening for inserting objects into the reverse vending machine;
wherein, when the module is inserted in a reverse vending machine, the 2d imaging device and the light source are viewing and illuminating the object at a first and a second oblique angle, respectively, wherein the first and second oblique angles are in the range 45-75° relative to a centre-symmetrical line of the imaging and light units,
wherein the reverse vending machine is provided with a transparent or translucent layer positioned to have each of the imaging and light source units on a first side of the layer, and to have a location, where the object is situated when being viewed and illuminated, on a second side of the layer, the second side being opposite the first side;
wherein the transparent or translucent layer is arranged substantially orthogonal relative to the centre-symmetrical line of the imaging and light units.
18. A method of deriving information relating to at least one feature of an object in a reverse vending machine, the method comprising:
providing a plurality of light sources and a plurality of 2d imaging devices arranged as a plurality of imaging and light units around the perimeter of the interior of the reverse vending machine, wherein said imaging and light units (40) each comprise one 2d imaging device and one light source;
obtaining at least one image of the object using at least one 2d imaging device at a first oblique angle in the range 45-75° relative to a centre-symmetrical line of the imaging and light units;
illuminating the object using at least one light source at a second oblique angle in the range 45-75° relative to a centre-symmetrical line of the imaging and light units; and
deriving information relating to the at least one feature using the at least one image obtained by the at least one 2d imaging device,
wherein the reverse vending machine is provided with a transparent or translucent layer positioned to have each of the imaging and light source units on a first side of the layer, and to have a location, where the object is situated when being viewed and illuminated, on a second side of the layer, the second side being opposite the first side;
wherein the transparent or translucent layer is arranged substantially orthogonal relative to the centre-symmetrical line of the imaging and light units.
2. The reverse vending machine according to
3. The reverse vending machine according to
4. The reverse vending machine according to
5. The reverse vending machine according to
6. The reverse vending machine according to
7. The reverse vending machine according to
8. The reverse vending machine according to
9. The reverse vending machine according to
10. The reverse vending machine according to
11. The reverse vending machine according to
12. The reverse vending machine according to
13. The reverse vending machine according to
14. The reverse vending machine according to
15. The reverse vending machine according to
a retro-reflector, a beam splitter and a light source; and
wherein the 2d imaging device is configured to view an object contour against the retro-reflector, and
the light source and the beam splitter are configured such that the light source and the 2d imaging device are optically co-located as seen from the retro-reflector.
16. The reverse vending machine according to
a background panel; and wherein the 2d imaging device is configured to view an object contour against the background panel.
17. The reverse vending machine according to
19. The method according to
arranging the imaging and light units such that the fields of view of adjacent 2d imaging devices are substantially overlapping each other; and
combining visible parts of the at least one feature from the adjacent 2d imaging devices into one image of the at least one feature.
20. The method according to
combining the visible parts of the at least one feature from the adjacent 2d imaging devices and from the sequence of consecutive images from the adjacent 2d imaging devices into one image of the at least one feature.
21. The method according to
combining visible parts of the at least one feature from a sequence of consecutive images from one 2d imaging device into one image of the at least one feature.
22. The method according to
23. The method according to
24. The method according to
25. The method according to
26. The method according to
27. The method according to
28. The method according to
30. The imaging and light source module according to
31. The imaging and light source module according to
32. The imaging and light source module according to
33. The imaging and light source module according to
34. The imaging and light source module according to
35. The imaging and light source module according to
36. The imaging and light source module according to
37. The imaging and light source module according to
38. The imaging and light source module according to
39. The imaging and light source module according to
40. The imaging and light source module according to
41. The imaging and light source module according to
42. The imaging and light source module according to
|
The present disclosure relates to reverse vending machines, and in particular to deriving information relating to features of objects in reverse vending machines.
Systems for recycling of returnable containers, for example beverage containers, have been in place for many years as a means to prevent littering and conserve resources. Such systems were originally based on manual handling of returned containers by vendors, but the process has been made more efficient by the introduction of reverse vending machines which were able to accept empty containers, verify the authenticity of the container, and issue a receipt that can be exchanged for cash or used as payment in the store where the reverse vending machine is located.
Over the years reverse vending machines have been made more efficient and sophisticated. They are now typically able to handle a wide range of containers made from various materials, most often glass, PET (polyethylene terephthalate), steel and aluminum. A reverse vending machine is typically able to receive the containers, validate them based on shape and other physical characteristics as well as bar codes and other markings, and sort them based on material or type. Some machines are able to store reusable containers while containers that are only recycled for their material are crushed and stored separately. A reverse vending machine should be able to reject non-returnable containers, detect and handle fraud attempts and assign the proper deposit return value to a wide range of containers. At the same time a machine must be reliable and regular maintenance should not be work intensive or require frequent replacement of parts.
Consequently, there is a need for constant improvement of reverse vending machines in order to meet these challenges as well as new challenges resulting from for example introduction of new types of returnable containers, and more sophisticated fraud attempts.
According to an aspect of the present disclosure there is provided a reverse vending machine comprising an opening 12 for inserting objects into the interior 20 of the machine, a plurality of light sources and a plurality of 2D imaging devices, wherein the plurality of 2D imaging devices and the plurality of light sources are arranged as a plurality of imaging and light units 40 around the perimeter of the interior 20, wherein the imaging and light units 40 comprise one 2D imaging device 41 and one light source 42, the 2D imaging device 41 and the light source 42 are viewing and illuminating the object at a first and a second oblique angle, respectively, and wherein the first and second oblique angles are in the range 45-75° relative to a centre-symmetrical line S of the imaging and light units 40.
According to another aspect of the present disclosure there is provided a method of deriving information relating to at least one feature of an object in a reverse vending machine, the method comprising: providing a plurality of light sources and a plurality of imaging devices arranged as a plurality of imaging and light units 40 around the perimeter of the interior 20 of the reverse vending machine, wherein the imaging and light units 40 comprise one 2D imaging device 41 and one light source 42; obtaining at least one image of the object using at least one 2D imaging device 41 at a first oblique angle α in the range 45-75° relative to a centre-symmetrical line S of the imaging and light units 40; illuminating the object using at least one light source 42 at a second oblique angle β in the range 45-75° relative to a centre-symmetrical line S of the imaging and light units 40; and deriving information relating to the at least one feature using an image received from the at least one 2D imaging device 41.
According to another aspect of the present disclosure there is provided an imaging and light source module insertable in a reverse vending machine, comprising: a plurality of imaging and light units 40, wherein the imaging and light units comprise one 2D imaging device 41 and one light source 42 arranged around the perimeter of an opening 32 in a cartridge 31, the opening 32 being adapted to fit around an opening 12 for inserting objects into the reverse vending machine; wherein when the module 30 is inserted in a reverse vending machine, the 2D imaging device 41 and the light source 42 are viewing and illuminating the object at a first and a second oblique angle, respectively, wherein the first and second oblique angles are in the range 45-75° relative to a centre-symmetrical line S of the imaging and light units 40.
Other aspects of the present disclosure are to be understood by the dependent patent claims and the detailed description hereinafter, with reference to the amended figures.
In the following description various examples and embodiments of the disclosure are set forth in order to provide the skilled person with a more thorough understanding of the disclosure. The specific details described in the context of the various embodiments and with reference to the attached drawings are not intended to be construed as limitations.
In the exemplary embodiments, various features and details are shown in combination. The fact that several features are described with respect to a particular example should not be construed as implying that those features by necessity have to be included together in all embodiments of the disclosure. Conversely, features that are described with reference to different embodiments should not be construed as mutually exclusive. As those with skill in the art will readily understand, embodiments that incorporate any subset of features described herein and that are not expressly interdependent have been contemplated by the inventor and are part of the intended disclosure. Explicit description of all such embodiments would, however, not contribute to the understanding of the principles of the disclosure, and consequently some permutations of features have been omitted for the sake of simplicity.
The term reverse vending machine as applied to the present application also contemplates systems for recycling of returnable containers where the no return value is paid out when a container is returned, e.g. in waste disposal systems for sorting out recyclable containers.
Reference is now made to
The front of the machine includes an opening 12 into which returnable items can be entered by the customer. Also provided is a display for providing messages to the customer and an input device allowing the customer to enter simple commands, for example indicating that the customer has entered all their returnable items. As illustrated in
The machine 10 may also include a loudspeaker 18 or some other form of audible or visual alarm that can be used to issue notifications to the customer or to an operator for example in the case of a malfunction, storage capacity overflow or some other issue that needs attention.
When a customer enters a returnable item into the reverse vending machine 10, the item must be recognized, its authenticity verified and the appropriate value must be determined.
Traditionally, a returned container is observed by one or more cameras 24 while it is transported through the chamber 20, and the images are analyzed electronically in order to determine the authenticity of the container. Later developments have introduced barcode readers or other devices for recognizing markings on the containers. A number of different types of technologies for barcode readers are known in the art, but the principal features shared by most of them include a light source and a light sensor. The light source can for example be light emitting diodes (LEDs), lasers or lamps, and the light sensor can be one or more photodiodes, or cameras. According to the exemplary embodiment illustrated in
The majority of barcode readers in store check-out and reverse vending machines today are laser scanners. However, the laser scanners are gradually being replaced by camera based readers, in particular 2D imaging devices, as 2D imaging devices and image processing techniques allow more features than merely decoding the bar code, such as analyzing advanced security mark features, or the shape, color and materials an object is composed of. The two types of readers have very different illumination and imaging geometries, which means they are faced with different problems when reading highly reflective surfaces. White bars on a reflective background gives very good contrast for a laser reader, thus this has become a very popular way of printing barcodes on aluminum cans. A 2D imaging device based reader has more difficulty in handling this kind of print on shiny objects in general, and on dented shiny objects in particular. This is particularly due to the fact that shiny surfaces cause specular reflexes that make the barcode, or parts of the barcode, unreadable. Hereinafter, is a 2D imaging device for simplicity referred to as a camera.
One known solution to get around this problem is to use polarized light and a crossed polarizer in front of the camera. However, this solution is costly to produce and leads to unwanted loss of light. According to an exemplary embodiment of the present embodiment an alternative solution is proposed wherein light from the light sources is angled on the object with an angle relative to the camera such that substantially all specular reflections are directed away from the camera lens.
Although one could consider employing only one camera 26 and one light source 28, inclusion of more than one camera and/or light sources improves illumination conditions and the field of view of the camera system. These additional cameras and light sources may be separate elements, or they may be arranged in a module of cameras and light sources for easy assembly into the reverse vending machine. In one alternative embodiment of the present disclosure a plurality of the one camera 26 and the one light source 28 is arranged in a plurality of imaging and light units 40, each imaging and light unit 40 comprising one camera 41 and one light source 42. Although only one imaging and light unit 40 is shown in
Although, the imaging and light units 40 illustrated in
An imaging and light source module 30 according to an embodiment of the present disclosure is illustrated in
According to one exemplary embodiment of the present disclosure illustrated in
According to an exemplary embodiment of an imaging and light unit 40 of the present disclosure illustrated in
Furthermore, the unit 40 illustrated in
In an alternative embodiment of the present disclosure, the mirrors 43, 44 are not used, and camera 41, or alternatively an array of cameras, is positioned such that the camera 41 facing the chamber, e.g. where mirror 44 is positioned in
As described above, the viewing distance along G should be as long as possible to obtain images with sufficient resolution to decode the features of small objects (small diameter) as well as large objects (large diameter), and as seen in
Although kept constant in the discussion above, it is further contemplated by embodiments of the present disclosure that the optical properties of the system may be changed by altering the optical properties of the layer 45, e.g. altering the refractive index of the layer 45 or coating the layer 45 with an anti-reflective coating, such that more light is allowed to pass the layer 45 at more narrow angles. In an exemplary embodiment of the present disclosure as discussed above, the angle A is in the range 20-45°. According to one embodiment of the present disclosure the layer 45 is provided with an anti-reflective coating, such that the incident light from the object 50 on the layer 45, i.e. angle A, may be as low as 15°. That is, the available range of the viewing and illumination angles towards an object 50 in the chamber can be extended from somewhere between 45 and 70° relative to the centre-symmetrical line S of the imaging and light units 40 to as high as 75° relative to the centre-symmetrical line S of the imaging and light units 40. The anti-reflective coating thus ensures that the upper limit of the range of the first and second oblique angles (α, β) at 75° can be achieved without excessive light loss due to reflection.
According to one exemplary embodiment illustrated in
Dents in cans and/or bottles provides specular surfaces reflecting light in an unpredictable way, often creating errors when reading the barcode. Because the angle between the viewing angle of the camera and the angle of the incoming light on the object is fixed and the position of the can does not change much between consecutive exposures, even consecutive images may exhibit the same error, eventually causing failure in reading the barcode. Thus, according to an exemplary embodiment of the present disclosure, adjacent cameras (40a, 40b, 40c . . . ) are arranged such that the field of view of adjacent cameras is arranged such that they overlap each other. Adjacent cameras may be arranged such that an area of an object which is in the field of view of one camera is also within the field of view of at least one adjacent camera. By this arrangement, a specular reflection observed by one camera will in most cases not be observed by an adjacent camera observing the same area. An image of the entire barcode without specular reflections can then be created based on visible parts of the barcode from several images obtained from several cameras, thus allowing successful reading of barcodes and other marks on dented cans and/or bottles.
Combining several images into one image relies on overlap between fragments (i.e. visible part of barcode), or as a minimum a “touch” between the fragments from a sequence of consecutive images from one camera, overlapping images from adjacent cameras or a combination of both. As such, combined images can be performed on images overlapping in space (i.e. images by neighboring cameras), in time (i.e. consecutive images by one camera), or a combination of both. In one exemplary embodiment the camera 41 is a freeze frame digital image sensor, which allows capturing images with low motion blur and high speed.
According to an exemplary embodiment of the present disclosure, the imaging and light units 40 surrounding the opening 32 may be configured to allow individual control of the camera 41 and the light source 42 of each of the imaging and light units 40. This allows for selecting different illumination schemes and imaging schemes dependent on conditions and/or the specifications of the reverse vending machines. In particular the system may allow activation of all light sources 42 and all cameras 41 on all units simultaneously; activating light source 42 and camera 41 for each of the units sequentially; and activating the camera of one unit 41b while activating the light sources of the adjacent units 40a, 40c, sequentially for all the units. The latter configuration creates a sharper illumination angle of the can or bottle with respect to the camera, thereby reducing specular reflections observed by the middle camera unit 41b. Traditionally different cameras have been used to read the different features of an object in a reverse vending machine, typically one camera arrangement has been used for reading the barcode and another camera arrangement for the shape, or contour, of an object. According to an exemplary embodiment of the present disclosure the camera 41 is utilized for reading the shape of an object or part of the object, as well as a bar code, a security mark or a deposit mark.
One exemplary embodiment for reading the shape of the object is illustrated in
The image viewed by the camera will show the contour of the bottle totally dark and with such sharp image as the camera is able to reproduce. The reason for the perfect, dark outline is as follows. Without any article located in the path of light the camera field of view will be filled by light from the light source 46, i.e. causing the image to be completely bright. If some parts of the light are deflected relative to its normal direction, those parts of the light will not reach the camera 41, and those portions will become dark. This is in particular the situation with a transparent bottle of glass or plastics. The material of such bottles will refract the light to cause it to change direction. Such refraction is in particular strong at the outline, which therefore appears to be dark. The thicker the walled bottle present in the chamber, the wider the dark outline. A glass bottle having a somewhat thick wall will in most cases appear to be dark all over. Even quite thin walled bottles of plastics provide a sharp and excellent outline.
The embodiment described with reference to
Now returning to
Reference is now made to
The reverse vending machine may also include a bar code reading unit 86 and a feature extraction unit 88. The feature extraction unit 88 may, depending on the requirements of the reverse vending machine, recognize and analyze features such as advanced security mark features or the color and materials a returned object is composed of, and communicating such recognition back to the processing unit 80. Those with skill in the art will realize that the shape comparison unit 84, the bar code reading unit 86 and the feature extraction unit 88 may be implemented as software stored in a storage device (not shown) and configured to be executed by the processing unit 80. These units may also be fully or partly implemented as separate processors, graphic processors, field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), or a combination thereof. Furthermore, several of the various algorithms, instructions and hardware implementing these units may operate as part of more than one such unit. For example, algorithms implemented as software modules in the bar code reading unit 86, may double as part of one or more feature extraction functions that are part of the feature extraction unit 88.
Those with skill in the art will also understand that additional components that are not illustrated in
Patent | Priority | Assignee | Title |
11295104, | Jun 10 2020 | Zebra Technologies Corporation | Methods and apparatus to read barcodes on reflective surfaces |
Patent | Priority | Assignee | Title |
4656510, | Aug 29 1984 | Halton System Oy | Apparatus for identifying and recording bottles and/or bottle hampers |
5898169, | Mar 31 1994 | Tomra Systems A/S | Device for generating, detecting and recognizing a contour image of a liquid container |
20100290767, | |||
DE202007003767, | |||
EP174549, | |||
EP2107534, | |||
EP2363837, | |||
JP2002107305, | |||
JP2009095718, | |||
JP2009175789, | |||
JP2011503573, | |||
WO2009021515, | |||
WO2009061207, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jun 22 2012 | Tomra Systems ASA | (assignment on the face of the patent) | / | |||
Dec 19 2013 | KAURALA, SIMO | Salcomp Oyj | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 031829 | /0337 | |
Feb 04 2014 | KIRKERUD, VIDAR | Tomra Systems ASA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 032293 | /0799 | |
Feb 04 2014 | LUNDE, TOM | Tomra Systems ASA | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 032293 | /0799 |
Date | Maintenance Fee Events |
Sep 21 2021 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Apr 03 2021 | 4 years fee payment window open |
Oct 03 2021 | 6 months grace period start (w surcharge) |
Apr 03 2022 | patent expiry (for year 4) |
Apr 03 2024 | 2 years to revive unintentionally abandoned end. (for year 4) |
Apr 03 2025 | 8 years fee payment window open |
Oct 03 2025 | 6 months grace period start (w surcharge) |
Apr 03 2026 | patent expiry (for year 8) |
Apr 03 2028 | 2 years to revive unintentionally abandoned end. (for year 8) |
Apr 03 2029 | 12 years fee payment window open |
Oct 03 2029 | 6 months grace period start (w surcharge) |
Apr 03 2030 | patent expiry (for year 12) |
Apr 03 2032 | 2 years to revive unintentionally abandoned end. (for year 12) |