systems and methods use a supporting arm having a first end and a second end, and a program of scanning instructions readable by a computerized processor. The first end of the supporting arm is connected to a secondary device. The second end of the supporting arm holds a portable device comprising a camera. The camera has a field of view within which images are captured. The portable device maintains the scanning instructions. The second end of the supporting arm is positioned to hold the camera in a location, relative to the secondary device, to maintain the surface of the secondary device within the field of view of the camera. The camera of the portable device obtains images of objects placed on the surface of the secondary device when the portable device is held by the portable device holder.
|
15. A method comprising:
connecting a first end of a support arm to a secondary device using a surface connector of said first end of said support arm;
connecting a second end of said support arm to a portable device using a portable device holder of said second end of said support arm, said portable device holder being sized and shaped to hold said portable device, said portable device comprising a camera;
positioning said second end of said support arm to hold said camera in a location, relative to said secondary device, to maintain a surface of said secondary device within a field of view of said camera, said portable device maintaining a program of scanning instructions readable by a computerized processor;
obtaining images of objects placed on said surface of said secondary device using said camera of said portable device when said portable device is held by said portable device holder; and
automatically correcting distortions of said images of said objects placed on said surface of said printer using said scanning instructions executed by a processor of said portable device to generate undistorted images of said objects.
1. A system comprising:
a support arm having a first end and a second end; and
a program of scanning instructions readable by a computerized processor,
said first end of said support arm comprising a surface connector,
said surface connector being sized and shaped to connect to a secondary device,
said second end of said support arm comprising a portable device holder,
said portable device holder being sized and shaped to hold a portable device comprising a camera,
said camera having a field of view within which images are captured,
said portable device maintaining said scanning instructions,
said second end of said support arm being positioned to hold said camera in a location, relative to said secondary device, to maintain a surface of said secondary device within said field of view of said camera,
said camera of said portable device obtaining images of objects placed on said surface of said secondary device when said portable device is held by said portable device holder, and
said scanning instructions causing a processor of said portable device to automatically correct distortions of said images of said objects placed on said surface of said secondary device to generate undistorted images of said objects.
8. A system comprising:
a support arm having a first end and a second end; and
a program of copying instructions readable by a computerized processor,
said first end of said support arm comprising a surface connector,
said surface connector being sized and shaped to connect to a printer device,
said second end of said support arm comprising a portable device holder,
said portable device holder being sized and shaped to hold a portable device comprising a camera,
said camera having a field of view within which images are captured,
said portable device and said printer device maintaining said copying instructions,
said second end of said support arm being positioned to hold said camera in a location, relative to said printer device, to maintain a surface of said printer device within said field of view of said camera,
said camera of said portable device obtaining images of objects placed on said surface of said printer device when said portable device is held by said portable device holder,
said copying instructions causing a processor of said portable device to automatically correct distortions of said images of said objects placed on said surface of said printer device to generate undistorted images of said objects,
said copying instructions causing said processor to forward said undistorted images of said objects to said printer device, and
said copying instructions causing said printer device to print said undistorted images of said objects.
2. The system according to
3. The system according to
4. The system according to
5. The system according to
6. The system according to
7. The system according to
9. The system according to
10. The system according to
11. The system according to
12. The system according to
13. The system according to
14. The system according to
16. The method according to
17. The method according to
18. The method according to
19. The method according to
20. The method according to
|
Systems and methods herein generally relate to using portable devices as scanners and more particularly to using items such as smartphones, tablet computers, etc. as scanners.
Low-end printing devices often have very limited capabilities and many such devices do not include the ability to scan or copy. However, the ever more available smartphone and tablet computer almost always include a camera, graphic user interface, and processor as standard equipment.
Exemplary systems herein comprise a supporting arm having a first end and a second end, and a program of scanning instructions readable by a computerized processor. The first end of the support arm comprises a surface connector (such as a biased clamp, permanent physical connections, etc.) and the surface connector is sized and shaped to connect to a secondary device. The second end of the support arm comprises a portable device holder (such as a biased clamp, a slotted frame, etc.) and the portable device holder is sized and shaped to hold a portable device comprising a camera (such as a smart phone, a personal digital assistant, a tablet computer, a stand-alone digital camera, etc.).
The camera has a field of view within which images are captured. The portable device maintains the scanning instructions. The second end of the support arm is positioned to hold the camera in a location, relative to the secondary device, to maintain the surface of the secondary device within the field of view of the camera. The camera of the portable device obtains images of objects placed on the surface of the secondary device when the portable device is held by the portable device holder.
The scanning instructions cause the processor of the portable device to automatically correct distortions of the images of the objects placed on the surface of the secondary device to generate undistorted and formatted images of the objects. Such undistorted and formatted images contain the objects appearing as laid flat on the surface.
The scanning instructions can also be copying instructions that cause the processor to automatically forward the undistorted and formatted images of the objects to the printer device. Further, such copying instructions cause the printing device to automatically print the undistorted images of the objects.
Various methods herein connect a first end of a support arm to a secondary device using a surface connector of the first end of the support arm. Also, such methods connect a second end of the support arm to a portable device using a portable device holder of the second end of the support arm. The portable device holder is sized and shaped to hold the portable device. The portable device has a camera, and these methods position the second end of the support arm to hold the camera in a location, relative to the secondary device, to maintain a surface of the secondary device within a field of view of the camera. The portable device maintains a program of scanning instructions readable by a computerized processor. These methods obtain images of objects placed on the surface of the secondary device using the camera of the portable device when the portable device is held by the portable device holder.
Also, such methods automatically correct distortions and format of the images of the objects placed on the surface of the printer using the scanning/copying instructions (executed by a processor of the portable device) to generate undistorted and formatted images of the objects.
Again, if the scanning instructions are also copying instructions, these methods cause the processor to automatically forward the undistorted and formatted images of the objects to the printer device. Further, with such copying instructions, these methods cause the printing device to automatically print the undistorted and formatted images of the objects.
These and other features are described in, or are apparent from, the following detailed description.
Various exemplary systems and methods are described in detail below, with reference to the attached drawing figures, in which:
As mentioned above, commonly available smartphones and tablet computers almost always include a camera, graphic user interface, and processor as standard equipment; however, low-end printers often do not include a scanning or copying capability. In view of this, the systems and methods herein provide a lightweight, easy to use, easy to store, stable, portable device holder and associated program of computer readable instructions that utilize the functionality of any portable device having a camera to provide a scanning and copying function to a low-end printing device.
As shown in
The first end 112 of the support arm 110 comprises a surface connector 116 (such as a biased clamp (such as that shown in
The second end 114 of the support arm 110 comprises a portable device holder 122 (such as a slotted frame 122A shown in
The portable device 130 maintains scanning instructions as part of the systems herein, and such scanning instructions are readable and executable by a computerized processor. Such scanning instructions can be loaded onto the portable device 130 when the portable device is connected (wired or wirelessly) to the secondary device or to another computerized device. For example, the scanning instructions can be downloaded by the portable device from a network server, from a local computer, from the printer itself, etc., using wired or wireless connections. Once downloaded, the portable device 130 can maintain the scanning instructions permanently.
The second end 114 of the support arm 110 is positioned to hold the camera 132 in a location, relative to the secondary device 100, to maintain the surface of the secondary device 100 within the field of view 134 of the camera 132. The camera 132 of the portable device 130 obtains images of objects placed on the surface 102 of the secondary device 100 as the portable device holder 122 holds the portable device 130.
To aid in the scanning process (and to optionally, in addition display a pattern of lines or dots on the object being scanned on the surface 102 of the secondary device 100, as discussed in greater detail below) lighting elements 124,
The scanning instructions provided to the portable device 130 cause the processor of the portable device 130 to automatically correct distortions and format of the images of the objects placed on the surface of the secondary device 100 to generate undistorted images of the objects. Such undistorted images contain the objects appearing as laid flat on the surface.
As can be seen in the above drawings, the portable device 130 (e.g., tablet/smartphone) is supported above the printer top 102. Images to be scanned are placed on the printer top 102 and the rear camera 132 on the portable device 130 is used to take the image. The image is then processed by the portable device 130 and sent to the printer for printing, or other destination via a wired or wireless connection (such as Bluetooth, WiFi, USB or other suitable link).
Systems and methods herein also provide additional processing to address defects that are inherent in the quality of the captured image. For example,
With respect to non-uniform illumination, systems and methods herein correct the illumination in the original image coordinates. For example, systems and methods herein take a calibration image of the background and map this image to a uniform value. One such available reference background is the printer top.
With respect to issue of white balance, in color images it is desirable to balance the white in the image. This can be done in the uniform illumination process shown in
With respect to corner detection, as shown by item 156 in
Perspective distortion is also removed by methods and systems herein. From the processing shown in
With respect to the issue of original size, typically the portable device 130 used is known and the holder is a set distance from the surface. Thus, from the original coordinates of the corners, systems and methods herein determine the original size and use this as an input to the printer to print the image on the correct paper. Further, systems and methods herein can scale the image to the default paper size or as part of the calibration for uniformity a known etched/preprinted grid (discussed below) can be scanned such that the setup knows the image size. The etched/preprinted grid is used for sizing, as opposed to contour removal. Therefore the two concepts are divided in this disclosure.
An image of a grid can be projected by the portable device 130 or by lights 124 in the portable device holder 122. For example, in some devices, the lights 124 are flood lights covered with a filter that causes a grid or line pattern to be displayed. A similar filter can be used with the light on the portable device used to produce a picture flash. Alternatively, if the lights 124 or portable device light is used to illuminate the object being photographed, such a filter can be only connected to either the lights 124 or the portable device light. In other alternatives the lights 124 comprise lights capable of producing a pattern (e.g., such as lasers, etc.).
Thus, the scanning instructions can cause the portable device 130 or lights 124 to display a grid on the objects when obtaining images of the objects, so as to obtain images of grid covered objects, as shown for example as item 160 in
The grid pattern shown in item 160 can be generated with a laser and diffraction grating, and can be a full line grid or just a series of dots (as shown in item 162 in
Further, systems and methods herein then map from the actual grid to the reference image. The systems and methods herein can only map from the grid on the image to a perfect notional grid, and can avoid going through the intermediate grid on the printer surface, as this will still have the camera and printer top distortions included.
To avoid chances of eye damage, the systems and methods herein monitor the target image and only power the laser grid 124 when there is no motion in the field of view 134 of the camera 132. Secondly the gird/dots are only flashed for a short time (e.g., 0.5 sec.) that is needed to extract the image contours.
Further, to avoid blurry scans, the systems and methods herein can take multiple pictures of an object and select the least blurry image, or only take an image when several consecutive frames have a stable image. The resultant corrected image 158 is shown in
Therefore, the systems and methods herein perform many phases. In the calibration phase, with a clear platen and no motion, the systems and methods herein capture a reference image. In the image phase, an object is placed on the surface 102 and the user starts the application having the scanning/copying instructions on the portable device 130 (through a graphic user interface standard to all such portable devices). The scanning/copying instructions display various menu options on the portable device 130 graphic user interface. The user then selects a desired menu option on the graphic user interface of the portable device 130.
In response to the menu option selection by the user, the scanning/copying instructions cause the camera 132 to take multiple images within a short time (e.g., within 2-10 seconds, or less). The scanning/copying instructions cause the processor of the portable device 130 to determine if any motion is present. The scanning/copying instructions cause the processor of the portable device 130 to optionally display a user message if motion is present or indicate a successful image capture.
Once the processor determines that there is no motion, the scanning/copying instructions cause the camera of the portable device 130 to acquire an original image (with or without illumination aid provided by the light of the portable device 130 or the lights 124 of the portable device holder 122). Further, the scanning/copying instructions cause the portable device 130 or the lights 124 to briefly display to grid or dot pattern and cause the camera 132 to acquire a second contour image. For this purpose, the portable device can be in wired or wireless communication with the lights 124 of the portable device holder 122 to cause them to display the grid/dot pattern, or the portable device 130 can use its own display capability to display the grid/dot pattern.
The scanning/copying instructions cause the processor of the portable device 130 to invert a contour map back to the reference grid and the smoothed de-warp calculation is applied to the original image. Further, as discussed above, the scanning/copying instructions cause the processor of the portable device 130 to perform other processing steps such as non-uniform illumination correction, white balance, subject corner detection, perspective distortion correction, original size determination, etc.
In one example, the systems and methods provide an automatic book copy process. More specifically, the scanning instructions can also be copying instructions that cause the processor to automatically forward the processed undistorted images of the objects to the printer device (again, through wired or wireless connections). Further, such copying instructions cause the printing device to automatically print the undistorted images of the objects, without requiring the user to provide any printing instructions or commands to the printer.
With respect to book copying, scanning/copying instructions cause the portable device 130 to instruct the user when to turn a page (through the graphic user interface) and to detect motion when pages are turned (using the camera). Further, the scanning/copying instructions cause the processor of the portable device 130 to identify the still periods between page turns, and to take the contour compensation image and the book image in these still periods making up a copy of the book. For example, the scanning/copying instructions can cause a speaker or the graphic user interface of the portable device 130 to produce a simple signal after each page is captured to signal the user to turn to the next page, and optionally a different signal to signify that the page capture is in progress. When the book is finished the user simply selects a finish menu selection option on the graphic user interface. With the book facing up and the automatic motion detection and image capture this method provides an extremely easy method of copying the book with minimal user intervention.
Further robustness is added because the scanning/copying instructions cause the processor of the portable device 130 to check for duplicate pages by post-processing the images and looking for duplicates in the image stream. The scanning/copying instructions cause the processor of the portable device 130 to optionally delete duplicate pages before printing or saving the finished book.
The input/output device 226 is used for communications to and from the computerized device 200. The processor 224 controls the various actions of the computerized device. A non-transitory computer storage medium device 220 (which can be optical, magnetic, capacitor based, etc.) is readable by the processor 224 and stores instructions that the processor 224 executes to allow the computerized device to perform its various functions, such as those described herein. Thus, as shown in
As shown in
Also, in item 308, such methods automatically correct distortions and format of the images of the objects placed on the surface of the printer using the scanning/copying instructions (executed by a processor of the portable device) to generate undistorted images of the objects (as discussed above). As noted above, during the process of obtaining images of the objects in item 306, these methods can cause the portable device to display a grid on the objects (using the scanning/copying instructions executed by the processor of the portable device) to obtain images of grid covered objects. Thus, when automatically correcting distortions in item 308, such methods use the images of grid covered objects to determine the amount of angular distortion within the images of the objects.
Again, if the scanning instructions are also copying instructions, these methods cause the processor to automatically forward the undistorted images of the objects to the printer device in item 310. Further, with such copying instructions, these methods cause the printing device to automatically print the undistorted images of the objects in item 312. The system and methods herein are not limited to just printing and copying, but can also be used with scanning and sharing technologies.
Many computerized devices are discussed above. Computerized devices that include chip-based central processing units (CPU's), input/output devices (including graphic user interfaces (GUI), memories, comparators, processors, etc. are well-known and readily available devices produced by manufacturers such as Dell Computers, Round Rock Tex., USA and Apple Computer Co., Cupertino Calif., USA. Such computerized devices commonly include input/output devices, power supplies, processors, electronic storage memories, wiring, etc., the details of which are omitted herefrom to allow the reader to focus on the salient aspects of the systems and methods described herein. Similarly, scanners and other similar peripheral equipment are available from Xerox Corporation, Norwalk, Conn., USA and the details of such devices are not discussed herein for purposes of brevity and reader focus.
The terms printer or printing device as used herein encompasses any apparatus, such as a digital copier, bookmaking machine, facsimile machine, multi-function machine, or simply a passive support table etc., which performs a print outputting function for any purpose. The details of printers, printing engines, etc., are well-known and are not described in detail herein to keep this disclosure focused on the salient features presented. The systems and methods herein can encompass systems and methods that print in color, monochrome, or handle color or monochrome image data. All foregoing systems and methods are specifically applicable to electrostatographic and/or xerographic machines and/or processes.
Further, an image output device is any device capable of rendering the image. The set of image output devices includes digital document reproduction equipment and other copier systems as are widely known in commerce, photographic production and reproduction equipment, monitors and other displays, computer workstations and servers, including a wide variety of color marking devices, and the like.
To render an image is to reduce the image data (or a signal thereof) to viewable form; store the image data to memory or a storage device for subsequent retrieval; or communicate the image data to another device. Such communication may take the form of transmitting a digital signal of the image data over a network.
In addition, terms such as “right”, “left”, “vertical”, “horizontal”, “top”, “bottom”, “upper”, “lower”, “under”, “below”, “underlying”, “over”, “overlying”, “parallel”, “perpendicular”, etc., used herein are understood to be relative locations as they are oriented and illustrated in the drawings (unless otherwise indicated). Terms such as “touching”, “on”, “in direct contact”, “abutting”, “directly adjacent to”, etc., mean that at least one element physically contacts another element (without other elements separating the described elements). Further, the terms automated or automatically mean that once a process is started (by a machine or a user), one or more machines perform the process without further input from any user.
It will be appreciated that the above-disclosed and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims Unless specifically defined in a specific claim itself, steps or components of the systems and methods herein cannot be implied or imported from any above example as limitations to any particular order, number, position, size, shape, angle, color, or material.
Wilsher, Michael John, Golding, Michael Peter, Roche, Lee, Jenkins, Jr., Jack Douglas
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
6540415, | Sep 02 1999 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Document capture stand |
7377660, | Dec 18 2003 | Sharp Kabushiki Kaisha | Photographing assisting apparatus, photographing method, and photographing system |
7496454, | Jul 19 2004 | University of Virginia Patent Foundation | High mast inspection system, equipment and method |
7624928, | Nov 18 2005 | FUJIFILM Business Innovation Corp | Method and apparatus for making tags, tag, and system for managing articles |
8400564, | May 03 2010 | Microsoft Technology Licensing, LLC | Image capture |
8479997, | Jun 16 2010 | Symbol Technologies, LLC | Optical scanner with customer interface |
20060066753, | |||
20060103893, | |||
20110205425, | |||
20130057927, | |||
20130075472, | |||
20140063519, | |||
DE3600643, | |||
EP2161489, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Nov 05 2013 | GOLDING, MICHAEL PETER | Xerox Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 031622 | /0904 | |
Nov 05 2013 | WILSHER, MICHAEL JOHN | Xerox Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 031622 | /0904 | |
Nov 05 2013 | ROCHE, LEE | Xerox Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 031622 | /0904 | |
Nov 07 2013 | JENKINS, JACK DOUGLAS, JR | Xerox Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 031622 | /0904 | |
Nov 18 2013 | Xerox Corporation | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
May 01 2015 | ASPN: Payor Number Assigned. |
Oct 26 2018 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jan 16 2023 | REM: Maintenance Fee Reminder Mailed. |
Jul 03 2023 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
May 26 2018 | 4 years fee payment window open |
Nov 26 2018 | 6 months grace period start (w surcharge) |
May 26 2019 | patent expiry (for year 4) |
May 26 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
May 26 2022 | 8 years fee payment window open |
Nov 26 2022 | 6 months grace period start (w surcharge) |
May 26 2023 | patent expiry (for year 8) |
May 26 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
May 26 2026 | 12 years fee payment window open |
Nov 26 2026 | 6 months grace period start (w surcharge) |
May 26 2027 | patent expiry (for year 12) |
May 26 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |