A method for capturing an image using an image capture device is disclosed. The image is capable of including a plurality of objects. Each of the plurality of objects is a corresponding distance from the imaging device. The image is associated with a focus zone. The method and system include determining if the image matches at least one criterion and determining whether at least one of the plurality of objects is out of focus if the image matches the at least one criterion. The method and system further include shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus.
|
18. A computer-readable medium containing a program for capturing an image capable of including a plurality of objects, each of the plurality of objects being a corresponding distance from the imaging device, the image being associated with a focus zone, program including instructions for:
determining if the image matches at least one criterion;
determining whether at least one of the plurality of objects is out of focus if the image matches the at least one criterion;
determining whether the focus zone can be shifted so that that the at least one object is out of focus if the at least one object is not out of focus;
shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus if it is determined that the focus zone can be shifted so that the at least one object is out of focus;
setting an aperture size without shifting the focus zone after the focus zone has been shifted if it is determined that the focus zone can be shifted so that the at least one object is out of focus;
adjusting the aperture size to shorten the focus zone if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
1. A method for capturing an image using an image capture device, the image capable of including a plurality of objects, each of the plurality of objects being a corresponding distance from the imaging device, the image being associated with a focus zone, method comprising the steps of:
(a) determining if the image matches at least one criteria;
(b) determining whether at least one of the plurality of objects is out of focus if the image matches the at least one criteria;
(c) determining whether the focus zone can be shifted so that the at least one object is out of focus if the at least one object is not out of focus; and
(d) shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus and if it is determined that the focus zone can be shifted so that the at least one object is out of focus;
(e) setting an aperture size without shifting the focus zone after the focus zone has been shifted if it is determined that the focus zone can be shifted so that the at least one object is out of focus; and
(f) adjusting the aperture size to shorten the focus zone if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
9. An image capture device for capturing an image capable of including a plurality of objects, each of the plurality of objects being a corresponding distance from the imaging device, the image being associated with a focus zone, the image capture device comprising:
means for determining if the image matches at least one criterion;
means for determining whether at least one of the plurality of objects is out of focus if the image matches the at least one criteria;
means for determining whether the focus zone can be shifted so that the at least one object is out of focus if the at least one object is not out of focus; and
means for shifting the focus zone, the focus zone shifting means shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus if it is determined that the focus zone can be so shifted;
means for adjusting an aperture size, the aperture size adjusting means setting the aperture size without shifting the focus zone after the focus zone has been shifted if it is determined that the focus zone can be shifted so that the at least one object is out of focus and adjusting the aperture size to shorten the focus zone if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
8. A method for allowing an image having a center to be captured by an imaging device, the image capable of including a plurality of objects, each of the plurality of objects being a corresponding distance from the imaging device, the method comprising the steps of:
(a) determining if the image matches a plurality of criteria, the step of determining if the image matches the plurality criteria further including the steps of:
(a1) determining the corresponding distance for each of the plurality of objects;
(a2) categorizing the plurality of objects as being located in a foreground or a background based on the corresponding distance, the image matching a first criteria of the plurality of criteria if a first object in foreground has a first corresponding distance and a second object in the background has a second corresponding distance;
(a3) separating the image into a plurality of zones;
(a4) analyzing the image in each of the plurality of zones to determine an amount of the image which each of the plurality of objects occupies, the image matching a second criteria of the plurality of criteria if the first object occupies a particular amount of the image;
(a5) analyzing the image in each of the plurality of zones to determine if the first object in the foreground is in proximity to the center of the image, the image matching a third criteria of the plurality of criteria if the first object is in proximity to the center of the image;
(b) determining whether the second object is out of focus if the image matches at least one criteria;
(c) determining a focus zone;
(d) determining whether the focus zone can be shifted so that that the at least one object is out of focus if the at least one object is not out of focus; and
(e) shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus and if the focus zone can be shifted so that the at least one object is out of focus;
(f) setting an aperture size without shifting the focus zone after the focus zone has been shifted if it is determined that the focus zone can be shifted so that the at least one object is out of focus; and
(g) adjusting the aperture size to shorten the focus zone if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
21. A computer-readable medium containing a program for capturing an image having a center to be captured by an imaging device, the image capable of including a plurality of objects, each of the plurality of objects being a corresponding distance from the imaging device, the program containing instructions for:
determining if the image matches a plurality of criteria, the instructions for determining if the image matches the plurality criteria further including instruction for:
determining the corresponding distance for each of the plurality of objects;
categorizing the plurality of objects as being located in a foreground or a background based on the corresponding distance, the image matching a first criterion of the plurality of criteria if a first object in foreground has a first corresponding distance and a second object in the background has a second corresponding distance;
separating the image into a plurality of zones;
analyzing the image in each of the plurality of zones to determine an amount of the image which each of the plurality of objects occupies, the image matching a second criterion of the plurality of criteria if the first object occupies a particular amount of the image;
analyzing the image in each of the plurality of zones to determine if the first object in the foreground is in proximity to the center of the image, the image matching a third criterion of the plurality of criteria if the first object is in proximity to the center of the image;
determining whether the second object is out of focus if the image matches at least one criterion;
determining a focus zone;
determining whether the focus zone can be shifted so that that the at least one object is out of focus if the at least one object is not out of focus; and
shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus and if the focus zone can be shifted so that the at least one object is out of focus;
setting an aperture size without shifting the focus zone after the focus zone has been shifted if it is determined that the focus zone can be shifted so that the at least one object is out of focus;
adjusting the aperture size to shorten the focus zone if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
2. The method of
(a1) determining the corresponding distance for each of the plurality of objects.
3. The method of
(a2) categorizing the plurality of objects as being located in a foreground or a background based on the corresponding distance, the image matching one of the at least one criteria if a first object in the foreground has a first corresponding distance and a second object in the background has a second corresponding distance.
4. The method of
(a1) separating the image into a plurality of zones;
(a2) analyzing the image in each of the plurality of zones to determine if the image matches the at least one criteria.
5. The method of
(a2i) determining the amount of each zone and a number of zones which the particular object occupies.
6. The method of
7. The method of
(d1) shifting the focus zone so that the at least one object is outside of the focus zone if the focus zone can be shifted so that the at least one object is outside of the focus zone.
10. The image capture device of
means for determining the corresponding distance for each of the plurality of objects.
11. The image capture device of
means for categorizing the plurality of objects as being located in a foreground or a background based on the corresponding distance, the image matching one of the at least one criteria if a first object in the foreground has a first corresponding distance and a second object in the background has a second corresponding distance.
12. The image capture device of
means for separating the image into a plurality of zones; and
means for analyzing the image in each of the plurality of zones to determine if the image matches the at least one criteria.
13. The image capture device of
means for determining the amount of each zone and a number of zones which the particular object occupies.
14. The image capture device of
15. The image capture device of
means for shifting the focus zone so that the at least one object is outside of the focus zone if the focus zone can be shifted so that the at least one object is outside of the focus zone.
16. The image capture device of
means for adjusting the shifting of the focus zone so that the focus zone can be shifted so that at least one object is outside of the focus zone if the at least one of the plurality of subjects is not out of focus.
19. The computer-readable medium of
shifting the focus zone so that the at least one object is outside of the focus zone if the focus zone can be shifted so that the at least one object is outside of the focus zone.
20. The computer-readable medium of
adjusting the focus zone so that the focus zone can be shifted so that at least one object is outside of the focus zone if the focus zone can be shifted so that the at least one object is outside of the focus zone.
22. The method of
(g) setting the focus zone location based on the aperture size if the aperture size has been adjusted to shorten the focus zone if it is determined that the focus zone cannot be shifted so that the at least one object is out of focus.
23. The method of
(h) setting the focus zone location based on the aperture size if the aperture size has been adjusted to shorten the focus zone if it is determined that the focus zone cannot be shifted so that the at least one object is out of focus.
24. The image capture device of
25. The computer-readable medium of
setting the focus zone location based on the aperture size if the aperture size has been adjusted to shorten the focus zone if it is determined that the focus zone cannot be shifted so that the at least one object is out of focus.
26. The computer-readable medium of
setting the focus zone location based on the aperture size if the aperture size has been adjusted to shorten the focus zone if it is determined that the focus zone cannot be shifted so that the at least one object is out of focus.
27. The method of
(f1) adjusting the aperture size to shorten the focus zone only if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
28. The method of
(g1) adjusting the aperture size to shorten the focus zone only if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
29. The image capture device of
30. The computer-readable medium of
adjusting the aperture size to shorten the focus zone only if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
31. The computer-readable medium of
adjusting the aperture size to shorten the focus zone only if it is determined that shifting the focus zone alone is not sufficient for the at least one object to be out of focus.
|
|||||||||||||||||||||||||||
The present invention relates to imaging devices, such as digital cameras, and more particularly to a method and system for shifting the focus zone to provide improved quality of portrait images.
Users capture a variety of images using conventional image capture devices, such as conventional cameras or conventional digital cameras. Often, the user desires different characteristics for different images being captured. Typically, the characteristics depend on the objects within the image in which the user is interested. For example, objects within a portrait image typically include a subject or subjects in the foreground and a variety of other objects in the background. When the user captures a portrait image, the user typically desires the subjects to be in focus, appearing sharply defined in the image. However, the user also typically desires the objects in the background to appear soft, or out of focus. Similarly, when a user captures an image of a moving object, the user typically desires the moving object to be in focus.
In order to allow a user to capture images having the desired qualities, conventional image capture devices, such as conventional cameras or conventional digital cameras, may have conventional hint modes. Conventional hint modes typically set the shutter speed and aperture size based on the conditions under which the image is taken. For example, hint modes may include a conventional portrait hint mode, sport mode, or twilight mode. In conventional sport mode, the shutter speed of the conventional image capture device is set to be very fast. Thus, the moving object may appear in focus. In the conventional twilight mode, the shutter speed is set much lower, to allow sufficient light for image capture. In the conventional portrait mode, the aperture is set to have a medium focus zone, to allow the subject to be in focus and the background soft. The focus zone is the range around the focus distance in which objects will appear sharp and in focus. The focus distance is distance from the image capture device which is most sharply in focus. The focus zone is inversely proportional to the aperture size. In addition, some conventional image capture devices may be set to automatically select a hint mode based on an analysis of the image data which indicates the conditions under which the image is captured.
Although conventional image capture devices allow some improvement in image quality, some images may still not have the desired qualities. This is particularly true of portrait images. Often, the subjects in the foreground of a portrait image are relatively close to other objects that are in the background. As a result, the focus zone encompasses both the subjects in the foreground and the other objects in the background. Both the foreground and the background will be in focus, appearing sharply defined in the portrait image. The portrait image, therefore, has undesirable characteristics and relatively poor quality.
Accordingly, what is needed is a system and method for improving portrait image quality, particularly for images in which objects in the background and objects in the foreground are relatively close. The present invention addresses such a need.
The present invention provides a method and system for capturing an image using an image capture device. The image is capable of including a plurality of objects. Each of the plurality of objects is a corresponding distance from the imaging device. The image is associated with a focus zone. The method and system comprise determining if the image matches at least one criterion and determining whether at least one of the plurality of objects is out of focus if the image matches the at least one criterion. The method and system further comprise shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus.
According to the system and method disclosed herein, the present invention allows a user to capture a portrait image in which the subject is in focus, while the background is not in focus, thereby improving image quality.
The present invention relates to an improvement in imaging devices, including digital cameras. The following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements. Although the present invention will be described in the context of a digital camera, various modifications to the preferred embodiment will be readily apparent to those skilled in the art and the generic principles herein may be applied to other embodiments. For example, any image capture device, particularly a portable device, which displays images, icons, and/or other items could incorporate the features described hereinbelow and that device would be within the spirit and scope of the present invention. Moreover, the present invention is also consistent with other image capture devices, such as cameras or video cameras. Thus, the present invention is not intended to be limited to the embodiment shown, but is to be accorded the widest scope consistent with the principles and features described herein.
Referring now to
CPU 344 may include a conventional microprocessor device for controlling the operation of camera 110. In the preferred embodiment, CPU 344 is capable of concurrently running multiple software routines to control the various processes of camera 110 within a multithreaded environment. For example, images may be captured at the same time that previously captured images are processed in the background to effectively increase the capture rate of the camera. In a preferred embodiment, CPU 344 runs an operating system that includes a menu-driven GUI and provides image processing through software, rather than hardware. An example of such software is the Digita™ Operating Environment by FlashPoint Technology of San Jose, Calif. Although CPU 344 is preferably a microprocessor, one or more DSP's (digital signal processor) or ASIC's (Application Specific Integrated Circuit) could also be used.
I/O 348 is an interface device allowing communications to and from computer 118. For example, I/O 348 permits an external host computer (not shown) to connect to and communicate with computer 118. I/O 348 also interfaces with a plurality of buttons and/or dials 404, and an optional status LCD 406, which in addition to the LCD screen 402, are the hardware elements of the camera's user interface 408.
Non-volatile memory 350, which may typically comprise a conventional read-only memory or flash memory, stores a set of computer-readable program instructions to control the operation of camera 110. Removable memory 354 serves as an additional image data storage area and is preferably a non-volatile device, such a flash disk, readily removable and replaceable by a camera 110 user via buffers/connector 352.
Power supply 356 supplies operating power to the various components of camera 110. Power manager 342 communicates via line 366 with power supply 356 and coordinates power management operations for camera 110. In the preferred embodiment, power supply 356 provides operating power to a main power bus 362 and also to a secondary power bus 364. The main power bus 362 provides power to imaging device 114, I/O 348, non-volatile memory 350 and removable memory 354. The secondary power bus 364 provides power to power manager 342, CPU 344 and DRAM 346.
Power supply 356 is connected to main batteries 358 and also to backup batteries 360. In the preferred embodiment, a camera 110 user may also connect power supply 356 to an external power source. During normal operation of power supply 356, the main batteries 358 provide operating power to power supply 356 which then provides the operating power to camera 110 via both main power bus 362 and secondary power bus 364. During a power failure mode in which the main batteries 358 have failed (when their output voltage has fallen below a minimum operational voltage level) the backup batteries 360 provide operating power to power supply 356 which then provides the operating power only to the secondary power bus 364 of camera 110.
Dynamic Random-Access-Memory (DRAM) 346 is a contiguous block of dynamic memory that may be selectively allocated for various storage functions. DRAM 346 stores both raw and compressed image data and is also used by CPU 344 while executing the software routines used within computer 118. The raw image data received from imaging device 114 is temporarily stored in several input buffers (not shown) within DRAM 346. Once the raw image data is processed, it is stored in a frame buffer (not shown) for display on the LCD screen 402. In a preferred embodiment, the input buffers and the frame buffer are split into two ping-pong buffers to improve the display speed of the digital camera and to prevent the tearing of the image in the display 402. After processed image data has been stored in DRAM 346, LCD controller 390 transfers the image data to LCD screen 402 for display.
The camera operates in at least two modes, capture mode for capturing images, and play mode for playing back the captured images on the LCD screen 402. To take a picture, the camera must be placed into capture mode. If the LCD screen 402 is activated, then the camera aids the user in preparing to capture an image by displaying a “live view” of the object viewed through the camera lens on the LCD screen 402 as a successive series of real-time frames. If the LCD screen 402 is not activated, then the user may capture an image using a conventional optical viewfinder (not shown).
The rate at which live view frames are processed and displayed on the LCD screen 402 depends on the hardware and software configuration of the camera, but is typically anywhere from 7 to 30 fps. In a preferred embodiment, the process responsible for generating this sequence of frames is a live view generation process, which is stored in non-volatile memory 350 and executed on CPU 344. However, the live view process can also be implemented using hardware.
During the execution of live view generation, frames of raw image data are sequentially captured by the imaging device 114 at a reduced resolution suitable for LCD screen 402, and the frames of raw image data are stored in the DRAM 346. The live view generation process then performs gamma correction and color conversion on the raw CCD data to convert the data into either a RGB or YCC color format which is compatible with the LCD screen 402. (RGB is an abbreviation for Red, Green, Blue, and YCC is an abbreviation for Luminance, Chrominance-red and Chrominance-blue). The raw image data is also processed for extracting exposure, focus, and white balance settings. After converting each frame of data to YCC (typically YCC 2:2:2 format), the YCC image data is transferred to the LCD screen 402 for display.
Although the resolution of the LCD screen 402 may vary, the LCD screen resolution is usually much less than the resolution of the image data that is produced by imaging device 114 when the user captures an image at full resolution. Typically, the resolution of LCD is the video resolution of a full resolution image. Since the LCD screen 402 is capable of only displaying images at ¼ resolution, the images generated during the live view process are also at ¼ resolution.
The live view frames generated during live view generation are displayed until the user decides to take a picture. When the user presses the shutter button to capture an image, the imaged data is captured at a resolution set by user, transformed into YCC 4:2:2 color space, compressed (e.g. JPEG), and stored as an image file. Live view then resumes to allow the capture of another image. The user may then continue to capture images or switch the camera 110 to play mode to playback and view the previously captured images on the LCD screen 402. In play mode, the user may also hear any recorded sound associated with a displayed image.
The present invention provides a method and system for capturing an image using an image capture device. The image is capable of including a plurality of objects. Each of the plurality of objects is a corresponding distance from the imaging device. The image is associated with a focus zone. The method and system comprise determining if the image matches at least one criterion and determining whether at least one of the plurality of objects is out of focus if the image matches the at least one criterion. The method and system further comprise shifting the focus zone so that the at least one object is out of focus if at least one of the plurality of subjects is not out of focus.
The present invention will be described in terms of a digital camera used to capture a portrait image. However, one of ordinary skill in the art will readily recognize that this method and system will operate effectively for other types of image capture devices. In addition, one of ordinary skill in the art will also recognize that the present invention will operate effectively for other types of images, particularly images having desirable characteristics which are similar to the desirable characteristics for portrait images.
To more particularly illustrate the method and system in accordance with the present invention, refer now to
It is first determined if the image 500 matches at least one criterion, via step 602. Preferably, the criteria include an object, such as the objects 502 and 504, being close to the camera 110. For example, in one embodiment, a object 502 or 504 is considered close to the camera 110 if it is within two to three feet of the camera 110. This close region is considered to be the foreground 554 of the image 500. Thus, the distance away from the camera 110 which is considered to be the foreground 554 may be set. The remaining portion of the image may be considered the background 556. In a preferred embodiment, the criteria also include ensuring that the close object is substantially centered within the image and occupies a particular portion of the image. Thus, a small object (not shown) or an object (not shown) existing primarily near the edge of the image 500 may not fit within the criteria. In one embodiment, the close objects 502 and 504 should include at least twenty percent of the area of the image 500 to match the criteria.
If the image 500 is determined to match the criteria in step 602, it is determined if certain objects are in focus, via step 604. In a preferred embodiment, it is determined if objects 506 and 508 in the background 556 are in focus. If the objects 506 and 508 are in focus, then the focus zone 552 is shifted to ensure that the objects 506 and 508 are not in focus, via step 606. Preferably, the focus zone 552 is shifted by moving the camera lens (not shown) with respect to the remainder of the camera 110. This shortens the focus distance 550. In a preferred embodiment, step 606 is only performed only if the focus zone 552 can be shifted sufficiently to ensure that the objects 506 and 508 in the background are not in focus. In a preferred embodiment, the amount the zone 552 is shifted is greater than an amount required to make the nearest object 506 in the background 556 to be just outside the focus zone 552. This is because the amount of soft focus, or fuzziness of the objects 506 and 508 increases with increasing distance from the focus zone 552. The exact amount that the focus zone 552 is shifted, therefore, depends upon the criteria set for the desired amount of soft focus. The desired amount of soft focus may depend upon the manufacturer of the camera 110 or the user of the camera 110. Once the method 600 is completed, the image 500 is captured.
The focus points of objects within the image 500 are determined, via step 612. The focus points are the distances at which each object 502, 504, 506, and 508 are best focused. In a preferred embodiment, this step is performed by focusing on objects starting at an infinite distance from the camera 110, and moving to objects close to the camera 110. Thus, in a preferred embodiment, the objects 508 will be focused first, then the objects 506, then object 502, and then object 504. The initial aperture size, shutter speed, and focus distance 550 are then determined, via step 614. Setting the aperture size determines the focus zone 552. Based on the focus points determined in step 612 and the criteria set for the foreground and background, each object 502, 504, 506, and 508 is categorized as being in the foreground 554 or background 556, via step 616. As discussed above, the foreground 554 may be defined as a particular distance from the camera 110, such as three feet. It is then determined if the objects 502 and 504 in the foreground match the criteria set, via step 618. In a preferred embodiment, step 618 is performed by breaking the image 500 into zones. Data in the zones is then analyzed to determine which object 502, 504, 506, and 508 the data corresponds with, the total area of the image 500 occupied by each object 502, 504, 506, and 508, and the region of the image 500 in which each object 502, 504, 506, and 508 resides. Thus, it can be determined whether the object 502, 504, 506, and 508 is near the center or the edge of the image 500.
If the objects 502 and 504 in the image 500 do not match the criteria, then the image may be captured with the current settings, via step 626. If the objects 502 and 504 match the critera, then it is then determined whether the objects 506 and 508 in the background 556 are too close, or are in focus, via step 620. In one embodiment, step 620 includes determining whether the objects 506 and 508 are within the focus zone 552 given the focus distance 550 that has been set. However, in a preferred embodiment, step 620 includes determining whether the objects 506 and 508 are within a particular distance from the focus zone 552. Thus, if the objects 506 and 508 are outside of the focus zone 552, but do not have a soft enough focus, the focus zone 552 may still be shifted.
If it is determined in step 620 that the objects 506 and 508 are not in focus, then via step 624 the focus zone 552 may be shifted only if the image 500 is very bright. Step 624 may be performed because when the image 500 is very bright, objects 506 and 508, which are well outside of the focus zone 552 and would have a sufficiently soft focus if less light were available, are actually in focus. However, step 624 is optional. If it is determined in step 620 that the objects 506 and 508 are in focus, then the focus zone is shifted, via step 622. In a preferred embodiment, step 622 is performed by calculating the amount the focus distance 550 should be offset, and shifting the focus zone 552 that amount. Then, via step 626 the image 500 may be captured.
For clarity,
The data for the zones 670 through 693 is then analyzed to determine if the image 500 matches a set of criteria, via step 706. In a preferred embodiment, the analysis in step 706 includes categorizing objects 502, 504, 506, and 508 as being in the foreground 556 or the background 558. Also in a preferred embodiment, the foreground is defined a set distance from the camera. In the preferred embodiment, there are several criteria. The first criterion is that the image 500 include at least one object, such as objects 502 and 504, which is close to the camera 110. Preferably, close is defined as a particular distance from the camera 110, such as three feet. A second criterion is that at least one object within the background 558 be near the object or objects 502 and 504 in the foreground 554. In a preferred embodiment, this second criterion is that the focus point of at least one object within the background 556 be within a certain distance from the focus point of an object 502 or 504 in the foreground 554. A third criterion is that the close object or objects occupy a large amount of the image. In one embodiment, the objects 502 and 504 should occupy at least twenty percent of the image 500. A fourth criterion is that the close objects or objects be relatively centered in the image 500.
It is then determined if a match was found in step 706, via step 708. If it is determined that a match for the criteria was not found in step 706, then via step 710 the aperture is set normally. The remaining settings, such as the exposure time and shutter speed are then set via step 730, and the image captured when the user directs the image to be captured, via step 732.
If it is determined in step 708 that a match was found, then in step 712 the focus zone and the level of soft focus desired for objects 506 and 508 in the background 556 are determined for the initial settings. The initial settings include the aperture size and shutter speed settings. It is then determined if the current focus for the objects 506 and 508 in the background 556 are sufficient, via step 714. In one embodiment, step 714 includes determining if the focus points for objects 506 and 508 in the background are greater than a particular distance of the focus zone 552.
If it is determined in step 714 that the soft focus of objects 506 and 508 in the background is sufficient, then the aperture is set normally, via step 710. Steps 730 and 732 will then follow, allowing a user to capture an image. If it is determined in step 714 that the soft focus is not sufficient, then via step 716 the amount the focus distance 550 should be offset is calculated. The offset preferably shortens the focus distance 550 sufficiently to allow the objects 506 and 508 in the background 556 to be at least a particular distance from the focus zone 552.
It is then determined if the focus distance 550 can be offset the calculated amount, via step 718. If it is determined that the focus distance 550 can be offset the calculated amount then the focus distance 550 is offset that amount, via step 720. The aperture is then set without substantially changing the focus distance 550, via step 722. The remaining settings are then set, via step 730, and the image captured in step 732.
If it is determined that the focus distance 550 cannot be offset the calculated amount, then via step 724 the aperture size required to sufficiently shorten the focus zone 552 with the current focus distance is determined. In one embodiment, the required aperture size is one which will set the focus zone 552 a particular distance from the focus points of the objects 506 and 508 in the background 556. It is then determined if the aperture can be set to the required size, via step 726. If the aperture can be set to the required size, then the aperture and initial focus distance are set, via step 728. The remaining settings are then set and the image 500 captured in steps 730 and 732, respectively. Note that in step 720 the shutter speed may be set based upon the aperture size that has been set. Consequently, changing the aperture size from the initial settings should not substantially degrade image quality. If, however, it is determined that the correct aperture cannot be set, then the normal aperture setting is used, via step 710. The remaining settings are then set and the image 500 captures in steps 730 and 732, respectively. Although not shown, the method 700 could loop back through steps 712 through 728 to determine the optimal combination of focus distance 550 and focus zone 552 to provide the closest focusing of objects 502 and 504 in the background to the soft focusing that is desired.
A method and system has been disclosed for improving the quality of portrait images by shifting the focus zone. Although the present invention has been described in accordance with the embodiments shown, one of ordinary skill in the art will readily recognize that there could be variations to the embodiments and those variations would be within the spirit and scope of the present invention. Accordingly, many modifications may be made by one of ordinary skill in the art without departing from the spirit and scope of the appended claim
| Patent | Priority | Assignee | Title |
| 10477005, | Aug 25 2014 | Apple Inc. | Portable electronic devices with integrated image/video compositing |
| 10769053, | Mar 30 2018 | HCL Technologies Limited | Method and system for performing user interface verification of a device under test |
| 7456897, | Dec 15 2003 | Canon Kabushiki Kaisha | Image-taking apparatus for setting maximum exposure time and control method therefor |
| 7570281, | Nov 16 1999 | FUJIFILM Corporation | Image processing apparatus and method for detecting a main subject to be photographed |
| 7999874, | Jan 22 2008 | Canon Kabushiki Kaisha | Image-pickup apparatus and focus controlling method |
| 8102457, | Jul 09 1997 | FlashPoint Technology, Inc. | Method and apparatus for correcting aspect ratio in a camera graphical user interface |
| 8111875, | Feb 20 2007 | FUJIFILM Corporation | Method of and apparatus for taking solid image and computer program for causing computer to execute the method |
| 8127232, | Dec 31 1998 | FlashPoint Technology, Inc. | Method and apparatus for editing heterogeneous media objects in a digital imaging device |
| 8184192, | Mar 28 2008 | Canon Kabushiki Kaisha | Imaging apparatus that performs an object region detection processing and method for controlling the imaging apparatus |
| 8233054, | Sep 25 2006 | Pioneer Corporation | Scenery imaging apparatus, scenery imaging method, scenery imaging program, and computer-readable recording medium |
| 8675098, | Mar 25 2009 | Sony Corporation | Image processing device, image processing method, and program |
| 8908080, | Dec 29 2004 | Nokia Technologies Oy | Electronic device and method in an electronic device for processing image data |
| 8934043, | Jul 17 2001 | Monument Peak Ventures, LLC | Revised recapture camera and method |
| 8970761, | Jul 09 1997 | FlashPoint Technology, Inc. | Method and apparatus for correcting aspect ratio in a camera graphical user interface |
| 8972867, | Dec 31 1998 | FlashPoint Technology, Inc. | Method and apparatus for editing heterogeneous media objects in a digital imaging device |
| 9100569, | Oct 29 2013 | NATIONAL CHUNG CHENG UNIVERSITY | Method for adaptive focusing |
| 9131149, | Mar 25 2009 | Sony Corporation | Information processing device, information processing method, and program |
| 9224145, | Aug 30 2006 | QURIO Holdings, Inc.; Qurio Holdings, Inc | Venue based digital rights using capture device with digital watermarking capability |
| 9350924, | Aug 25 2014 | Apple Inc | Portable electronic devices with integrated image/video compositing |
| 9552627, | Dec 29 2004 | Nokia Technologies Oy | Electronic device and method in an electronic device for processing image data |
| 9858651, | Dec 29 2004 | Nokia Technologies Oy | Electronic device and method in an electronic device for processing image data |
| 9942375, | Aug 25 2014 | Apple Inc | Portable electronic devices with integrated image/video compositing |
| Patent | Priority | Assignee | Title |
| 4825235, | May 09 1986 | NIKON CORPORATION, A CORP OF JAPAN | Camera having soft focus filter |
| 4826301, | Nov 11 1985 | Canon Kabushiki Kaisha | Photographic system having soft focus function |
| 5825016, | Mar 07 1995 | Minolta Co., Ltd. | Focus detection device and accompanying optical equipment |
| 6067114, | Mar 05 1996 | Intellectual Ventures Fund 83 LLC | Detecting compositional change in image |
| Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
| Oct 21 1998 | ANDERSON, ERIC C | FLASHPOINT TECHNOLOGY, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 009559 | /0137 | |
| Oct 22 1998 | FlashPoint Technology, Inc. | (assignment on the face of the patent) | / |
| Date | Maintenance Fee Events |
| Mar 03 2010 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
| Mar 03 2014 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
| Apr 23 2018 | REM: Maintenance Fee Reminder Mailed. |
| Oct 15 2018 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
| Date | Maintenance Schedule |
| Sep 12 2009 | 4 years fee payment window open |
| Mar 12 2010 | 6 months grace period start (w surcharge) |
| Sep 12 2010 | patent expiry (for year 4) |
| Sep 12 2012 | 2 years to revive unintentionally abandoned end. (for year 4) |
| Sep 12 2013 | 8 years fee payment window open |
| Mar 12 2014 | 6 months grace period start (w surcharge) |
| Sep 12 2014 | patent expiry (for year 8) |
| Sep 12 2016 | 2 years to revive unintentionally abandoned end. (for year 8) |
| Sep 12 2017 | 12 years fee payment window open |
| Mar 12 2018 | 6 months grace period start (w surcharge) |
| Sep 12 2018 | patent expiry (for year 12) |
| Sep 12 2020 | 2 years to revive unintentionally abandoned end. (for year 12) |