The present invention provides an image searching device that searches a print target image adapted for a printable area only by setting a template for the printable area and a search condition necessary to search the print target image. The image searching device inputs shape information on the printable area. Then, the image searching device sets the image search condition. Then, the image searching device searches the print target image from a plurality of images on the basis of the shape information on the printable area, and the image search condition. According to the image searching device, upon printing of an image in a specially-shaped printable area, a print target image adapted for the printable area can be automatically searched only by setting a shape of the printable area, and an image search condition, resulting in improvement of searching efficiency.
|
2. A method for searching an image, comprising the steps of:
setting a search condition for searching an image;
setting a direction of a person's face as a search condition; and
searching a plurality of images for an image including a person facing the direction set as a search condition,
wherein said step of setting a search condition includes selecting landscape as an image scene.
1. An image searching device comprising:
a user interface unit for setting a search condition to search for an image;
a direction setting unit for causing said user interface to set a direction of a person's face as a search condition; and
a search unit for searching a plurality of images for an image including a person facing the direction set as a search condition by said user interface unit,
wherein said user interface unit comprises a selection unit for selecting landscape as an image scene.
|
This application is a divisional of application Ser. No. 12/115,871 filed May 6, 2008. It claims benefit of that application under 35 U.S.C. §120, and claims benefit under 35 U.S.C. §119 of Japanese Patent Application No. 2007-123667, filed May 8, 2007. The entire contents of each of the mentioned prior applications are incorporated herein by reference.
1. Field of the Invention
The present invention relates to a technique for searching a print target image to be printed on a label surface of an optical disk or in a specially-shaped printable area on nonstandard-sized paper.
2. Description of the Related Art
In recent years, a printer for personal use has been widely spread. A general user performs printing not only on standard-sized paper such as L size or A4 size paper of which a printable area has a rectangular shape, but also often on paper having a specially-shaped printable area. The paper having such specially-shaped printable area includes a label surface of an optical disk such as CD-R, special sticker paper to be stuck on an object surface, or nonstandard-sized postcard. There is also performed a printing procedure in which a vast number of digital images taken with a digital camera or digital video camera are stored in a personal computer, and some of the images are searched from these stored images for printing. For this purpose, there have been proposed a method for searching a print target image to be printed in the specially-shaped printable area, and a method for applying predetermined processing to a searched print target image to print it. For example, Japanese Patent Laid-Open No. 2003-018388 discloses a method comprising: inputting information in a field of a configuration template for an image layout format; searching an image to be laid out for each field; and automatically laying out the searched image. Also, Japanese Patent Laid-Open No. 2006-167965 discloses a method comprising: automatically enlarging an image such that a part of the image is printed on an entire label surface of an optical disk upon printing of it on the label surface of the optical disk.
Upon searching the print target image from the vast number of images, searching efficiency can be improved if the following steps can be automatically performed, i.e., the steps of first removing images inappropriate to printing in a specially-shaped printable area, and then searching the print target image from images appropriate to printing in the specially-shaped printable area. However, in Japanese Patent Laid-Open No. 2003-018338, a user needs to specify the layout for the image on the basis of the printable area by him/herself. As a result, if there are a plurality of layouts for the image adapted for the printable area, the user also needs to specify a plurality of search conditions, and therefore such setting operation by the user becomes complicated. Also, the user makes the setting by him/herself, so that it may be difficult to specify the layouts for all images adapted for the printable area. In Japanese Patent Laid-Open No. 2006-167965, if a print target image is edited (enlarged or reduced) on the basis of a user's preference, the image may protrude out of a printable area as a result of the enlargement even if the image prior to the edition fits into the printable area. As described, such conventional techniques have a problem that the print target image adapted for the specially-shaped printable area cannot be simply searched from the vast number of images.
It is therefore an object of the present invention to provide, in consideration of such problem, an image searching device that searches a print target image adapted for a printable area only by setting a template for the printable area and a search condition necessary to search the print target image.
An image searching device of the present invention provides a component for inputting shape information on a printable area, a component for setting an image search condition, and a component for searching a print target image from a plurality of images on the basis of the shape information on the printable area, and the image search condition.
In the image searching device of the present invention, the component for searching a print target image is configured to detect a main subject included in the image, and output as the print target image an image that includes the main subject fitting into the printable area and covers a whole of the printable area.
An image searching method of the present invention includes the steps of inputting shape information on a printable area, setting an image search condition, and searching a print target image from a plurality of images on the basis of the shape information on the printable area, and the image search condition.
In the image searching method of the present invention, the step of searching a print target image detects a main subject included in the image, and outputs as the print target image an image that includes the main subject fitting into the printable area and covers a whole of the printable area.
A computer-readable recording medium of the present invention instructs a computer to perform the steps of inputting shape information on a printable area, setting an image search condition, and searching a print target image from a plurality of images on the basis of the shape information on the printable area, and the image search condition.
According to the present invention, upon printing of an image in a specially-shaped printable area, a print target image adapted for the printable area can be automatically searched only by setting a shape of the printable area, and an image search condition, resulting in improvement of searching efficiency.
Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings).
Preferred embodiments of the present invention will hereinafter be described in detail with reference to the drawings.
In the following embodiments, functions of an image searching device may be incorporated in an information device such as a personal computer, or a printer. The image searching device has a storage device. Preferably, an image management application software installed on a personal computer provides an image search function, and a hard disk for a personal computer is a storage device for storing a search target image. Furthermore, it may be configured such that a printer in which an image management application is installed searches an image stored in a printer's memory in accordance with instructions via a user-interface of the printer.
In Step S101, the image searching device reads out shape information on the heart-shaped printable area from the storage device. The shape information is preliminarily stored in the storage device as a template. In Embodiment 1, the shape information substantially consists of coordinate information. That is, the image searching device reads out the coordinate information on the heart-shaped printable area from the storage device. The coordinate information t[x, y] on the template is preliminarily stored in the storage device. On the other hand, coordinate information on a template not stored in the storage device can be additionally set by scanning as a printable area with a scanner connected to a personal computer, or can be set with shape information on the printable area inputted into the personal computer by a user.
It is assumed that coordinate information on a template is represented by bit map and
if t[x,y]=1, Expression (1.1)
Information to be compared with an after-mentioned search condition by using an image analysis function of a camera for shooting when taking picture is automatically added to a search target image. Obviously, upon a user manually enters information to be compared with the after-mentioned search condition in the image searching device, the information may be added to the search target image.
In Step S102, the user sets a search condition for searching a print target image via an after-mentioned image search condition setting screen. The search condition includes a keyword, person's facial feature, image feature appearing in a photograph of a night view or snapshot, type of paper to be printed thereon, shooting date and time, and the like. The search condition may be any combination of such condition elements.
In Step S103, the image searching device starts searching the print target image meeting the search condition having been set, and if the print target image meeting the search condition is available, the flow proceeds to Step S104, whereas if the print target image meeting the search condition is unavailable, the flow proceeds to Step S106. In Step S106, the image searching device sorts an image not meeting the search condition into a group of images not to be printed.
In Step S104, the image searching device detects a main subject within the print target image meeting the search condition having been set; determines whether or not it fits into the printable area; and if it fits into the printable area, the flow proceeds to Step S105, whereas if it does not fit into the printable area, the flow proceeds to Step S106. In Embodiment 1, the main subject is supposed to be people's faces. To detect the people's faces in the image, a publicly-known face region detecting algorithm can be used. The face recognition algorithm is used to detect a face region in the image, and then if all coordinates (x[i], y[i]) in the detected face region meet Expression (1.1), i.e.,
t(x[i],y[i])=1, Expression (1.3)
In Step S105, the image searching device sorts the image including the face region fitting into the printable area into a group of images to be printed. The sorted print target image is outputted as a result of the search.
On the other hand, if any of the coordinates (x[i], y[i]) within the people face region meets Expression (1.2), i.e.,
t(x[i],y[i])=0, Expression (1.4)
In Step S601, the image searching device obtains the outer frame R1 from the outside diameter 2*r1 with the use of Expression (2.1):
R1=πr12 Expression (2.1)
Subsequently, the image searching device once stores coordinate information R1 [x, y] on the outer frame R1 in the storage device. The coordinate information on the outer frame R1 may be preliminarily stored in the storage device.
In Step S602, the user sets a search condition for searching an image via the after-mentioned image search condition setting screen. The search condition is as described above.
In Step S603, the image searching device starts searching the print target image meeting the search condition having been set, and if the print target image meeting the search condition is available, the flow proceeds to Step S604, whereas if the print target image meeting the search condition is unavailable, the flow proceeds to Step S608. In Step S608, the image searching device sorts a print target image not meeting the search condition into the group of images not to be printed.
In Step S604, the image searching device reads out the coordinate information on the outer frame R1 from the storage device; determines whether or not a main subject within the image meeting the search condition fits into the outer frame R1; and if it fits into the outer frame R1, the flow proceeds to Step S605, whereas if it does not fit into the outer frame R1, the flow proceeds to Step S608. In Embodiment 2, the main subject is supposed to be a person's face. The face detecting algorithm is used to detect a face region within the image, and then if all coordinates (x[i], y[i]) in the detected face region meet Expression (2.2), i.e.,
R1(x[i],y[i])=1, Expression (2.2)
On the other hand, if any of the coordinates (x[i], y[i]) within the person face region meets Expression (2.3), i.e.,
R1(x[i],y[i])=0, Expression (2.3)
the face region protrudes outside the outer frame R1. In this case, the image searching device sorts the searched image into the group of images not to be printed. Also, if the outer frame R1 is displaced to allocate the face region so as to fit into the outer frame R1, blank spaces may appear in the outer frame R1 as illustrated in
In Step S605, the image searching device obtains the unprintable area R2 around the center of the optical disk from the inside diameter 2*r2 with the use of Expression (2.4).
R2=πr22 Expression (2.4)
Subsequently, the image searching device once stores coordinate information R2[x, y] on the unprintable area R2 in the storage device. The coordinate information on the unprintable area R2 may be preliminarily stored in the storage device.
In Step S606, the image searching device reads out the coordinate information on the unprintable area R2 from the storage device, and determines whether or not the face region overlaps with the unprintable area R2. If the face region does not overlap with the unprintable area R2 as illustrated in
R2(x[i],y[i])=0 Expression (2.5)
On the other hand, if the face region overlaps with the unprintable area R2 as illustrated in
R2(x[i],y[i])=1, Expression (2.6)
In Step S607, the image searching device sorts the searched print target image into the group of images to be printed.
In Step S608, the image searching device sorts the searched print target image into the group of images not to be printed.
According to Embodiment 2, the print target image printable on the label surface of the optical disk can be obtained by searching the print target image including the face region that fits into the outer frame R1 and does not overlap with the unprintable area R2.
Also, Embodiment 2 describes an example where the print target image including the face region completely fitting into the printable area is searched by comparing the pieces of coordinate information on the outer frame R1 and unprintable area R2 with the coordinate information on the face region. As another example, the print target image including the face region completely fitting into the printable area may be searched by using the optical disk being of a circular shape to compare shape information on the printable area obtained from the central coordinate, radius, angle, and the like with a position and size of the face region. Also, a size of the optical disk is generally standardized, so that it is possible to preliminarily store the information on the printable area.
Further, printing may be performed with an imaging device such as a digital camera, or digital video camera and a printing device such as an inkjet printer being directly connected to each other without through a personal computer. In such a case, if these devices store the shape information on the printable area to search the print target image, the user can simply perform direct printing on the label surface of the optical disk while checking a print result on a preview screen or the like provided by these devices.
Next, an example is described, where a print target image to be further printed on the label surface of the optical disk having been already printed with characters is searched.
In Step S1501, the image searching device reads out shape information on the printable area from the storage device. The shape information is preliminarily stored in the storage device as a template. In Embodiment 4, the shape information substantially consists of coordinate information. The template is represented by coordination information t[x, y].
In Step S1502, a search condition for searching the image is set via the after-mentioned image search condition setting screen. The search condition is as described above.
In Step S1503, the image searching device starts searching the image meeting the search condition having been set, and if the image meeting the search condition is available, the flow proceeds to Step S1504, whereas if the image meeting the search condition is unavailable, the flow proceeds to Step S1510. In Step S1510, the image searching device sorts an image not meeting the search condition into the group of images not to be printed.
In Step S1504, the image searching device sets an enlargement ratio or reduction ratio for the searched image.
In Step S1505, the image searching device enlarges or reduces the image at the set enlargement or reduction ratio.
In Step S1506, the image searching device determines whether or not a main subject within the enlarged or reduced image fits into the printable area. In Embodiment 4, the main subject is supposed to be a person. If the main subject fits into the printable area, the flow proceeds to Step S1507, whereas if it does not fit into the printable area, the flow proceeds to Step S1510. Note that it may be configured such that if the main subject does not fit into the printable area in Step S1506, the flow returns to Step S1504 where the main subject is fitted into the printable area by changing the enlargement or reduction ratio or moving the main subject.
In Step S1507, the image searching device calculates coordinates in the entire image for a case where the main subject is allocated in a preferred location within the printable area.
In Step S1508, the image searching device further determines whether or not the enlarged or reduced image covers the entire printable area. That is, in Step S1508, it is determined whether or not there is any blank space in the printable area, and if there is no blank space in the printable area, the flow proceeds to Step S1509, whereas if there is some blank space in the printable area, the flow proceeds to Step S1510. Note that it may be configured such that if it is determined in Step S1508 that there is some blank space in the printable area, the flow returns to Step S1504 where the image is made to cover the entire printable area by changing the enlargement or reduction ratio.
In Step S1509, the image searching device sorts the image into the group of images to be printed.
In Step S1510, the image searching device sorts the image into the group of images not to be printed.
In the above Embodiments 1 to 4, if the main subject is a person, a direction of a face of the person can be determined with a publicly-known image analysis technique. Accordingly, as the search condition, a direction of a person's face may be set. Also, a size of the main subject occupying the printable area may be adapted to be set. Further, a still image clipped out of a moving image may be an object to be searched. In this case, the still image may be one obtained by clipping the moving image at certain time intervals.
Next, a user interface for setting a search condition for searching an image in Embodiments 1 to 4 is described.
Reference numeral 1401 represents an image search condition setting dialog. The dialog includes setting areas represented by Reference numerals 1402 to 1418.
Reference numeral 1402 represents the area for setting a paper type. Different paper types are displayed on a popup menu, and the user selects an intended paper type from the types displayed on the menu. Detailed information on a shape of paper and that on a shape (inside diameter, outside diameter, etc.) of a printable disk (optical disk of which a label surface can be printed thereon with an image) are set via advanced settings 1403.
Reference numeral 1404 represents the area for setting a specified main subject. In this example, as the main subject, a person is preliminarily set. If “Search person” is turned ON in “1404”, the following areas 1405 to 1410 can be set.
Reference numeral 1405 represents the area for specifying a location within a printable area where the person is allocated. In this example, “Entire area” is selected. If “Entire area” is selected, the person may be allocated in any location within the printable area. Besides, the allocation in any of four regions into which the printable area is divided may be specified. Detailed information on the allocation is set via “1406”.
Reference numeral 1407 represents the area for setting a size of the person to be allocated in the printable area. In this example, “Equal to or more than one quarter of area” is selected. Also, numeral information on the size of the person may be set via advanced settings represented by Reference numeral 1408.
Reference numeral 1409 represents the area for setting a direction the person faces in. In this example, “Frontward” is selected. In this case, an image displaying the person facing frontward is searched. As the direction the person faces in, “Rightward”, or “Leftward” may be specified in addition to “Frontward”. In addition, if directions in which a plurality of persons' faces are specified, the directions can be specified via advanced settings represented by “1410”.
Reference numeral 1411 represents the area for searching an image scene. In this example, “Landscape” is selected. In this case, a landscape image not including a person is searched.
Reference numeral 1412 represents the area for searching a second object. The second object refers to a subject other than a person. By turning “Second object” ON in “1412” and further via advanced settings 1413, color, shape, and the like of the second object are set.
Reference numeral 1414 represents the area for setting keyword search. This area is used when an image is searched with keywords. The keywords include shooting date and time, image analysis information, image tag information, and the like. In this example, the shooting date and time are specified as the search condition. Specific date and time can be specified via advanced settings 1415.
Reference numeral 1416 represents a search start button. By clicking this button after making the above various settings, the image search is started. Reference numeral 1417 represents a cancel button. By clicking this button, all of the above various settings are canceled. Reference numeral 1418 represents a help button.
By performing the above-described image searching procedure after setting the predetermined pieces of information in the image search condition setting dialog, an image adapted for a specially-shaped printable area can be easily searched. Also, the image search condition setting dialog has a screen configuration by which all of the search condition elements for an image can be viewed, so that the user can predict to some extent what kind of image is to be actually searched, resulting in improvement of searching efficiency.
The present invention can also be provided in such a way that a recording medium recorded thereon with a program code of software realizing functions of the above-described embodiments is loaded in a system or device, and a computer such as the system reads the program code from the recording medium to execute it. The recording medium is a computer-readable recording medium. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiments, and therefore the recording medium recorded thereon with the program code constitutes the present invention. Alternatively, it may be adapted such that an operating system (OS) or the like running on the computer performs part or all of actual processing under the instruction of the program code, and the processing realizes the functions of the above-described embodiments. Still alternatively, the above-described embodiments may be provided in such a way that the program code read out of the recording medium is recorded in an expansion card or expansion unit of the computer, and then the expansion card or the like performs part or all of the processing under the instruction of the program code.
If the present invention is applied to the above recording medium, the recording medium is stored thereon with program codes corresponding to the flowcharts described above.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Patent | Priority | Assignee | Title |
9524447, | Mar 05 2014 | Searching 2D image based on transformed 1D data matching |
Patent | Priority | Assignee | Title |
5771307, | Dec 15 1992 | THE NIELSEN COMPANY US , LLC, A DELAWARE LIMITED LIABILITY COMPANY | Audience measurement system and method |
7315635, | Jun 06 2002 | FUJIFILM Corporation | Anatomical characteristic position detecting system, and object structure measurement system |
7469378, | Sep 16 2003 | Seiko Epson Corporation | Layout system, layout program, and layout method |
7796838, | Jun 21 2005 | Sony Corporation | Imaging apparatus, processing method of the apparatus making computer execute the methods of selecting face search directions specific to a display mode and capture mode of operation |
7860162, | Sep 29 2005 | Panasonic Corporation | Object tracking method and object tracking apparatus |
20040004633, | |||
20040078759, | |||
20050257170, | |||
20060285750, | |||
20070014439, | |||
20070047775, | |||
20070052726, | |||
20070058869, | |||
20070070201, | |||
20070121141, | |||
20070195344, | |||
20070216773, | |||
20080002766, | |||
20080031490, | |||
20080037837, | |||
20080123150, | |||
20080123153, | |||
JP2003018388, | |||
JP2006167965, | |||
JP2007065940, | |||
JP2009026146, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 20 2012 | Canon Kabushiki Kaisha | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Mar 12 2015 | ASPN: Payor Number Assigned. |
May 04 2017 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Jul 12 2021 | REM: Maintenance Fee Reminder Mailed. |
Dec 27 2021 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Nov 19 2016 | 4 years fee payment window open |
May 19 2017 | 6 months grace period start (w surcharge) |
Nov 19 2017 | patent expiry (for year 4) |
Nov 19 2019 | 2 years to revive unintentionally abandoned end. (for year 4) |
Nov 19 2020 | 8 years fee payment window open |
May 19 2021 | 6 months grace period start (w surcharge) |
Nov 19 2021 | patent expiry (for year 8) |
Nov 19 2023 | 2 years to revive unintentionally abandoned end. (for year 8) |
Nov 19 2024 | 12 years fee payment window open |
May 19 2025 | 6 months grace period start (w surcharge) |
Nov 19 2025 | patent expiry (for year 12) |
Nov 19 2027 | 2 years to revive unintentionally abandoned end. (for year 12) |