System for automatic image association

Abstract

Methods and systems for improving a photography business are disclosed, comprising, in an embodiment, taking a photograph of a coded component together with a series of photographs for the client. The coded component comprises human-readable information and is provided to the client for access to the photographs. The coded component also comprises machine-readable information, enabling a server to sort the photographs to the corresponding jobs without operator intervention. The coded component can also comprise a fillable option field to identify that the photographs associated with the coded component are to be specially treated according to a desired selection.

Description

The present invention relates to photography or photographic services, and particularly to improved automation of image storage for a photography business. The present application claims priority from the provisional patent application Ser. No. 61/154,436, filed on Feb. 23, 2009, entitled “System for automatic image association”, hereby incorporated by reference.

BACKGROUND OF THE INVENTION

Image management has long been an issue for professional photographers and other providers of photographic services. Digital image capture has compounded the problem due to the increasing quantity of captured and stored images. Clients demand secure and private access to their images particularly when there is computer or on-line access available. Faced with hectic schedules, multiple cameras, and large numbers of images, photographers have sought solutions to the image management issue.

Many photographers have solved this problem manually by taking note of a picture counter for each job or by using separate memory storage, film or folders for each job. Each of these solutions implies a manual process requirement and does not support automation.

SUMMARY

The present invention includes methods and systems for improving the photography business, managing the business aspect to allow the photographer to concentrate on the photographs. Further, the present invention can provide processes to automate the photography business, reducing the time involved in the business service aspect of the business and providing enhanced privacy for clients by preventing unauthorized access to stored photographs. This automated image association may be used by one or multiple photographers and may be implemented on one or more cameras at an event. Multiple methods of implementation are described including an automated method for capturing and labeling a series of photographs as well as other methods for categorizing images. This invention may have other photographic or image storage applications.

In an embodiment, the present process comprises taking a photograph of a coded component together with a series of photographs for each client. The coded component or the information relating to the coded component can be transferred to the client for access to the photographs while the photograph containing the coded component serves as a delimiter for separating photographs of different jobs. The process can follow any order, for example, taking the photographs relating to the job may be performed before or after capturing the photograph of the coded component, or capturing the photograph of the coded component may be performed before or after the client receives the coded component.

In an embodiment, the present invention discloses a process and a data processing system, e.g., a server, to automate the photography business using a coded component. For example, the coded component can comprise an image that is machine readable and recognizable, which enables the server to identify the photographs containing the coded components among the plurality of photographs. The coded components can serve to identify different jobs or different clients, and the remaining photographs are automatically sorted to the corresponding jobs by their association with the coded components. Additionally, the coded component can comprise an option field identifying a desired treatment of the photographs. Upon decoding the information from the option field, the server can automatically treat the photographs associated with this coded component according to the desired instructions. The process can be automated with minimum operator interaction, including client review and selection of photographs, together with billing and payment. Further, a coded component may represent the purchase item option such as instructions for treatment of photographs. Multiple coded components may be presented in a single job identification.

In an embodiment, the coded component also comprises human readable information such as a job name and a password to allow the client to access the photographs. Upon identifying the coded components, sorting and performing optional treatment on the selected photographs, the server can automatically create different accounts with different access levels to distributedly store the photographs associated with the coded components. Using the coded component, which was, for example, handed by the photographer at the photo shoot session, a client can then log in an a card embedded with this identification string. Alternatively, blocks 402 and 404 can be combined, for example, by a photographer who prints a business card with a program employing an algorithm to generate unique identification string for each card. Also, the photographer could simply receive one or more cards with embedded identification strings, for example, from an employer or from a department handling coded component cards. The photographer may also receive an electronic version of the coded component for display on alternate media, such as a PDA, mobile phone, computer or other devices. In block 406, the photographer selects a coded component, and proceeds with the jobs, for example, with the sequence of blocks 410 forward, as described above.

In an embodiment, the coded component comprises a unique graphic image that is machine readable and recognizable. The machine readable and recognizable graphic image can allow the machine to recognize the delimiter and thus can act as an identifier for a client, a subject or for other labeling or sorting purposes to group the pictures accordingly. The graphic image can be a one or two dimensional image such as a bar code or a bitmap pixel code (e.g., data matrix barcode). The graphic image may be a string of numbers or characters. The graphic image may also be a color code or arrangement of colors. This unique coded component may be printed (or imaged) onto a code card or on other substrates such as paper, plastic, proof sheets, or may be displayed on electronic screen such as a PDA, mobile phone, camera, or computer. In the case of the printed version, this coded component may exist as part of a unique business card used for marking the photographic job. The unique business card can then be used for the association and retrieval of images. FIGS. 5A-5C show examples of the coded component included on a card, showing the coded components 510A, 510B and 510C, respectively. This coded card or image display thus allows the photographer to delineate a stream of photographs and may serve other purposes to aid the photographer in tracking photographs or images.

The coded components are preferably machine generated and not repeated to avoid mixing the jobs. The code can be generated sequentially or randomly, and can be pre-prepared on the cards that the photographer carries or may be stored in electronic format to be displayed on other media such as a screen. The coded component may also be encrypted, such as with a signature, so that the origin of the generation of a coded component may be verified. Prior to a session, a user may generate a printed version of the coded component or a visual display on other media such as a PDA, for capture by the camera during a photography session.

The coded component may comprise other information in standard characters which are human readable. This coded card also allows the client to have access to both the code and any other instructions associated with the use of the card or the identification of photographs. In an aspect, the coded component card may include other instructions used for the retrieval of images. This may include a password link to the coded component, the name of the photography company, an image of the photography company logo, the name and contact information of the photographer and instructions for accessing and downloading images from the storage system.

In an aspect, the photographer may generate and carry a plurality of identical coded components, preferably separated by color coding to prevent mixing. For example, a first job is for a number of yellow coded cards containing the first coded component and a second job is for a number of blue coded cards containing a second coded component. One of the duplicated cards can be provided to the client, and other duplicated cards can be used for end tag, or for beginning tag for a new memory card.

An embodiment of the present invention allows the coded card to be defined. The coded card may include a graphical one or two dimensional code as well as other information in standard characters which are human readable. This coded card allows the client to have access to both the code and any other instructions associated with the use of the card or the identification of photographs. This coded card also allows the photographer to delineate a stream of photographs and may serve other purposes to aid the photographer in tracking photographs or images. The coded card can provide an optional field for special instructions.

In an aspect, the code portion of the card may include machine readable image such as 1D barcode (line code), 2D barcode (dot matrix code or data matrix barcode), standard alpha numeric characters to be read by an optical character reader (OCR), or any graphical image that can be processed by a machine. The card may include human readable image standard alpha numeric characters, or any graphical image that can be read by people. In an aspect, the coded card may be downloaded from a website and printed on a printer. Multiple coded cards may be generated. The information contained on the code card may further include the identification of the photographer or company taking the photographs, instructions for viewing, downloading, sorting or ordering the photographs after the event, and identifying names. The code card may also include the password link to the photographs.

In the case of a single photographer working for himself, the photographer may select the coded component from a software system that will generate coded components. The photographer may develop an association in his software system to the client or a list of clients, but this is not a system requirement. The coded component may then be printed onto a coded component card along with other relevant information such as the name of the company or photographer, the address, a password link for access to the photographs, or other information. The coded component may be printed on a card, or on another medium or stored electronically. Multiple duplicate cards may be generated, preferably color coded to prevent mixing. Also multiple unique coded component cards may be generated by the photographer at one sitting to facilitate multiple client shoots in a given time period.

In the case of multiple photographers working for a company, a master generator can generate multiple duplicated coded components to distribute to each photographer. The duplicated coded components can have some common features to be easily identified. For example, the duplicated coded components can be color coded, and thus the system can tell the multiple photographers to work on a red job, meaning the job having the coded component on a red card. Each photographer may have multiple duplicated cards, for example, to provide to a client and to mark the job for a new memory card. The color designation for a job may also occur electronically in cases where the coded component is displayed on other media such as a PDA, mobile phone, computer or other device.

Alternatively, each photographer takes a different coded component, and then reports the employed coded component to the company, who then links all the coded components to the same job. Many coded component cards or images on an alternate media (such as a PDA) exist for the same job, with different coded components and a way to link these coded components together. Duplicated coded components may also be used.

Alternatively, one user may develop the association between a coded component and the client's identifying information. This association is not required by the system, the information on the printed coded component card may be automatically downloaded and linked to the coded component. This information may be stored in a database for access later by other photographers. One individual may generate the printed versions of the coded components or each photographer may print one or multiple coded component cards for a photo shoot. Electronic versions may be transferred to external devices, such as a PDA.

Multiple coded component cards may exist for the same client job. These cards may have the same coded component but may have different identifying information. For example, in the case where a coded component card is generated that includes the photographer's name and contact information, different names may be listed to correspond to the different photographers while the coded component remains the same.

In the case of a single photographer working as a contractor for a company, the coded component card or other media containing the coded component may be generated by the company and prepared for physical pickup by the contractor. The coded component may also be transferred electronically to the photographer for printing at a different location such as the photographer's workplace or home office or for display electronically, without generating a hard copy.

In another aspect of the embodiment, multiple cameras may be used to generate photographs that are associated with the same coded component. This allows for a team of photographers, a photographer with multiple cameras or a combination thereof to generate a series of photographs for a client.

In an aspect, the coded component would be captured prior to the photo shoot by each camera in use for the session. Coded component image capture may be achieved by generating multiple copies of the same coded component and using each camera to photograph the media upon which the coded component has been placed. In an alternative method, one coded component card may be generated and each camera may capture an image of the same coded component card prior to the photo shoot. Alternatively, the coded component may be captured from another media such as a PDA.

Further, this feature would allow the incorporation of photos taken by other parties, such as guests at a wedding. In this case, the photographer would decide how the images are grouped. The images could be grouped serially, for example Camera A images are followed by the images from Camera B and so on. The images could also be intertwined by using the time and date stamp of the image file. The photographer may also manually determine the order and grouping of the images.

Other variations exist and are within the scope of the present invention.

In an embodiment, the coded component can include an option field which is either machine readable or human readable or both. The option field can extend the use of the system beyond sorting and organizing the pictures to additional post processing steps. The option field can be added to the card, selected or added by the photographer or the client. For example, the option field can include special requests such as matte or gloss finish, picture retouch or not, color or black and white format, resolution required, storage requests, separate accounts, special billing requirements, etc. The option field can be machine readable so that the machine can automatically perform the option request. The optional field can be human readable to enable the client or the photographer to set the field value. In an aspect, the option field comprises a number corresponding to a selection check list where someone, such as the client or the photographer, selects the proper option. The option field can comprise a blank section for writing in the special request. FIG. 6 illustrates an exemplary business card comprising an option field for selection check mark. A coded component may also contain a link or be linked to an option enabling the photographer to capture coded components associated with order or post-processing instructions.

In an embodiment, the photographer or his designate will download the photographs to a storage system. The coded component is also downloaded to the storage system along with the series of photographs since the coded component exists in the form of a photograph, at the beginning and/or the end of the series. In an aspect, the sequence of download preserves the sequence of pictures taken, e.g., the pictures are downloaded based on time sequence, the first picture taken is downloaded first before the second picture captured. This is similar to analog film since the pictures are developed as a function of time. This can facilitate the grouping of photographs according to the coded component, since any pictures between two coded components belong to either coded component, depending on the set up. This preservation of time sequence can allow the use of memory cards without any coded component picture, since after downloading, all pictures are present, and not separated by the limitation of the memory cards. For example, memory cards 2 and 3 do not have any coded component pictures, but after downloading, these pictures are sandwiched between a coded component in memory card 1 and a coded component in memory card 4. From the storage point of view, there are no separation of memory cards, and thus these pictures all are sandwiched between two coded components (except maybe the last job).

In an aspect, the time sequence preservation can be recovered by other techniques such as incremental file name or time stamp. For example, the digital camera has a setting where the captured pictures are stored in a file on a memory medium, and the file has a unique name which can be the incremental sequence number that will identify the sequence. For example, the first file can be named img0567.jpg and the next file, representing the picture taken immediately after the first file, is named img0568.jpg. Thus by observing the file name, a time sequence can be re-constructed without following any downloading procedures. Alternatively, the camera can have a built in clock, and when a picture is taken, this clock (date and time) can be stored or embedded in the file as a time stamp. This time stamp can allow the re-construction of the time sequence of the taken pictures. The time stamp method can provide an additional advantage over the file sequence in the case of multiple cameras or photographers on the job. With multiple memory cards to be downloaded, the time stamp feature can successfully group the pictures according to the time of the event. Other information can be employed for indicating an end of a picture series, including a time out value, an error signal, a counter system, or a long break time between photographs.

The memory cards preferably contain coded components to identify the taken pictures. For example, it is preferable to start and finish a job within one memory card, or to start a new job with a new memory card. However, this is not always possible, so it is also preferable to keep a coded component (for example, a duplicated coded component if the first coded component is given to the client, or not giving the coded component to the client until after the job) so that a coded component can be included in the pictures of a new memory card. Also, the memory cards can be sequentially numbered, so that the picture order can be reconstructed from the sequence number of the memory cards. Alternatively, file sequence or time sequence might be employed to reconstruct the job sequence, and group the pictures accordingly.

In an embodiment, the automatic post processing comprises an auto sort process where the downloaded pictures are sorted into groups based on job number. The coded components are machine processed to recover the job number, and the pictures belonging to this job number are linked to the job. Depending on the procedure of capturing the coded components, the photographs can be sorted differently. For example, if the first picture of the job is the picture containing the coded component, then all the pictures between this coded component and the subsequent coded component belong to the job identified by this coded component. In an aspect, all pictures are processed to identify the coded components and the number of coded components. Then the pictures are sorted and categorized into groups. In an aspect, the pictures are processed in sequence, and each processed picture is determined to have a coded component, or belongs to a group identified by a coded component.

In an aspect, a job can have a plurality of coded components, and thus all pictures belonging to these coded components belong to the same job. Other post processing methods to group the photographs can be employed based on the order of coded components.

In an embodiment, the coded component link to the photograph or series of photographs may allow for privacy of the client by restricting online access to the photograph(s) to users with a code or password linked to the code. The photographer or other administrator may configure an account log in with a password for each client or for other photographers to access the images. The login information and password may then be distributed to the client (or may have been previously distributed if it is placed on the coded component card) for the purpose of accessing the photographs.

In an aspect, the user may sort, inspect, select, modify or distribute the photographs based on the coded component link. For example, the user may access the images online, inputting either the coded component or a password link to access the photographs. In this example, the user may be allowed to distribute this coded component or password link to other individuals (such as family members or friends) for access to the images for review. This feature may enable an additional option of categorizing some images as private. In this case, the master user may access the images, review them and sort some images into a designated group. Subsequent access may be allowed with a different password link allowing other users to access only limited groups of images.

FIG. 7 outlines an overview of the process described in this invention where a photographer or photographers may capture an image of a coded component to mark a photo shoot or job and may then pass this coded component on to a client for future access to photographs. The photographer 730 downloads (761) a unique identification string, preferably in the form of an image, from a server 740. The photographer then prints or downloads (762) and keeps (763) the coded component 720, for example, in the form of a business card. The photographer then proceeds to a client 750, taking a picture of a coded component (764) with a camera 710. The coded component 720 is then stored (765) in a photograph within a series of photographs of the job. The photographer performs (766) a photo shoot and stores (767) a series of photographs. The coded component is then transferred (768) to the client 750, who receives (769) the coded component as a means to access the photograph, and other services. The photographs are uploaded (770) to the server 740, with an acknowledge receipt (771). The client may later access these photographs, using a link to the coded component or other access methods implemented by the photographer.

FIG. 8 demonstrates the incorporation of the coded component into a sequence of photographs with time and date stamps. The coded component 850 and an image or series of images 860 are captured by a camera 810 (or cameras) and stored in the camera's memory 820. The camera automatically creates a sequence 830 of file names for the photographs, together with the time and date stamp 840. The coded component and the sequence of images are downloaded to a storage medium 870. At the server, the sequence of images is reconstructed 880 (in the case of multiple cameras for example). The set of images are sorted to jobs 890 and made available for client access.

An additional aspect of the embodiment allows for multiple coded components to be associated with an image. This would allow association of images to different events where applicable. For example, this would allow image association for Individual A, present at the rehearsal dinner and Individual A, present at the wedding. In an aspect of the invention, the user may manually associate images with the coded component. This would allow for association of images in the case where the automatic upload did not occur or where images were added from another source. For example, the client may incorporate photographs of his own into a set of the photographer's captured images for the purpose of archiving or providing access to other family members. Software may be configured to allow the client or the photographer or other user or administrator to associate these incorporated photographs with the event.

In an aspect, the coded component association may be linked with any image captured by photography (i.e. not limited to photograph of scenery or subjects) including but not limited to: photographs of documents, medical records, or art work. In this aspect, the coded component may be used to later access a series of images for review by individuals with the coded component or a password link to the coded component. This feature will enable unique tracking and sorting of documents or other objects captured by the camera. An example of this feature is submissions for an art competition. A coded component may be established between a competition event and a set of individual submissions, allowing other users to access a set of photographs for the purpose of reviewing or judging the submissions. This feature could also enable grouping of photographs captured at an estate sale, for example.

In an embodiment, the present invention discloses a process and an apparatus by which a coded component may be embedded to each photograph. In this case, the coded component is prepared and included in the field of view of the camera so that it is part of the final image. The photographs may then be transferred to a storage server and automatic sorting may occur based on this coded component tag. One aspect of this embodiment provides for the identification of an individual person or subject from a group of photographs.

In an aspect, a subject may hold the coded component while the photograph is being captured by the photographer as illustrated by FIG. 9A. This allows identification of individual photographs or groups of photographs such as may be taken at a posed photo shoot. Examples of posed photo shoots include school portraits, family photo sessions, engagement photographs or other cases where photographs are captured by a photographer. In the case of a posed photo shoot, the individual or individuals being photographed may hold the coded component for a first test shot. All subsequent photographs would then be grouped with this coded component.

The coded component could also be worn by a subject, such as on a nametag or identification badge. This implementation would allow for photograph grouping and identification at sporting, corporate, family or other events. In some cases, an individual image may contain more than one coded component, such as when multiple team members are photographed at a sporting event. In this case, the photographs may be sorted for individuals or groups of individuals (e.g., AND or OR sorting). This aspect may also apply to inanimate subjects, illustrated in FIG. 9B, such as exhibits at a science fair, art works in an auction or animals at a competition. This feature would be especially useful for sorting photographs taken at an automobile race, for example. In this case, the coded component may be included on several small, visible areas of the outside of the automobile.

In another aspect, the coded component may be placed within the field of view for later identification, sorting and retrieval of photographs. For example, at an artwork competition, the coded component may be placed next to the artwork for incorporation within the field of view of the camera. Further, it may allow the user to sort, inspect, select, modify or distribute the photographs based on the coded component link. For example, the user may access the images online, inputting either the coded component or a password link to access the photographs. In this example, the user may be allowed to distribute this coded component or password link to other individuals (such as family members or friends) for access to the images for review.

In an embodiment, the present invention discloses a method and an apparatus for the attachment of a coded component directly to the camera or camera lens so that whenever a photograph is captured, the code will be embedded into the image for later processing. This may be accomplished with an optical or mechanical device. In an aspect, the coded component is prepared and attached to the camera's field of view, as illustrated in FIG. 10, so that each photograph captured includes the coded component.

In an embodiment, the coded component may be linked directly to the memory file on the camera, as illustrated by FIG. 11. This embodiment comprises of coded component preparation and incorporation into the memory file of the camera so that each photograph taken will have the coded component embedded into the memory file. When required, the photographer shall have the ability to change the coded component association to correspond with a different client or photography job. This feature also enables the use and re-use (mix and match) of a coded component during a short period of time. This would prove useful to a photographer capturing multiple clients at a single event such as graduates and their families at a graduation or contestants at an event. In an aspect, the camera will allow for selection of coded components by the photographer.

In an embodiment, the user may later assign a coded component to the memory file of the image, using the date and time stamp as a link to the coded component. In this aspect, the user may specify that photographs taken between listed times and/or dates are to be associated with a specified coded component. The user may assign a coded component to the memory file of the image manually. This operation may be performed on a single photograph or multiple photographs. This feature allows for the establishment of the coded component link independent of any printed version of the coded component.

In an embodiment, the present invention discloses a process of linking the appointment data to the date and time of the captured photographs, for example, to identify the client to the photographs taken by the camera, or by associating different client identifications with different photographs. In an aspect, the photographer, or his business associates, maintains an appointment calendar, or any similar component, which records the identification of a job (such as the identification of the client or the event), and the date and/or time of the job. The calendar is preferably maintained in an electronic format, to allow process automation. The photographer then goes to the client and starts taking photographs using a camera that provides date and/or time stamp. The appointment calendar and the taken photographs are then loaded to a server (or alternatively, the photographs can be loaded to the server hosting the calendar application), and an algorithm associates the photographs to the jobs, using the date and/or time extracted from the photographs and the calendar as linkage. For example, any photograph having time stamp in the vicinity of the date and/or time of the job appointment is automatically assigned to the job. First, the time stamp of a photograph is retrieved to extract the date and/or time of the photograph. If the date and/or time are within the time window of a job appointment, the photograph is then assigned to the job. Other conflict resolved algorithms can include the sequence of the photographs, or the small time difference between photographs. For example, if two photographs are within a few seconds (or minutes) of each other, it is likely that they belong to the same job. Alternatively, a long break between photographs, for example, a day or two, can indicate that the two photographs belong to different jobs.

In the event of ambiguity, conflict resolution algorithms can be employed. For example, if a camera is not properly set up for date and time, a number of photographs might have a time offset. Software algorithm can be use used to calculate the time offset, and reset the time stamp for these photographs. Alternatively, human intervention can be used. In an aspect, the time window for a job appointment can be determined from the starting times and/or the ending times of the jobs. The time window can be between the starting time and the ending time, or can be between some predetermined time before the starting time and some other predetermined time after the ending time. For example, the time window can start about half an hour before the starting time of the job, and end at about 1 to 2 hours after the scheduled time. Alternatively, the time window can be calculated from the previous and/or the next job appointments. For example, a start time of a time window for a job can be a fraction of the time the previous job ends and the current job starts. Similarly, an end time of a time window for a job can be a fraction of the time the current job ends and the next job starts.

Multiple cameras may be used to generate photographs that are associated with the same date and/or time linkage between the photographs and the calendar appointment date. This allows for a team of photographers or a single photographer to generate a series of photographs for a client.

In an aspect, the appointment calendar contains information that allows the clients to access the photographs. For example, a client identification and/or a password can be given to the clients so that the clients can access the photographs. The identification and password link to the photograph or series of photographs may allow for privacy of the client by restricting online access to the photograph(s) to users with a code or password linked to the clients. Further, it may allow the user to sort, inspect, select, modify or distribute the photographs based on the identification.

The present invention may also be embodied in a machine or computer readable format, e.g., an appropriately programmed computer, a software program written in any of a variety of programming languages. The software program would be written to carry out various functional operations of the present invention. Moreover, a machine or computer readable format of the present invention may be embodied in a variety of program storage devices, such as a diskette, a hard disk, a CD, a DVD, a nonvolatile electronic memory, or the like. The software program may be run on a variety of devices, e.g. a processor.

With reference to FIGS. 12A and 12B, an exemplary environment for implementing various aspects of the invention includes a computer 1401, comprising a processing unit 1431, a system memory 1432, and a system bus 1430. The processing unit 1431 can be any of various available processors, such as single microprocessor, dual microprocessors or other multiprocessor architectures. The system bus 1430 can be any type of bus structures or architectures, such as 12-bit bus, Industrial Standard Architecture (ISA), Micro-Channel Architecture (MSA), Extended ISA (EISA), Intelligent Drive Electronics (IDE), VESA Local Bus (VLB), Peripheral Component Interconnect (PCI), Universal Serial Bus (USB), Advanced Graphics Port (AGP), Personal Computer Memory Card International Association bus (PCMCIA), or Small Computer Systems Interface (SCST).

The system memory 1432 can include volatile memory 1433 and nonvolatile memory 1434. Nonvolatile memory 1434 can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory 1433, can include random access memory (RAM), synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), or direct Rambus RAM (DRRAM).

Computer 1401 also includes storage media 1436, such as removable/nonremovable, volatile/nonvolatile disk storage, magnetic disk drive, floppy disk drive, tape drive, Jaz drive, Zip drive, LS-100 drive, flash memory card, memory stick, optical disk drive such as a compact disk ROM device (CD-ROM), CD recordable drive (CD-R Drive), CD rewritable drive (CD-RW Drive) or a digital versatile disk ROM drive (DVD-ROM). A removable or non-removable interface 1435 can be used to facilitate connection.

The computer system 1401 further can include software to operate in environment 1400, such as an operating system 1411, system applications 1412, program modules 1413 and program data 1414, which are stored either in system memory 1432 or on disk storage 1436. System applications can include various algorithms to transfer photograph files, identify a photograph containing a coded component, recognize a coded component, and sort the photographs to different jobs. Additional algorithms such as client billing and secured payment can also be included. Various operating systems or combinations of operating systems can be used.

Input devices 1422 can be used to enter commands or data, and can include a pointing device such as a mouse, trackball, stylus, touch pad, keyboard, microphone, joystick, game pad, satellite dish, scanner, TV tuner card, sound card, digital camera, digital video camera, web camera, and the like, connected through interface ports 1438. Interface ports 1438 can include a serial port, a parallel port, a game port, a universal serial bus (USB), and a 1394 bus. The interface ports 1438 can also accommodate output devices 1421. For example, a USB port may be used to provide input to computer 1401 and to output information from computer 1401 to an output device 1421. Output adapter 1439, such as video or sound cards, is provided to connect to some output devices such as monitors, speakers, and printers.

Computer 1401 can operate in a networked environment with remote computers 1424. The remote computers 1424, shown with a memory storage device 1425, can be a personal computer, a server, a router, a network PC, a workstation, a microprocessor based appliance, a peer device or other common network node and the like, and typically includes many or all of the elements described relative to computer 1401. Remote computers can be connected to computer 1401 through a network interface 1423 and communication connection 1437, with wire or wireless connections. Network interface 1423 can be communication networks such as local-area networks (LAN), wide area networks (WAN) or wireless connection networks. LAN technologies include Fiber Distributed Data Interface (FDDI), Copper Distributed Data Interface (CDDI), Ethernet/IEEE 1202.3, Token Ring/IEEE 1202.5 and the like. WAN technologies include, but are not limited to, point-to-point links, circuit switching networks like Integrated Services Digital Networks (ISDN) and variations thereon, packet switching networks, and Digital Subscriber Lines (DSL).

FIG. 12B is a schematic block diagram of a sample computing environment 1410 with which the present invention can interact. The system 1410 includes a plurality of client systems 1441. The system 1410 also includes a plurality of servers 1443. The servers 1443 can be used to employ the present invention. The system 1410 includes a communication network 1445 to facilitate communications between the clients 1441 and the servers 1443. Client data storage 1442, connected to client system 1441, can store information locally. Similarly, the server 1443 can include server data storage 1444.

FIG. 13 illustrates an exemplary method for a data processing system to perform an embodiment of the present invention. In block 1200, a data processing system, such as a server, receives a plurality of photographs belonged belonging to different jobs. The photographs also included photographs having embedded coded components, which can serve as delimiters for the jobs by comprising a machine-readable element identifying a job. These photographs can be transferred from one or more photographers regarding the photographs taken for one or more jobs. In block 1210, the server identifies one or more photographs each having a coded component. The coded components then can be decoded, and in block 1220, the photographs are sorted to the corresponding jobs by associating the photographs with the coded components.

FIG. 14 illustrates another exemplary method for a data processing system to perform an embodiment of the present invention. In blocks 1200 and 1210, the photographs are received by a server with the photographs containing the coded components identified. In block 1312, the server, e.g., a program running on the server employing a pre-coded algorithm, retrieves, from the coded component, identifying data relating to a job. For example, the data can include the job name and password, which can be used later for generating an account for the client. The data can indicate how the photographs are sequenced, for example, a beginning coded component with job photographs immediately after the photograph containing the coded component, an end coded component with job photographs immediately before the photograph containing the coded component, or beginning and end coded components sandwiching job photographs. The data can also indicate that the photographs are sequenced with file names or with date and time, to determine the order of the photograph sequence. In block 1220, the photographs of different jobs are sorted to the corresponding jobs, by associating the photographs with the coded components. For example, if the retrieved coded component identifies that it is a beginning coded component with no end coded component, the photographs after the coded component photograph in the photograph sequence are associated with the coded component, until encountering another beginning coded component photograph. The coded component can also identify time sequence, for example, any unusual large time gap between the photographs can also serve as the delimiter, separating the photographs between jobs.

In block 1322, the server can employ a conflict-resolving algorithm in the event of conflict in sorting the photographs. For example, if there is a large time gap between photographs, a predetermined algorithm can be set to address the issue. Alternatively, an operator intervention can be requested to solve the conflict.

In block 1324, the server can retrieve from the coded component, an optional desired treatment for the photographs or for the client. In block 1326, the server performs the treatment according to the decoded information from the coded components. For example, the coded component requests a gloss finish on the photographs, and the server can perform the requested treatment on the photographs associated with the coded component having the request. Alternatively, the coded component can request a special billing requirement, and the server can set up the account for the client to satisfy the special request.

In block 1328, the server creates different accounts for different jobs containing the corresponding photographs. In block 1329, a job name and optionally a password can be assigned to the accounts to provide secure access to different clients. With the automatic sorting and account set up, only the proper clients can access their photographs, thus offering a secure environment of photograph distribution, for example, in the Internet environment.

FIG. 15 illustrates an exemplary data processing system according to an embodiment of the present invention. The system comprises a server 1520, such as a computer or any data processing system, which includes a processor 1522 linking to a memory 1524 and software programs 1526, such as a searching algorithm for searching photographs containing coded components, a pattern recognition algorithm for decoding the coded components, a sorting algorithm to sort photographs to corresponding jobs, a conflict resolving algorithm to solve conflict in sorting, account management programs, and other needed computer management programs. One or more local cameras 1510A, photographers 1530A and clients 1540A, and one or more remote cameras 1510B, photographers 1530B and clients 1540B can connect to the data processing system 1520, directly or through network connection such as the Internet 1550. The cameras can be connected to the server, for example, through the photographers or through an associate, for downloading photographs, including photographs containing the coded components. The photographers can connect to the server to get the unique coded component components or to print cards having embedded coded component components. The photographers can also connect to the server for accessing the photographs, for example, to provide feedback to the client regarding a treatment of the photographs. The clients can connect to the server to access the photographs, ask questions, receive invoices and perform payments. The server can run unattended, and require minimum operator intervention, since the process is designed to achieve full automation for the photograph business.

While the invention is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims. For example, a “camera” is not limited to a single purpose camera only but may include a camera phone, a video camera or other device used for image capture. Further, a “picture” or “photograph” may include a still or moving image. Reference to a memory card shall include any method used for storage of electronic files.

Claims

1. A computer-implemented method to improve automation of a photography automatically process digital photographic images of one or more posed photo shoot sessions by one or more computer systems that include one or more processors and system memories containing program instructions that, when executed by the one or more processors, configured the one or more computer systems to perform the computer-implemented method comprising:

generating, by the one or more computer systems, a plurality of unique identification strings;

for each unique identification string of the plurality of unique identification strings:

coding, by the one or more computer systems, from the unique identification string, a one- or two-dimensional, machine-recognizable, and machine-readable graphic pattern,

wherein each coded graphic pattern is unique;

establishing an association between each unique identification string or each unique coded graphic pattern and an individual client of a plurality of clients;

preparing, by the one or more computer systems, before the one or more posed photo shoot sessions, imageable media to display each unique coded graphic pattern;

for each of a plurality of jobs of the one or more posed photo shoot sessions, wherein each job comprises a series of photographs for one of the individual clients of the plurality of clients:

selecting, to be used for a particular individual client of the plurality of clients, the prepared imageable media displaying a selected unique coded graphic pattern of the unique coded graphic patterns;

placing, to identify the job, the selected prepared imageable media displaying the selected unique coded graphic pattern within a field of view of a hand-holdable camera;

taking at least a first a code-storing photograph of a coded component the selected prepared imageable media displaying the selected unique coded graphic pattern using a handheldable the hand-holdable camera, the coded component comprising a machine-readable element; and wherein the displayed unique coded graphic pattern is embedded into the code-storing photograph such that the code-storing photograph stores the displayed selected unique coded graphic pattern, immediate prior to:

taking one or more second job photographs relating to a job of a the particular individual client using the handheldable same hand-holdable camera used to take the code-storing photograph,

wherein the one or more second job photographs do not contain the coded component, any of the unique coded graphic patterns;

wherein the at least a first photograph photographs of the plurality of jobs form a sequence of digital images in which each of the code-storing photographs is operable to mark at least one of positioned within the sequence of digital images at a beginning and an end of the one or more second job photographs of one of the jobs;

sending the taken photographs sequence of digital images of the plurality of jobs, including the at least a first photograph code-storing photographs and the one or more second job photographs, to a data processing system, wherein the one or more computer systems comprise the data processing system is configured; and

causing the one or more computer systems that comprise the data processing system to:

process the taken photographs to sequence of digital images,

recognize the unique coded graphic patterns,

identify the at least a first photograph code-storing photographs, and

decode the unique coded graphic patterns,

retrieve, from the decoded unique coded graphic patterns, identifying data relating to each of the plurality of jobs,

wherein the retrieved identifying data includes each unique identification string;

associating associate the one or more second job photographs into groups, wherein each job photograph or group is associated with the machine-readable element of the at least a first code-storing photograph positioned at the beginning of the one or more job photographs immediately following the code-storing photograph, and

link the associated one or more job photographs with each of the plurality of jobs that the retrieved identifying data relates to,

such that the one or more computer systems sort the plurality of job photographs that do not contain any of the unique coded graphic patterns to corresponding jobs according to the identifying data retrieved from the unique coded graphic patterns stored in the code-storing photographs.

2. A method as in claim 1 further comprising

providing at least one of the coded component and information relating to the coded component to the client.

3. A method as in claim 2 wherein either taking the one or more photographs relating to the job is performed before or after taking the photograph of the coded component, or

taking the photograph of the coded component is performed before or after providing the coded component to the client.

4. A method as in claim 1 wherein taking a photograph of the coded component comprises taking a picture of the client with the coded component.

5. A method as in claim 1 wherein the coded component further comprises human-readable information which comprises at least one of public information and secured information to enable the client to access the one or more photographs.

6. A method as in claim 1 wherein the coded component further comprises an option field which indicates a desired treatment for the job.

7. A method as in claim 1 wherein the machine-readable element comprises at least one of a 1-D barcode, a 2-D code, a color code, machine recognizable characters, and patterns that are recognizable by a machine vision program.

8. A method as in claim 1 wherein the machine-readable element links to a client database to provide information related to the client.

9. A computer-implemented method to improve automation of a photography automatically process digital photographic images, the method performed by one or more computer systems that include one or more processors and system memories containing program instructions that, when executed by the one or more processors, configure the one or more computer systems to perform the computer-implemented method comprising:

receiving a plurality of photographs belonging to different sequence of digital images for a plurality of jobs of the one or more posed photo shoot sessions,

wherein each job of the plurality of jobs comprises a series of photographs for an individual client of a plurality of clients,

wherein the plurality of photographs including first sequence of digital images includes both a plurality of code-storing photographs having, each code-storing photograph storing an embedded coded components unique coded graphic pattern, and second a plurality of job photographs, each job photograph not having an embedded coded components unique coded graphic pattern,

wherein one or more first photographs are operable to mark at least one of each code-storing photograph is positioned within the sequence of digital images at a beginning and or an end of one or more second of the job photographs that belong to a job of the different jobs of one of the jobs, and

wherein each coded component comprises a machine-readable element configured for identifying a job, and

wherein the plurality of job photographs are taken using a same handheldable hand-holdable camera used to take the code-storing photographs;

processing each image of the plurality of photographs sequence of digital images by a searching algorithm configured to identify the one or more first of the plurality of code-storing photographs; and

sorting the plurality of job photographs to the corresponding jobs by:

for a first digital image of the sequence of digital images, identified by the processing as one of the plurality of code-storing photographs containing one of the embedded unique coded graphic patterns;

recognizing the one of the embedded unique coded graphic patterns as a one- or two-way dimensional, machine-generated, and machine-readable code;

decoding, by a pattern recognition algorithm, the one of the embedded unique coded graphic patterns; and

retrieving, from the decoded one of the embedded unique coded graphic patterns, identifying data relating to a first job of the plurality of jobs;

for one or more second digital images of the sequence of digital images, not identified by the processing as one of the plurality of code-storing photographs;

determining that, in the sequence of digital images, the one or more second digital images are positioned immediately after or before the first digital image,

wherein, based on the processing, the one or more second digital images are job photographs, and

wherein the first digital image serves as a delimiter of the beginning or the end of the job photographs of the first job; and

associating the one or more second job photographs delimited by the first digital image with the coded components of the one or more first photographs first job that the identifying data retrieved from the decoded one of the embedded unique coded graphic patterns relates to;

wherein the one or more computer systems associate other job photographs of the plurality of job photographs with different jobs of the plurality of jobs,

such that the one or more computer systems sort the plurality of job photographs that do not contain any of the unique coded graphic patterns to the corresponding jobs according to the identifying data retrieved from decoding the unique coded graphic patterns embedded in the code-storing photographs.

10. A method as in claim 9 further comprising retrieving, from the code component, identifying data relating to the job.

11. A method as in claim 9 wherein a coded component further comprises a desired treatment for the job, the method further comprising: performing the treatment.

12. A method as in claim 9 wherein the photographs of the plurality of photographs receding or following the photograph containing the coded component are associated with the coded component.

13. A method as in claim 9 wherein the plurality of photographs comprise at least one of a sequence number and a time stamp and the plurality of photographs with the sequence number or time in the vicinity of that of the coded component photograph are associated with the coded component.

14. A method as in claim 9 further comprising assigning at least one of a job name and a password to the plurality of photographs of a job to restrict access to the plurality of photographs.

15. A method as in claim 9 further comprising employing a conflict-resolving algorithm in the event of conflict in sorting the plurality of photographs.

16. A machine readable non-transitory machine-readable medium comprising having stored thereon instructions that, when executed by one or more processors in one or more computer systems, configure the computer systems to execute the a computer-implemented method of claim 9 to automatically process digital photographic images, where the method comprises

receiving a sequence of digital images for a plurality of jobs of one or more posed photo shoot sessions,

wherein each job of the plurality of jobs comprises a series of photographs for an individual client of a plurality of clients,

wherein the sequence of digital images includes both a plurality of code-storing photographs, each code-storing photograph storing an embedded unique coded graphic pattern, and a plurality of job photographs, each job photograph not having an embedded unique coded graphic pattern,

wherein each code-storing photograph is positioned within the sequence of digital images at a beginning or an end of one or more of the job photographs of one of the jobs, and

wherein the plurality of job photographs are taken using a same hand-holdable camera used to take the code-storing photographs;

processing each image of the sequence of digital images by a searching algorithm configured to identify one or more of the plurality of code-storing photographs;

sorting the plurality of job photographs to corresponding jobs by:

for a first digital image of the sequence of digital images, identified by the processing as one of the plurality of code-storing photographs containing one of the embedded unique coded graphic patterns;

recognizing the one of the embedded unique coded graphic patterns as a one- or two-dimensional, machine-generated, and machine-readable code;

decoding, by a pattern recognition algorithm, the one of the embedded unique coded graphic patterns; and

retrieving, from the decoded one of the embedded unique coded graphic patterns, identifying data relating to a first job of the plurality of jobs;

for one or more second digital images of the sequence of digital images, not identified by the processing as one of the plurality of code-storing photographs;

determining that, in the sequence of digital images, the one or more second digital images are positioned immediately after or before the first digital image,

wherein, based on the processing, the one or more second digital images are job photographs, and

wherein the first digital image serves as a delimiter of the beginning or the end of the job photographs of the first job; and

associating the one or more job photographs delimited by the first digital image with the first job that the identifying data retrieved from the decoded one of the embedded unique coded graphic patterns relative to;

wherein the one or more computer systems associate other job photographs of the plurality of job photographs with different jobs of the plurality of jobs,

such that the one or more computer systems sort the plurality of job photographs that do not contain any of the unique coded graphic patterns to the corresponding jobs according to the identifying data retrieved from decoding the unique coded graphic patterns embedded in the code-storing photographs.

17. A data processing system to improve automation of a photography process, comprising:

means for receiving a plurality of photographs belongs to different jobs, the plurality of photographs including first photographs having an embedded coded component and second photographs not having embedded coded components,

wherein one or more first photographs are operable to mark at least one of a beginning and an end of one or more second photographs that belong to a job of the different jobs,

wherein each coded component comprises a machine-readable element configured to identify a job, and

wherein the plurality of photographs are taken using a same handheldable camera;

means for processing the plurality of photographs to identify the one or more first photographs;

means for sorting the plurality of photographs to the corresponding jobs by associating the one or more second photographs with the co components of the one or more first photographs.

18. A data processing system as in claim 17 wherein a coded component further comprises a desired treatment for the plurality of photographs, the data processing system further comprising:

means for treating the plurality of photographs associated with the coded component.

19. A data processing system as in claim 17 further comprising means for employing a conflict-resolving algorithm in the event of conflict in sorting the plurality of photographs.

20. A method as in claim 2 wherein taking the one or more photographs relating to the job is performed after taking the photograph of the coded component.

21. The computer-implemented method of claim 1 wherein coding the one- or two-dimensional, machine-recognizable, and machine-readable graphic pattern comprises generating, by the one or more computer systems, a 2D bar code.

22. The computer-implemented method of claim 1 wherein the coding comprises including retrievable identifying data relating to a job in the coded graphic pattern, wherein the retrievable identifying data comprises one or more of a job name, a job number, an identifier for a client of the plurality of clients, a password for a client account, or the unique identification string.

23. The computer-implemented method of claim 1 wherein the coding comprises including retrievable photograph sequencing data indicating that the coded graphic pattern is a beginning code for an immediately following series of photographs.

24. The computer-implemented method of claim 1 wherein the coding comprises encrypting or digitally signing the coded graphic pattern.

25. The computer-implemented method of claim 1 wherein the preparing comprises one or more of:

causing each unique coded graphic pattern to be printed onto a displayable substrate, wherein the displayable substrate comprises a card, paper, plastic, or proof sheets;

causing each unique coded graphic pattern to be visually displayed on an electronic display screen, wherein the electronic display screen comprises a mobile phone, smart phone, personal digital assistant (PDA), laptop computer, or computer monitor; or

causing each unique coded graphic pattern to be displayed via an optical or mechanical device configured for attachment directly to the camera or a lens of the camera.

26. The computer-implemented method of claim 1 wherein the preparing comprises generating, for a same one of the unique coded graphic patterns, multiple different imageable media, wherein the different imageable media further include different human-readable photographer names.

27. The computer-implemented method of claim 1 wherein the placing comprises providing the prepared imageable media displaying a unique coded graphic pattern to the client for the client to hold while the first photograph of the unique coded graphic pattern is taken, and wherein taking the code-storing photograph comprises taking a picture of the client together with the prepared imageable media displaying the unique coded graphic pattern.

28. The computer-implemented method of claim 1 wherein taking the code-storing photograph and taking the one or more job photographs using the same hand-holdable camera comprises using a first hand-holdable camera to take a first code-storing photograph and first job photographs, and using a second hand-holdable camera to take a second code-storing photograph and second job photographs.

29. The computer-implemented method of claim 28 wherein the first hand-holdable camera and the second hand-holdable camera are used for the same job, to take the first and second code-storing photographs of the same unique coded graphic pattern and the first and second job photographs relating to the same client.

30. The computer-implemented method of claim 1, wherein establishing an association between each unique identification string or each unique coded graphic pattern and an individual client of a plurality of clients comprises storing, in a database, each unique identification string or each unique coded graphic pattern linked when an individual client of the plurality of clients.

31. The computer-implemented method of claim 1, further comprising, for each of the plurality of jobs:

automatically creating, by the one or more computer systems, an account to distributedly store the associated one of more job photographs that relate to the client;

assigning, by the one or more computer systems, a password to the account;

wherein the preparing, by the one or more computer systems, the imageable media to display the unique coded graphic patterns further comprises causing the imageable media to further display the password;

transferred to the individual client a physical or electronic version of the prepared imageable media displaying the unique coded graphic pattern and the password for the client; and

restricting, by the one or more computer systems, online access to the associated one or more job photographs to a user with the account password;

wherein the client with the password can use the one or more computer systems to log in to the account to inspect, select, modify, or distribute the associated one or more job photographs relating to the client.

32. The computer-implemented method of claim 9 wherein receiving the sequence of digital images comprises automatically transferring one or more files stored by the camera on a memory medium to the one or more computer systems.

33. The computer-implemented method of claim 9 wherein processing each image of the sequence of digital images to identify one or more of the plurality of code-storing photographs comprises processing all of the sequence of digital images to identify the plurality of code-storing photographs and a total number of the plurality of code-storing photographs.

34. The computer-implemented method of claim 9 wherein recognizing the one of the embedded unique coded graphic patterns as a one- or two-dimensional, machine-generated, and machine-readable code comprises using one or more machine vision or image recognition algorithms.

35. The computer-implemented method of claim 9 wherein the one of a one- or two-dimensional, machine-generated, and machine-readable code is a 1D barcode or a 2D barcode.

36. The computer-implemented method of claim 9 wherein retrieving identifying data relating to a first job from the decoded one of the embedded unique coded graphic patterns comprises retrieving one or more of:

a first job name, a first job number, an identifier for a client of the plurality of clients, a name associated with the first job, a password for a client account, a unique identification string, or a link to a database;

an indication of whether the decoded one of the embedded unique coded graphic patterns is a delimiter of a beginning or an end of job photographs; and

one or more treatment instructions.

37. The computer-implemented method of claim 9 wherein a single code-storing photograph contains multiple embedded unique coded graphic patterns, and further comprising retrieving different information from each of the multiple embedded unique coded graphic patterns.

38. The computer-implemented method of claim 9 wherein, based on the first digital image serving as a delimiter of the beginning or the end of the job photographs of the first job, the computer system determines that the job photographs begin after or end before the first digital image and do not include the first digital image.

39. The computer-implemented method of claim 9 wherein determining that, in the sequence of digital images, the one or more second digital images are positioned immediately after or before the first digital image comprises extracting metadata including one or more of an incremental file name, an incremental sequence number, a creation time and date, and a capture time and date, and recovering a time sequence based on the metadata.

40. The computer-implemented method of claim 9 wherein determining that, in the sequence of digital images, the one or more second digital images are positioned immediately after or before the first digital image comprises employing a conflict resolution algorithm to resolve an ambiguity by calculating and applying a time offset.

41. The computer-implemented method of claim 9 wherein associating the one or more job photographs delimited by the first digital image with the first job comprises one or more of:

associating the one or more second digital images into a group;

associating the one or more second digital images with the unique coded graphic pattern embedded in the first digital image; or

associating the one or more second digital images with the identifying data relating to the first job retrieved from the decoded one of the embedded unique coded graphic patterns.

42. The computer-implemented method of claim 9 wherein the associating identifies the one or more second digital images as photographs for a first client of the plurality of clients.

43. The computer-implemented method of claim 9 wherein multiple different unique coded graphic patterns are linked to the first job.

44. The computer-implemented method of claim 9 wherein multiple first digital images contain the same embedded unique coded graphic pattern, wherein each of the associated one or more second digital images are linked to the first job.

45. The computer-implemented method of claim 9 wherein the sequence of digital images including the plurality of job photographs taken using the same hand-holdable camera used to take the code-storing photographs comprises a first code-storing photograph and first job photographs taken using a first hand-holdable camera, and a second code-storing photograph and second job photographs taken using a second hand-holdable camera.

46. The computer-implemented method of claim 9 wherein each image of the sequence of digital images is processed in sequence, and each processed image is determined to have an embedded unique coded graphic pattern, or to belong to a group identified by an embedded unique coded graphic pattern.