Methods and systems for labeling digital image data generated by digital imaging devices, such as digital cameras and camcorders, with descriptive information are disclosed. In one embodiment, a menu of descriptive terms is displayed to the user of the digital imaging device. The user chooses one or more of the descriptive terms and the user's choices are associated with the digital image data. The descriptive terms may be used, for example, to generate a file name or may be later displayed with the digital image. In another embodiment, the digital imaging device accepts audio input such as, for example, the user speaking descriptive labels into a microphone. Using speech processing techniques, descriptive terms are extracted from the audio input and associated with the digital image data. In yet another embodiment, the digital imaging device accepts information from a location determination device, such as a GPS system. The location information may be used to determine alphanumeric location labels that can then be associated with the digital image data.
|
2. A method for labeling digital image data comprising:
acquiring a digital image; receiving numeric geographic coordinates from a location determination device; displaying the at least one alphanumeric location label to a user; receiving an indication from the user selecting at least one alphanumeric location label; and associating the at least one selected alphanumeric location label with an image data file containing the digital image.
1. A method for labeling digital image data comprising:
acquiring a digital image; receiving numeric geographic coordinates from a location determination device; displaying a menu of at least one alphanumeric location label corresponding to points near the location corresponding to the numeric geographic coordinates; receiving an input from a user to select at least one of the at least one alphanumeric location label in the menu; and associating the at least one selected alphanumeric location label with an image data file containing the digital image.
6. A computer-readable medium containing instructions for controlling a computer system to perform a method, the computer system having a group of data structures reflecting a logical structure of a data source, the method comprising:
acquiring a digital image; receiving numeric geographic coordinates from a location determination device; displaying a menu of at least one alphanumeric location label corresponding to points near the location corresponding to the numeric geographic coordinates; receiving an input from a user to select at least one of the at least one alphanumeric location label in the menu; and associating the at least one selected alphanumeric location label with an image data file containing the digital image.
7. A computer-readable medium containing instructions for controlling a computer system to perform a method, the computer system having a group of data structures reflecting a logical structure of a data source, the method comprising:
acquiring a digital image; receiving numeric geographic coordinates from a location determination device; determining at least one alphanumeric location label corresponding to the numeric geographic coordinates; displaying the at least one alphanumeric location label to a user; receiving an indication from the user selecting at least one alphanumeric location label in the menu; and associating the at least one selected alphanumeric location label with an image data file containing the digital image.
3. A digital imaging device, comprising:
a lens system that acquires a digital image; an imager device for converting the image to a digital image signal; a location determination device that generates location information representing a geographic location where the digital image was acquired; a memory for storing a data base of alphanumeric location labels; and a processor for determining at least one alphanumeric location label corresponding to the numeric geographic coordinates; and associating the at least one alphanumeric location label with an image data file containing the digital image signal; a display for displaying a menu of the at least one alphanumeric location label; and a user input mechanism for allowing a user to select at least one of the at least one alphanumeric location labels in the menu.
4. The digital imaging device of
5. The digital imaging device of
a second processor for linking the at least one alphanumeric location label with the digital image; and a display for displaying the at least one alphanumeric location label with the digital image, when the digital image is displayed.
|
The present invention relates generally to methods and apparatus for improving digital image processing.
Digital imaging devices, such as digital cameras and scanners, create digital representations of images and store the digital representations to data files for future use and manipulation. Data file names are created either automatically or entered in manually by the user. Conventional digital imaging devices that create filenames automatically typically use consecutive alphanumeric filenames, such as "xxx0001.jpg" and "xxx0002.jpg", to label the data files. While the files are labeled automatically, the file name created by the device has no relevance to the contents or description of the image. Nondescriptive filenames make organizing, indexing, sorting and retrieval of these files difficult and time consuming.
Some conventional imaging devices allow the use of descriptive file names, but these file names must be entered by the user. In conventional scanning devices, for example, pages to be scanned are loaded into a document feeder. The user specifies scan settings, including a file name for the stored image. The user must enter a descriptive name, such as "capecod1." When the user indicates that the desired settings are chosen by, for example, pressing a button, the scanned image is then saved as the indicated file name.
Some conventional digital cameras create a file name for the image file using data from an internal clock that is used also for automatic time stamping. These conventional devices may create, for example, an alphanumeric file name for a standard JPEG file of 050198182350.JPG for an image created on May 1, 1998 at 6:23 pm 50 seconds. The date and time information may also be integrated with the digital image information. This information is useful for retrieving an image based on date and time of creation. Conventional automatic digital imaging devices, however, do not stamp a digital image recording with other information useful for recalling an image, such as the location of the capture or the event associated with the image, such as a picnic, birthday or other event.
Some commercially available digital cameras are combined with global positioning system (GPS) receivers that collect and store position data describing the position of the camera at the time it acquired an image. These cameras, however, simply stamp the image data with the latitudinal and longitudinal coordinates which do not allow for easy recognition by others of the location where the image was acquired. They do not, for example, translate the coordinates into easily recognizable place names like "Cape Cod."
Methods, systems, and articles for manufacture consistent with the present invention overcome the shortcomings of existing systems by providing methods and means for labeling digital image data. According to one aspect of the invention, a digital image is acquired using a digital imaging device. A menu of descriptive terms is displayed to a user and the user selects at least one of the descriptive terms for association with the digital image file. In another aspect of the invention, an audio input device provides the digital imaging device with an audio signal containing at least one descriptive term. The descriptive term in the audio signal is associated with the digital image data file. In yet another aspect of the invention, a location determination device provides the digital imaging device with location information representing a geographic location where the digital image was acquired. The location information is associated with the digital image data file.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate the invention and, together with the description, serve to explain the principles of the invention.
Reference will now be made in detail to an implementation consistent with the principles of the present invention as illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings and the following description to refer to the same or like parts.
Methods, systems, and articles of manufacture consistent with the present invention assist a user in archiving, indexing, sorting and retrieving stored image files by associating information relevant to the digital image with the image data file. In a digital imaging device equipped with an audio receiver, the user records audio information describing the digital image that is acquired. The descriptive audio information is converted to digital information that is used to label the image. The digitized descriptive information may be used, for example, to create a descriptive file name or print information on the image.
In an alternative embodiment, a digital imaging device is equipped with a location determination unit that provides location information to the digital imaging device. The location information may be converted to geographic coordinates, which may in turn be used to determine a place name or other descriptive term. The geographic coordinates, place name, or descriptive term may be used, for example, to create a descriptive file name or print information on the image.
Processor 140 may be any commonly available digital processor special purpose digital processor. Processor 140 may also store the image in a memory 150. Memory 150 may include any storage device capable of storing data processed by processor 140, including, for example, data base 152. Memory 150 may be, for example, a floppy disk, or other magnetic medium, or a blank RAM. Data base 152 may contain, for example, a dictionary of words, place names, events, or other descriptive terms.
Processor 140 is also connected to at least one user input device 155 via any suitable data connection. User input device 155 can be any device capable of passing information to or receiving data from processor 140. By way of example only, user input device 155 may be a scroll wheel, button, key, or other suitable means of accepting input from a user. Digital camera 100 may also include a display 180, such as a cathode ray tube (CRT) or liquid crystal display (LCD), for displaying information.
Consistent with the present invention, digital camera 100 may also include an audio receiver 265, such as a microphone, as shown in FIG. 2. Audio receiver 265 may be located physically inside camera 100 or externally attached as a peripheral device, such as audio receiver 265. Audio receiver 265 may be operatively connected to an optional recorder 260 or other means of recording audio received from audio receiver 265. In implementations without optional recorder 260, audio may be stored in memory 150.
Location determination unit 375 passes the location information (such as the coordinates or place name) to camera control 370. Camera control 370 is operatively connected to processor 340 and passes location information to processor 340. As described above, processor 340 is operatively connected to memory 350 which may contain a database of geographic coordinates and familiar places names. Processor 340 may obtain a place name corresponding to the geographic coordinates by, for example, comparing the coordinates to the information in the database and determining the closest location. Processor 340 may also contain a character generator that produces a bit map of the text information.
In
If the user's choice, as indicated in step 430, does not have sub-menus, text corresponding to the user's choice is associated with the image data file (stage 450). The text may be used, for example, as a descriptive file name, such as "4thofjuly.jpg." If more than one item has been chosen, the file name may become, for example, "VACATION13 4thofjuly--070498_jpg." In another embodiment consistent with the present invention, the text may be printed as a legend on the image, either in the form as stored (e.g. VACATION--4thofjuly--070498_jpg) or expanded to a more meaningful form, such as "VACATION, Fourth of July, Jul. 4, 1998, 6:23:50 P.M." The descriptive information may be converted to a bit map of characters, with appropriate masking information added to the digital image file. The processor, for example, may composite the "Fourth of July" legend bit map onto the video image. The resulting composited image will be displayed on the camera viewfinder and/or stored to memory.
Consistent with the present invention, a digital imaging device may also receive information from an audio input device.
The audio may contain such content as a person commenting on the image he is shooting, for example "David on vacation in Washington D.C." If the audio should be associated with the image file as is (stage 724), the audio is linked to the image data (stage 726) and may subsequently be recalled and replayed when the digital image file is recalled.
Alternatively, the audio may be converted to a digital audio file (stage 730). The digital audio file may be stored and subsequently recalled and replayed when the digital image file is recalled. The digital audio file may also be processed, for example, using voice recognition software either in the digital camera or in any computer that is subsequently processing the image file (stage 735). If the voice recognition process results in more than one possible choice (stage 740), the choices may be displayed to the user (stage 742). The user may indicate a choice by, for example, manipulating a scroll wheel or using buttons, such as those provide in user input areas 540 of
If the voice recognition process does not recognize words in the digital audio file as words in the chosen language (stage 736), the process may proceed with a default process for determining a file name (stage 738). If, however, words in the data base are recognized, the process proceeds with step 740. The words may be used as is or, alternatively, compared to a list of words in a data base. For example, the words recognized by the voice recognition software may be compared against a data base of words commonly used to describe images, such as "David, "vacation" and Washington, D.C." either provided by the manufacture as part of the image. The use of a common words data base may prevent the file from being named by other nondescriptive words that the voice recognition software may recognize, such as "in, "the," and "a." Descriptive words may be used to create a file name, such as "DAVID_VACATION_WASHINGTON_DC.jpg," file tag, or overlay for displaying on the image file (such as "David in vacation in Washington, DC"). Once again software in the computer could search the database of image files for a file name with a key word like "David" or "Vacation".
If more than one word in the data base is recognized (stage 740), the words are displayed to the user (stage 742). In
In another embodiment consistent with the present invention, the file name is printed inconspicuously on the image, either in the form as stored (e.g. VACATION--4thofjuly--070498_jpg) or expanded to a more meaningful form, such as "VACATION, Fourth of July, Jul. 4, 1998, 6:23:50 P.M." The descriptive information may be converted to a bit map of characters, with appropriate masking information added to the digital containing the descriptive information image file. Masking information is a set of instructions on how to combine the image with the digital image file. The processor, for example, may composite the "Fourth of July" bit map onto the video image. The resulting composited image will be displayed on the camera viewfinder and/or stored to memory.
In yet another embodiment consistent with the present invention, a digital imaging device may also receive information from a location determination device, such as a GPS.
Consistent with the present invention, a digital imaging device acquires an image (stage 910). The digital imaging device also receives location information from a location determination device, such as a GPS (stage 920). The location information received may be, for example, longitudinal and latitudinal coordinates of the location of the camera when the image was acquired. The coordinates may be associated with the file as is (stage 924), in which case the coordinates are simply linked to the image data (stage 926).
If not associated as is, the location information may be converted to textual location information (stage 930). For example, the longitudinal and latitudinal coordinates may be used to obtain a city or location name derived from map data by using a look-up table of names associated with coordinates. The coordinate information may also be used to obtain graphical map information derived from the map data, supplied to the device on, for example, a replaceable memory cartridge.
The location coordinates may be compared, for example, to entries in a location data base stored in memory. The location data base may contain, for example, global location coordinates and alphanumeric place names such as "Orlando, Fla." or "Manhattan, N.Y." If the coordinates do not correspond exactly to any location in the data base (stage 936), the process may default (stage 938). Alternatively, the process may choose multiple entries with coordinates near the given coordinates (stage 940) and display the list of place names to the user (stage 942). If the coordinates correspond to more than one place name, such as "Manhattan, N.Y." and "Radio City Music Hall," or alphanumeric place name, all entries may be displayed to the user. The user then indicates which of the place names should be associated with the particular image file (stage 944). The user may, for example, scroll through the choices using a scroll wheel or indicate a choice using buttons on the camera. The alphanumeric place name may be, for example, imprinted on the printed photo, used to generate the file name, as in MANHATTAN.JPEG.
The foregoing description of implementations of the invention have been presented for purposes of illustration and description. They are not exhaustive and do not limit the invention to the precise form disclosed. Modifications and variations are possible in light of the above teachings or may be acquired from practicing of the invention. For example, the described implementation includes software but the present invention may be implemented as a combination of hardware and software or in hardware alone. The invention may be implemented with both object-oriented and non-object-oriented programming systems. The scope of the invention is defined by the claims and their equivalents.
Abram, Philip Michael, Sato, Robert J.
Patent | Priority | Assignee | Title |
10043516, | Sep 23 2016 | Apple Inc | Intelligent automated assistant |
10049663, | Jun 08 2016 | Apple Inc | Intelligent automated assistant for media exploration |
10049668, | Dec 02 2015 | Apple Inc | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
10049675, | Feb 25 2010 | Apple Inc. | User profiling for voice input processing |
10057736, | Jun 03 2011 | Apple Inc | Active transport based notifications |
10067938, | Jun 10 2016 | Apple Inc | Multilingual word prediction |
10074360, | Sep 30 2014 | Apple Inc. | Providing an indication of the suitability of speech recognition |
10078631, | May 30 2014 | Apple Inc. | Entropy-guided text prediction using combined word and character n-gram language models |
10079014, | Jun 08 2012 | Apple Inc. | Name recognition system |
10083688, | May 27 2015 | Apple Inc | Device voice control for selecting a displayed affordance |
10083690, | May 30 2014 | Apple Inc. | Better resolution when referencing to concepts |
10089072, | Jun 11 2016 | Apple Inc | Intelligent device arbitration and control |
10101822, | Jun 05 2015 | Apple Inc. | Language input correction |
10102359, | Mar 21 2011 | Apple Inc. | Device access using voice authentication |
10108612, | Jul 31 2008 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
10127220, | Jun 04 2015 | Apple Inc | Language identification from short strings |
10127911, | Sep 30 2014 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
10134385, | Mar 02 2012 | Apple Inc.; Apple Inc | Systems and methods for name pronunciation |
10152858, | May 09 2016 | COBAN TECHNOLOGIES, INC | Systems, apparatuses and methods for triggering actions based on data capture and characterization |
10152859, | May 09 2016 | COBAN TECHNOLOGIES, INC | Systems, apparatuses and methods for multiplexing and synchronizing audio recordings |
10165171, | Jan 22 2016 | COBAN TECHNOLOGIES, INC | Systems, apparatuses, and methods for controlling audiovisual apparatuses |
10169329, | May 30 2014 | Apple Inc. | Exemplar-based natural language processing |
10170123, | May 30 2014 | Apple Inc | Intelligent assistant for home automation |
10176167, | Jun 09 2013 | Apple Inc | System and method for inferring user intent from speech inputs |
10185542, | Jun 09 2013 | Apple Inc | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
10186254, | Jun 07 2015 | Apple Inc | Context-based endpoint detection |
10192552, | Jun 10 2016 | Apple Inc | Digital assistant providing whispered speech |
10199051, | Feb 07 2013 | Apple Inc | Voice trigger for a digital assistant |
10223066, | Dec 23 2015 | Apple Inc | Proactive assistance based on dialog communication between devices |
10237067, | Sep 30 2002 | MYPORT TECHNOLOGIES, INC | Apparatus for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval |
10241644, | Jun 03 2011 | Apple Inc | Actionable reminder entries |
10241752, | Sep 30 2011 | Apple Inc | Interface for a virtual digital assistant |
10249300, | Jun 06 2016 | Apple Inc | Intelligent list reading |
10255907, | Jun 07 2015 | Apple Inc. | Automatic accent detection using acoustic models |
10269345, | Jun 11 2016 | Apple Inc | Intelligent task discovery |
10276170, | Jan 18 2010 | Apple Inc. | Intelligent automated assistant |
10283110, | Jul 02 2009 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
10289433, | May 30 2014 | Apple Inc | Domain specific language for encoding assistant dialog |
10297253, | Jun 11 2016 | Apple Inc | Application integration with a digital assistant |
10311134, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
10311871, | Mar 08 2015 | Apple Inc. | Competing devices responding to voice triggers |
10318871, | Sep 08 2005 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
10325011, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
10354011, | Jun 09 2016 | Apple Inc | Intelligent automated assistant in a home environment |
10356243, | Jun 05 2015 | Apple Inc. | Virtual assistant aided communication with 3rd party service in a communication session |
10366158, | Sep 29 2015 | Apple Inc | Efficient word encoding for recurrent neural network language models |
10370102, | May 09 2016 | COBAN TECHNOLOGIES, INC | Systems, apparatuses and methods for unmanned aerial vehicle |
10381016, | Jan 03 2008 | Apple Inc. | Methods and apparatus for altering audio output signals |
10410637, | May 12 2017 | Apple Inc | User-specific acoustic models |
10431204, | Sep 11 2014 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
10446141, | Aug 28 2014 | Apple Inc. | Automatic speech recognition based on user feedback |
10446143, | Mar 14 2016 | Apple Inc | Identification of voice inputs providing credentials |
10475446, | Jun 05 2009 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
10482874, | May 15 2017 | Apple Inc | Hierarchical belief states for digital assistants |
10490187, | Jun 10 2016 | Apple Inc | Digital assistant providing automated status report |
10496753, | Jan 18 2010 | Apple Inc.; Apple Inc | Automatically adapting user interfaces for hands-free interaction |
10497365, | May 30 2014 | Apple Inc. | Multi-command single utterance input method |
10509862, | Jun 10 2016 | Apple Inc | Dynamic phrase expansion of language input |
10521466, | Jun 11 2016 | Apple Inc | Data driven natural language event detection and classification |
10552013, | Dec 02 2014 | Apple Inc. | Data detection |
10553209, | Jan 18 2010 | Apple Inc. | Systems and methods for hands-free notification summaries |
10553215, | Sep 23 2016 | Apple Inc. | Intelligent automated assistant |
10567477, | Mar 08 2015 | Apple Inc | Virtual assistant continuity |
10568032, | Apr 03 2007 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
10592095, | May 23 2014 | Apple Inc. | Instantaneous speaking of content on touch devices |
10593346, | Dec 22 2016 | Apple Inc | Rank-reduced token representation for automatic speech recognition |
10607140, | Jan 25 2010 | NEWVALUEXCHANGE LTD. | Apparatuses, methods and systems for a digital conversation management platform |
10607141, | Jan 25 2010 | NEWVALUEXCHANGE LTD. | Apparatuses, methods and systems for a digital conversation management platform |
10642953, | Dec 26 2012 | PHILIPS IMAGE GUIDED THERAPY CORPORATION | Data labeling and indexing in a multi-modality medical imaging system |
10657961, | Jun 08 2013 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
10659851, | Jun 30 2014 | Apple Inc. | Real-time digital assistant knowledge updates |
10671428, | Sep 08 2015 | Apple Inc | Distributed personal assistant |
10679605, | Jan 18 2010 | Apple Inc | Hands-free list-reading by intelligent automated assistant |
10691473, | Nov 06 2015 | Apple Inc | Intelligent automated assistant in a messaging environment |
10705794, | Jan 18 2010 | Apple Inc | Automatically adapting user interfaces for hands-free interaction |
10706373, | Jun 03 2011 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
10706841, | Jan 18 2010 | Apple Inc. | Task flow identification based on user intent |
10721066, | Sep 30 2002 | MYPORT TECHNOLOGIES, INC | Method for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval |
10733993, | Jun 10 2016 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
10747498, | Sep 08 2015 | Apple Inc | Zero latency digital assistant |
10755703, | May 11 2017 | Apple Inc | Offline personal assistant |
10762293, | Dec 22 2010 | Apple Inc.; Apple Inc | Using parts-of-speech tagging and named entity recognition for spelling correction |
10789041, | Sep 12 2014 | Apple Inc. | Dynamic thresholds for always listening speech trigger |
10789840, | May 09 2016 | COBAN TECHNOLOGIES, INC | Systems, apparatuses and methods for detecting driving behavior and triggering actions based on detected driving behavior |
10791176, | May 12 2017 | Apple Inc | Synchronization and task delegation of a digital assistant |
10791216, | Aug 06 2013 | Apple Inc | Auto-activating smart responses based on activities from remote devices |
10795541, | Jun 03 2011 | Apple Inc. | Intelligent organization of tasks items |
10810274, | May 15 2017 | Apple Inc | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
10839427, | Jun 18 2002 | MOBILE DATA TECHNOLOGIES, LLC | Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks |
10904611, | Jun 30 2014 | Apple Inc. | Intelligent automated assistant for TV user interactions |
10978090, | Feb 07 2013 | Apple Inc. | Voice trigger for a digital assistant |
10984326, | Jan 25 2010 | NEWVALUEXCHANGE LTD. | Apparatuses, methods and systems for a digital conversation management platform |
10984327, | Jan 25 2010 | NEW VALUEXCHANGE LTD. | Apparatuses, methods and systems for a digital conversation management platform |
11010550, | Sep 29 2015 | Apple Inc | Unified language modeling framework for word prediction, auto-completion and auto-correction |
11025565, | Jun 07 2015 | Apple Inc | Personalized prediction of responses for instant messaging |
11037565, | Jun 10 2016 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
11069347, | Jun 08 2016 | Apple Inc. | Intelligent automated assistant for media exploration |
11080012, | Jun 05 2009 | Apple Inc. | Interface for a virtual digital assistant |
11087759, | Mar 08 2015 | Apple Inc. | Virtual assistant activation |
11120372, | Jun 03 2011 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
11133008, | May 30 2014 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
11152002, | Jun 11 2016 | Apple Inc. | Application integration with a digital assistant |
11217255, | May 16 2017 | Apple Inc | Far-field extension for digital assistant services |
11232251, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
11257504, | May 30 2014 | Apple Inc. | Intelligent assistant for home automation |
11405466, | May 12 2017 | Apple Inc. | Synchronization and task delegation of a digital assistant |
11410053, | Jan 25 2010 | NEWVALUEXCHANGE LTD. | Apparatuses, methods and systems for a digital conversation management platform |
11423681, | Jan 30 2017 | Canon Kabushiki Kaisha | Image processing apparatus, method of controlling the same, and storage medium |
11423886, | Jan 18 2010 | Apple Inc. | Task flow identification based on user intent |
11500672, | Sep 08 2015 | Apple Inc. | Distributed personal assistant |
11526368, | Nov 06 2015 | Apple Inc. | Intelligent automated assistant in a messaging environment |
11526911, | Jun 18 2002 | Mobile Data Technologies LLC | Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks |
11556230, | Dec 02 2014 | Apple Inc. | Data detection |
11587559, | Sep 30 2015 | Apple Inc | Intelligent device identification |
11830266, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
12087308, | Jan 18 2010 | Apple Inc. | Intelligent automated assistant |
6657661, | Jun 20 2000 | HEWLETT-PACKARD DEVELOPMENT COMPANY L P | Digital camera with GPS enabled file management and a device to determine direction |
6829624, | Jan 29 2001 | FUJIFILM Corporation | Data processing method for digital camera |
6833865, | Sep 01 1998 | MICRO FOCUS LLC | Embedded metadata engines in digital capture devices |
6862038, | Feb 11 2000 | CHEMTRON RESEARCH LLC | Efficient image categorization |
6877134, | Aug 14 1997 | MICRO FOCUS LLC | Integrated data and real-time metadata capture system and method |
7002625, | Nov 24 2000 | Canon Kabushiki Kaisha | Image pickup apparatus for recording a photographed image in a directory |
7003113, | Jul 23 1999 | HTC Corporation | Position authentication system and electronic equipment using the same |
7007243, | Dec 20 2000 | Monument Peak Ventures, LLC | Method and apparatus for producing digital images with embedded image capture location icons |
7015969, | Dec 07 1999 | HEWLETT-PACKARD DEVELOPMENT COMPANY L P | Hand-held image capture apparatus with scanning arrangement |
7016899, | Sep 21 2000 | Lenovo PC International | Camera device, methods and program products for location and environmental stamping of images, communications and other applications |
7163151, | Dec 19 2003 | Nokia Technologies Oy | Image handling using a voice tag |
7184573, | Sep 30 2002 | MYPORT IP, INC | Apparatus for capturing information as a file and enhancing the file with embedded information |
7228010, | Feb 27 2003 | AT&T Corp.; AT&T Corp | Systems, methods and devices for determining and assigning descriptive filenames to digital images |
7324943, | Oct 02 2003 | Panasonic Intellectual Property Corporation of America | Voice tagging, voice annotation, and speech recognition for portable devices with optional post processing |
7391445, | Mar 31 2004 | Magix Software GmbH | System and method of creating multilayered digital images in real time |
7403224, | Sep 01 1998 | MICRO FOCUS LLC | Embedded metadata engines in digital capture devices |
7411606, | Feb 11 2000 | CHEMTRON RESEARCH LLC | Efficient image categorization |
7414651, | Feb 11 2000 | CHEMTRON RESEARCH LLC | Efficient image categorization |
7453501, | Jul 15 2002 | Ricoh Company, LTD | Imaging apparatus |
7460738, | Feb 27 2003 | AT&T Intellectual Property II, L.P. | Systems, methods and devices for determining and assigning descriptive filenames to digital images |
7483061, | Sep 26 2005 | Monument Peak Ventures, LLC | Image and audio capture with mode selection |
7532245, | Sep 28 1999 | Olympus Corporation | Digital printer and digital camera |
7603686, | Nov 30 2000 | Sony Corporation; Justsystem Corporation | Information processing method and apparatus and recording medium |
7676491, | Jan 25 2006 | OCE-Technologies B.V. | Method and system for accessing a file system |
7707239, | Nov 01 2004 | Scenera Technologies, LLC | Using local networks for location information and image tagging |
7719576, | Jun 14 2004 | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | Method and apparatus for tagging digital photographs with geographic location data |
7769827, | Apr 07 2000 | MICRO FOCUS LLC | Interactive video application hosting |
7778438, | Sep 30 2002 | MYPORT TECHNOLOGIES, INC | Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval |
7778440, | Sep 30 2002 | MYPORT IP, INC | Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval |
7787041, | Apr 05 2001 | SANYO ELECTRIC CO , LTD | Image reproduction apparatus |
7822746, | Nov 18 2005 | JOLLY SEVEN, SERIES 70 OF ALLIED SECURITY TRUST I | System and method for tagging images based on positional information |
7868920, | Sep 22 2005 | LG Electronics Inc | Mobile communication terminal having function of photographing moving picture, and method for operating same |
7877766, | May 04 2000 | Xenogenic Development Limited Liability Company | Method and system of providing a non-skippable sub-advertisement stream |
7912366, | Dec 11 2006 | Kyocera Corporation | System and method for providing photograph location information in a wireless communication device |
7962948, | Apr 07 2000 | FLASH UPLINK LLC | Video-enabled community building |
7978232, | Feb 05 2004 | HERE GLOBAL B V | Photograph location stamp |
8001124, | Nov 18 2005 | JOLLY SEVEN, SERIES 70 OF ALLIED SECURITY TRUST I | System and method for tagging images based on positional information |
8027561, | Aug 24 2006 | AT&T Intellectual Property I, L.P. | Methods, devices and computer program products for event-based media file tagging |
8060574, | Sep 28 2006 | QURIO Holdings, Inc. | System and method providing quality based peer review and distribution of digital content |
8068638, | Sep 30 2002 | MYPORT IP, INC | Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval |
8107130, | Sep 06 2004 | Oki Data Corporation | Image processing device |
8135169, | Sep 30 2002 | MYPORT IP, INC | Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval |
8171509, | Apr 07 2000 | VL IP HOLDINGS LLC; VL COLLECTIVE IP LLC | System and method for applying a database to video multimedia |
8184916, | Dec 26 2001 | Monument Peak Ventures, LLC | Method for creating and using affective information in a digital imaging system |
8301995, | Jun 22 2006 | Qualcomm Incorporated | Labeling and sorting items of digital data by use of attached annotations |
8359314, | Nov 18 2005 | JOLLY SEVEN, SERIES 70 OF ALLIED SECURITY TRUST I | System and method for tagging images based on positional information |
8375283, | Jun 20 2006 | Nokia Technologies Oy | System, device, method, and computer program product for annotating media files |
8387087, | Apr 07 2000 | Hewlett Packard Enterprise Development LP | System and method for applying a database to video multimedia |
8471925, | Mar 08 2007 | SAMSUNG ELECTRONICS CO , LTD | Digital image processing apparatus and file managing method performed therein |
8495694, | Apr 07 2000 | Hewlett Packard Enterprise Development LP | Video-enabled community building |
8509477, | Sep 30 2002 | MyPort Technologies, Inc. | Method for multi-media capture, transmission, conversion, metatags creation, storage and search retrieval |
8548978, | Apr 07 2000 | MICRO FOCUS LLC | Network video guide and spidering |
8558919, | Dec 30 2009 | Malikie Innovations Limited | Filing digital images using voice input |
8630496, | Dec 26 2001 | Monument Peak Ventures, LLC | Method for creating and using affective information in a digital imaging system |
8687841, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method for embedding searchable information into a file, encryption, transmission, storage and retrieval |
8724004, | Oct 01 2009 | Microsoft Technology Licensing, LLC | Mobile terminal and tag editing method thereof |
8803980, | May 29 2007 | Malikie Innovations Limited | System and method for selecting a geographic location to associate with an object |
8842197, | Nov 30 2005 | Scenera Mobile Technologies, LLC | Automatic generation of metadata for a digital image based on ambient conditions |
8892446, | Jan 18 2010 | Apple Inc. | Service orchestration for intelligent automated assistant |
8903716, | Jan 18 2010 | Apple Inc. | Personalized vocabulary for digital assistant |
8930191, | Jan 18 2010 | Apple Inc | Paraphrasing of user requests and results by automated digital assistant |
8942986, | Jan 18 2010 | Apple Inc. | Determining user intent based on ontologies of domains |
8964850, | Jul 08 2008 | Monument Peak Ventures, LLC | Method, apparatus and system for converging images encoded using different standards |
8983119, | Sep 30 2002 | MyPort Technologies, Inc. | Method for voice command activation, multi-media capture, transmission, speech conversion, metatags creation, storage and search retrieval |
9013600, | Dec 30 2009 | Malikie Innovations Limited | Filing digital images using voice input |
9032039, | Jun 18 2002 | MOBILE DATA TECHNOLOGIES, LLC | Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks |
9070193, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method to embed searchable information into a file, encryption, transmission, storage and retrieval |
9082046, | Dec 26 2001 | Monument Peak Ventures, LLC | Method for creating and using affective information in a digital imaging system |
9117447, | Jan 18 2010 | Apple Inc. | Using event alert text as input to an automated assistant |
9159113, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval |
9223769, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
9225527, | Aug 29 2014 | Coban Technologies, Inc. | Hidden plug-in storage drive for data integrity |
9262612, | Mar 21 2011 | Apple Inc.; Apple Inc | Device access using voice authentication |
9300784, | Jun 13 2013 | Apple Inc | System and method for emergency calls initiated by voice command |
9307317, | Aug 29 2014 | Coban Technologies, Inc. | Wireless programmable microphone apparatus and system for integrated surveillance system devices |
9318108, | Jan 18 2010 | Apple Inc.; Apple Inc | Intelligent automated assistant |
9330720, | Jan 03 2008 | Apple Inc. | Methods and apparatus for altering audio output signals |
9338493, | Jun 30 2014 | Apple Inc | Intelligent automated assistant for TV user interactions |
9338520, | Apr 07 2000 | VL IP HOLDINGS LLC; VL COLLECTIVE IP LLC | System and method for applying a database to video multimedia |
9342534, | Nov 30 2005 | Scenera Mobile Technologies, LLC | Automatic generation of metadata for a digital image based on meterological conditions |
9368114, | Mar 14 2013 | Apple Inc. | Context-sensitive handling of interruptions |
9430463, | May 30 2014 | Apple Inc | Exemplar-based natural language processing |
9430720, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
9483461, | Mar 06 2012 | Apple Inc.; Apple Inc | Handling speech synthesis of content for multiple languages |
9495129, | Jun 29 2012 | Apple Inc. | Device, method, and user interface for voice-activated navigation and browsing of a document |
9502031, | May 27 2014 | Apple Inc.; Apple Inc | Method for supporting dynamic grammars in WFST-based ASR |
9508027, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
9535906, | Jul 31 2008 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
9548050, | Jan 18 2010 | Apple Inc. | Intelligent automated assistant |
9558402, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
9576574, | Sep 10 2012 | Apple Inc. | Context-sensitive handling of interruptions by intelligent digital assistant |
9582608, | Jun 07 2013 | Apple Inc | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
9589309, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval |
9619578, | Jun 18 2002 | MOBILE DATA TECHNOLOGIES, LLC | Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks |
9620104, | Jun 07 2013 | Apple Inc | System and method for user-specified pronunciation of words for speech synthesis and recognition |
9620105, | May 15 2014 | Apple Inc. | Analyzing audio input for efficient speech and music recognition |
9626955, | Apr 05 2008 | Apple Inc. | Intelligent text-to-speech conversion |
9633004, | May 30 2014 | Apple Inc.; Apple Inc | Better resolution when referencing to concepts |
9633660, | Feb 25 2010 | Apple Inc. | User profiling for voice input processing |
9633674, | Jun 07 2013 | Apple Inc.; Apple Inc | System and method for detecting errors in interactions with a voice-based digital assistant |
9646609, | Sep 30 2014 | Apple Inc. | Caching apparatus for serving phonetic pronunciations |
9646614, | Mar 16 2000 | Apple Inc. | Fast, language-independent method for user authentication by voice |
9668024, | Jun 30 2014 | Apple Inc. | Intelligent automated assistant for TV user interactions |
9668121, | Sep 30 2014 | Apple Inc. | Social reminders |
9684728, | Apr 07 2000 | MICRO FOCUS LLC | Sharing video |
9697820, | Sep 24 2015 | Apple Inc. | Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks |
9697822, | Mar 15 2013 | Apple Inc. | System and method for updating an adaptive speech recognition model |
9711141, | Dec 09 2014 | Apple Inc. | Disambiguating heteronyms in speech synthesis |
9715875, | May 30 2014 | Apple Inc | Reducing the need for manual start/end-pointing and trigger phrases |
9721566, | Mar 08 2015 | Apple Inc | Competing devices responding to voice triggers |
9734193, | May 30 2014 | Apple Inc. | Determining domain salience ranking from ambiguous words in natural speech |
9760559, | May 30 2014 | Apple Inc | Predictive text input |
9785630, | May 30 2014 | Apple Inc. | Text prediction using combined word N-gram and unigram language models |
9798393, | Aug 29 2011 | Apple Inc. | Text correction processing |
9818400, | Sep 11 2014 | Apple Inc.; Apple Inc | Method and apparatus for discovering trending terms in speech requests |
9832017, | Sep 30 2002 | MYPORT TECHNOLOGIES, INC | Apparatus for personal voice assistant, location services, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatag(s)/ contextual tag(s), storage and search retrieval |
9842101, | May 30 2014 | Apple Inc | Predictive conversion of language input |
9842105, | Apr 16 2015 | Apple Inc | Parsimonious continuous-space phrase representations for natural language processing |
9858925, | Jun 05 2009 | Apple Inc | Using context information to facilitate processing of commands in a virtual assistant |
9865248, | Apr 05 2008 | Apple Inc. | Intelligent text-to-speech conversion |
9865280, | Mar 06 2015 | Apple Inc | Structured dictation using intelligent automated assistants |
9886432, | Sep 30 2014 | Apple Inc. | Parsimonious handling of word inflection via categorical stem + suffix N-gram language models |
9886953, | Mar 08 2015 | Apple Inc | Virtual assistant activation |
9899019, | Mar 18 2015 | Apple Inc | Systems and methods for structured stem and suffix language models |
9922348, | Jun 18 2002 | MOBILE DATA TECHNOLOGIES, LLC | Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks |
9922391, | Sep 30 2002 | MyPort Technologies, Inc. | System for embedding searchable information, encryption, signing operation, transmission, storage and retrieval |
9922642, | Mar 15 2013 | Apple Inc. | Training an at least partial voice command system |
9934775, | May 26 2016 | Apple Inc | Unit-selection text-to-speech synthesis based on predicted concatenation parameters |
9953013, | Sep 21 2011 | PatNotate LLC | Data processing systems, devices, and methods for content analysis |
9953088, | May 14 2012 | Apple Inc. | Crowd sourcing information to fulfill user requests |
9959870, | Dec 11 2008 | Apple Inc | Speech recognition involving a mobile device |
9966060, | Jun 07 2013 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
9966065, | May 30 2014 | Apple Inc. | Multi-command single utterance input method |
9966068, | Jun 08 2013 | Apple Inc | Interpreting and acting upon commands that involve sharing information with remote devices |
9971774, | Sep 19 2012 | Apple Inc. | Voice-based media searching |
9972304, | Jun 03 2016 | Apple Inc | Privacy preserving distributed evaluation framework for embedded personalized systems |
9986419, | Sep 30 2014 | Apple Inc. | Social reminders |
Patent | Priority | Assignee | Title |
5335072, | May 30 1990 | Minolta Camera Kabushiki Kaisha | Photographic system capable of storing information on photographed image data |
5345309, | Oct 10 1991 | Ball Corporation | Precision three dimensional profiling and measurement system for cylindrical containers |
5477511, | Jul 13 1994 | Portable documentation system | |
5633678, | Dec 20 1995 | Eastman Kodak Company | Electronic still camera for capturing and categorizing images |
5692225, | Aug 30 1994 | Eastman Kodak Company | Voice recognition of recorded messages for photographic printers |
5734794, | Jun 22 1995 | Method and system for voice-activated cell animation | |
5796428, | Oct 21 1993 | FIPA Frohwitter Intellectual Property AG | Electronic photography system |
5825408, | Mar 31 1993 | Casio Computer Co., Ltd. | Portable compact imaging and displaying apparatus |
5974386, | Sep 12 1996 | Nikon Corporation | Timeline display of sound characteristics with thumbnail video |
6012028, | Mar 10 1997 | Ricoh Company, LTD | Text to speech conversion system and method that distinguishes geographical names based upon the present position |
6064959, | Mar 28 1997 | Nuance Communications, Inc | Error correction in speech recognition |
6111605, | Nov 06 1995 | Ricoh Company, LTD | Digital still video camera, image data output system for digital still video camera, frame for data relay for digital still video camera, data transfer system for digital still video camera, and image regenerating apparatus |
6128446, | Dec 11 1997 | Eastman Kodak Company | Method and apparatus for annotation of photographic film in a camera |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Feb 26 1999 | Sony Corporation | (assignment on the face of the patent) | / | |||
Feb 26 1999 | Sony Electronics, Inc. | (assignment on the face of the patent) | / | |||
Mar 25 1999 | ABRAM, PHILIP MICHAEL | Sony Electronics, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 009880 | /0529 | |
Mar 25 1999 | ABRAM, PHILIP MICHAEL | Sony Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 009880 | /0529 | |
Mar 29 1999 | SATO, ROBERT J | Sony Electronics, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 009880 | /0529 | |
Mar 29 1999 | SATO, ROBERT J | Sony Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 009880 | /0529 |
Date | Maintenance Fee Events |
Apr 10 2006 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Oct 10 2006 | ASPN: Payor Number Assigned. |
Oct 10 2006 | RMPN: Payer Number De-assigned. |
Apr 08 2010 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Apr 08 2014 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Oct 08 2005 | 4 years fee payment window open |
Apr 08 2006 | 6 months grace period start (w surcharge) |
Oct 08 2006 | patent expiry (for year 4) |
Oct 08 2008 | 2 years to revive unintentionally abandoned end. (for year 4) |
Oct 08 2009 | 8 years fee payment window open |
Apr 08 2010 | 6 months grace period start (w surcharge) |
Oct 08 2010 | patent expiry (for year 8) |
Oct 08 2012 | 2 years to revive unintentionally abandoned end. (for year 8) |
Oct 08 2013 | 12 years fee payment window open |
Apr 08 2014 | 6 months grace period start (w surcharge) |
Oct 08 2014 | patent expiry (for year 12) |
Oct 08 2016 | 2 years to revive unintentionally abandoned end. (for year 12) |