A portable image transfer system includes a digital still camera which captures images in digital form and stores the images in a camera memory, a cellular telephone transmitter, and a central processing unit (CPU). The CPU controls the camera memory to cause it to output data representing an image and the CPU controls the cellular telephone transmitter to cause a cellular telephone to transmit the data received from the camera memory. A receiving station is coupled to the cellular telephone transmitter by a cellular network to receive image data and store the images.
|
0. 45. A telecommunication system comprising:
a communication component for receiving image data originating from a cellular telephone device;
an image data store for storing the image data;
a return link for sending commands to the cellular telephone device; and
a controller coupled to the communication component and to the image data store, the controller configured to process the image data and to communicate the image data over the internet to a receiving station, the receiving station having image processing means,
wherein the image data is transmitted to the receiving station when the receiving station transmits a first command to the cellular telephone device to obtain further images needed by the image processing means.
0. 19. A portable image transfer system comprising:
a digital still camera, at a remote station, which captures one or more images in digital form and stores the images in a camera memory;
a cellular telephone transmitter for communication with a receiving station, the receiving station having an image processor;
a central processing unit (CPU); and
a return link for receiving commands from the receiving station to the CPU to obtain further images as needed by the image processor,
the CPU being coupled to the camera memory and the cellular telephone transmitter, the CPU being configured to control the camera memory to produce output data representing the images formatted as one or more electronic mail messages, the CPU further being configured to control the cellular telephone transmitter to transmit the output data from the camera memory to the receiving station.
0. 57. A portable image transfer apparatus comprising:
a cellular telephone transmitter component;
an image capture component for producing digital images;
a memory operatively coupled to the image capture interface to receive and store one or more digital images;
a controller coupled to the memory and to the cellular telephone transmitter, the controller configured to produce output data representing the images, the controller further configured to control the cellular telephone transmitter to communicate with a receiving station to transmit the output data from the camera memory to the receiving station, the receiving station having an image processor; and
a link for receiving data from the receiving station,
wherein the output data is transmitted to the receiving station when the receiving station transmits a first command to the portable image transfer apparatus to obtain further images as needed by the image processor.
0. 29. A portable image transfer apparatus comprising:
a cellular telephone transmitter component;
an image capture component for producing digital images;
a memory operatively coupled to the image capture interface to receive and store one or more digital images;
a controller coupled to the memory and to the cellular telephone transmitter component, the controller configured to produce output data representing the images, the controller further configured to control the cellular telephone transmitter component to communicate with a receiving station to transmit the output data from the memory to the receiving station, the receiving station having image processing means; and
a return link for receiving commands from the receiving station,
wherein the output data is transmitted to the receiving station when the receiving station transmits a first command to the portable image transfer apparatus to obtain further images needed by the image processing means.
0. 24. A portable image transfer system comprising:
a digital still camera, at a remote station, which captures one or more images in digital form and stores the images in a camera memory;
a cellular telephone transmitter for communication with a receiving station, the receiving station having an image processor;
circuitry to produce information relating to the location of the portable image transfer system;
a central processing unit (CPU); and
a return link for receiving commands from the receiving station to the CPU to obtain further images as needed by the image processor,
the CPU being coupled to the camera memory, to the circuitry, and to the cellular telephone transmitter, the CPU being configured to control the camera memory to produce output data representing a combination of the images and the location information, the CPU further being configured to control the cellular telephone transmitter to transmit the output data from the camera memory to the receiving station.
0. 47. A portable image transfer system comprising:
a digital still camera, at a remote station, which captures one or more images in digital form and stores the images in a camera memory;
a cellular telephone transmitter for communication with a receiving station, the receiving station having means for image processing;
a central processing unit (CPU); and
a link for receiving data from the receiving station to the CPU,
the CPU being coupled to the camera memory and the cellular telephone transmitter, the CPU being configured to control the camera memory to produce output data representing the images formatted as one or more electronic mail messages, the CPU further being configured to control the cellular telephone transmitter to transmit the output data from the camera memory to the receiving station,
wherein the output data is transmitted to the receiving station when the receiving station transmits a first command to the portable image transfer system to obtain further images needed by the means for image processing.
0. 15. A portable image transfer system comprising:
a digital still camera, at a remote station, which captures images in digital form and stores the images in a camera memory;
a cellular telephone transmitter;
a central processing unit (CPU) coupled to the camera memory and the cellular telephone transmitter, wherein the CPU controls the camera memory to cause it to output data representing an image and the CPU controls the cellular telephone transmitter to cause a cellular telephone to transmit the data output from the camera memory;
a receiving station coupled to the cellular telephone transmitter by a cellular network to receive image data;
means, at the receiving station, for image processing;
means for resetting the camera memory to be reused for subsequent images;
a return link for sending commands from the receiving station to the CPU, wherein the commands are directions for obtaining further images as needed by the means for image processing; and
an image storage device coupled to the receiving station to store images received by the receiving station.
1. A portable image transfer system comprising:
a digital still camera, at a remote station, which captures images in digital form and stores the images in a camera memory;
a cellular telephone transmitter;
a central processing unit (CPU) coupled to the camera memory and the cellular telephone transmitter, wherein the CPU controls the camera memory to cause it to output data representing an image and the CPU controls the cellular telephone transmitter to cause a cellular telephone to transmit the data output from the camera memory;
a receiving station coupled to the cellular telephone transmitter by a cellular network to receive image data;
means, at the receiving station, for image processing;
means for resetting the camera memory to be reused for subsequent images once an image is transmitted to the receiving station;
a return link for sending commands from the receiving station to the CPU, wherein the commands are directions for obtaining further images as needed by the means for image processing; and
an image storage device coupled to the receiving station to store images received by the receiving station.
0. 52. A portable image transfer system comprising:
a digital still camera, at a remote station, which captures one or more images in digital form and stores the images in a camera memory;
a cellular telephone transmitter for communication with a receiving station, the receiving station having means for image processing;
circuitry to produce information relating to the location of the portable image transfer system;
a central processing unit (CPU); and
a link for receiving data from the receiving station to the CPU,
the CPU being coupled to the camera memory, to the circuitry, and to the cellular telephone transmitter, the CPU being configured to control the camera memory to produce output data representing a combination of the images and the location information, the CPU further being configured to control the cellular telephone transmitter to transmit the output data from the camera memory to the receiving station,
wherein the output data is transmitted to the receiving station when the receiving station transmits a first command to the portable image transfer apparatus to obtain further images needed by the means for image processing.
2. The apparatus of
3. The apparatus of
a standard cellular telephone; and
a cellular modem.
4. The apparatus of
5. The apparatus of
6. The apparatus of
7. The apparatus of
8. The apparatus of
9. The apparatus of
10. The apparatus of
11. The apparatus of
12. The apparatus of
13. The apparatus of
0. 14. The apparatus of
0. 16. The apparatus of
0. 17. The apparatus of
0. 18. The apparatus of
0. 20. The portable image transfer system of
0. 21. The portable image transfer system of
0. 22. The portable image transfer system of
0. 23. The portable image transfer system of
0. 25. The portable image transfer system of
0. 26. The portable image transfer system of
0. 27. The portable image transfer system of
0. 28. The portable image transfer system of
0. 30. The portable image transfer system of
0. 31. The portable image transfer system of
0. 32. The portable image transfer system of
0. 33. The portable image transfer system of
0. 34. The portable image transfer system of
0. 35. The portable image transfer system of
0. 36. The portable image transfer system of
0. 37. The portable image transfer system of
0. 38. The portable image transfer system of
0. 39. The portable image transfer system of
0. 40. A telecommunication system comprising:
a communication component for receiving image data originating from a cellular telephone device;
an image data store for storing the image data;
a return link for sending commands to the cellular telephone device; and
a controller coupled to the communication component and to the image data store, the controller configured to process the image data and to communicate the image data over the internet to a receiving station,
wherein the cellular telephone device is an image transfer apparatus as recited in
wherein the image data is transmitted to the receiving station when the receiving station transmits a first command to the cellular telephone device.
0. 41. An image processing system comprising:
a communication component for receiving image data originating from a cellular telephone device, the cellular telephone device comprising an image transfer apparatus as recited in
an image data store for storing the image data; and
a controller coupled to the communication component and to the image data store, the controller configured to process the image data and to communicate the image data over the internet.
0. 42. The image processing system of
0. 43. An image processing system comprising:
a communication component for receiving image data originating from a cellular telephone device, the cellular telephone device comprising an image transfer apparatus as recited in
an image data store for storing the image data; and
a controller coupled to the communication component and to the image data store, the controller configured to process the image data and to communicate the image data over the internet.
0. 44. The portable image transfer system of
0. 46. The telecommunication system of
0. 48. The portable image transfer system of
0. 49. The portable image transfer system of
0. 50. The portable image transfer system of
0. 51. The portable image transfer system of
0. 53. The portable image transfer system of
0. 54. The portable image transfer system of
0. 55. The portable image transfer system of
0. 56. The portable image transfer system of
0. 58. The portable image transfer system of
0. 59. The portable image transfer system of
0. 60. An image processing system comprising:
a communication component for receiving image data originating from a cellular telephone device, the cellular telephone device comprising an image transfer apparatus as recited in
an image data store for storing the image data; and
a controller coupled to the communication component and to the image data store, the controller configured to process the image data and to communicate the image data over the internet.
0. 61. The portable image transfer system of
0. 62. The portable image transfer system of
0. 63. The portable image transfer system of
0. 64. The portable image transfer system of
0. 65. The portable image transfer system of
0. 66. The portable image transfer system of
a standard cellular telephone; and
a cellular modem.
0. 67. The portable image transfer system of
0. 68. The portable image transfer system of
0. 69. An image processing system comprising:
a communication component for receiving image data originating from a cellular telephone device, the cellular telephone device comprising an image transfer apparatus as recited in
an image data store for storing the image data; and
a controller coupled to the communication component and to the image data store, the controller configured to process the image data and to communicate the image data over the internet.
0. 70. The image processing system of
0. 71. The image processing system of
0. 72. The image processing system of
|
The present invention relates to the field of digital still video cameras (DSVC's). More specifically, one embodiment of the present invention provides for improved storage of images generated by a DSVC. A portable DSVC is convenient for taking pictures at various locations because of the cameras's size and weight. Unfortunately, as users have come to expect small weights and compact sizes for consumer electronics, DSVC's have tended to be limited in the number of images which could be stored. One solution to the problem is to add additional memory modules, but this is an expensive solution given that the memory modules must be miniaturized so as not to adversely affect the portability of the DSVC.
What is needed is a DSVC with a large image storage capacity where the image storage is not unduly expensive and does not unreasonably impact the size of the portable cameras.
An improved portable image capture system is provided by virtue of the present invention. In one embodiment, a central processing unit (CPU), a modem and a cellular telephone transmitter are coupled to an image memory of a DSVC. The CPU is also coupled to a display and a command input device, which might be a voice activated device or a touch screen device integrated with the display. The CPU executes programs as needed to download images through the cellular telephone transmitter to a server station according to a protocol optimized for the connection available. Where the connection is a direct cellular telephone line, data is sent through the cellular telephone transmitter to cellular telephone system and it is received by a modem at the server station. A CPU at the server station directs the file to be stored in a data storage device, which is typically a large-capacity, inexpensive device such as a hard drive.
In variations of the present invention, the server station might perform complex analysis of the received images in order to instruct the DSVC to obtain additional images which the server station determines are needed for the analyses. The analyses include image resolution enhancement, stereoscopic matching, photocopying, and the like, as well as subjective evaluation of camera angle and image compression. In a specific implementation, the server station transmits images back to the remote station for viewing or forwarding to a local facsimile device or digital camera.
A further understanding of the nature and advantages of the inventions herein may be realized by reference to the remaining portion of the specification and the attached drawing.
Referring to
Remote station 12 also includes a display 30 and a command input device 32 for interacting with the user of remote station 12 and accepting commands. The programs executed by CPU 22 are stored in a code EPROM 34 which respond to the commands sent by a user using input command device 32. Command input device 32 might be a voice activated device or a touch screen integrated with display 30. Code EPROM 34 includes code necessary to perform certain processing functions on an image before it is transmitted, such as a protocol packetizing program 36, an encryption module 38 and an e-mail handler 40.
Server station 14 is shown comprising modem 56 which is controlled by a CPU 52 which executes code stored in its own code EPROM 54. The programs stored in code EPROM 54 are instructions for CPU 52 to transfer data received by modem 56 into data storage device 58 while processing the received image to handle the requirements of the protocols used to send the image.
In one example of the operation of image transfer system 10, CPU 22 executes a program with instructions to periodically read an image from image memory 24 and mark the image as being read, allowing image memory 24 to be overwritten by subsequent images. As each image is read, the image data is encrypted and formatted as an electronic mail message. Where cellular system 16 is not a direct modem link, but a SLIP/PPP connection using TCP/IP, additional protocol packaging is performed on the image for transmission. When the images are received at server station 14, they are decrypted and unpackaged, then stored in data storage 58. If desired, some or all of the images in data storage 58 can be made available over the Internet. If a TCP/IP connection is used, CPU 20 might also execute a routine stored in code EPROM 34 to “ping” a destination before sending an image. The ping process sends a dummy message through a channel to determine whether or not the destination, such as server station 14, is available, ready and willing to receive data. If an affirmative response to the ping is received by remote station 12, only then does CPU 22 transmit the image package. If location information is to be included with each image, a Global Positioning System (GPS) receiver 60 can be coupled to CPU 22, such as a PCMCIA-compatible GPS receiver manufactured by Trimble Navigation of Sunnyvale, Calif.
Many uses of the present invention are contemplated, some of which are mentioned here, others of which are apparent after reading the disclosure. One use is the collection of vacation photos. Since the remote station is extremely portable, it is convenient for a vacationer to pack the remote station and carry it on their travels. When the capture of an image is desired, the vacationer activates remote station 12 using command input device 32, captures the image and, if image memory 24 is full, transmits images back to server station 14. This allows the vacationer to take as many pictures as desired without worrying about running out of film or image memory capacity, or needing to carry around sufficient memory to hold all the images from an entire trip.
Another application in television reporting. A field reporter could use the remote station to capture images at the scene of a news event and have those images transmitted to a server station controlled by the television studio, thus allowing up-to-the-minute news photos without requiring expensive and bulky equipment such as is now required in a news van.
In a typical operation, display 30 indicates the amount of free space remaining in image memory 24. When the user decides to free up additional memory by transmitting images already stored in image memory 24, the user initiates a command sequence using command input device 32. This begins the process of CPU 22 dialing a cellular number for server station 14 or otherwise setting up the link between remote station 12 and server station 14. CPU 22 then packages an image as required by the protocols, encryption or mailing procedures and directs the package as needed and flags the images in image memory 24 as being sent. One method for labeling images as being sent is to include a binary flag for each block of image memory 24 available for images. As an image is captured by capture device 20, the flag is set to indicate that the block is in use. As an image is transmitted by CPU 22, the flag is reset to indicate that the block is again available for image storage.
One application in which the present invention finds a use is in-field stereo image capture. With in-field stereo image capture, a camera is on location capturing an image and the server is processing the images. One problem with developing high quality stereo reconstructions is accuracy in image areas where the scene geometry changes quickly, i.e., sharp edges. The need for increased accuracy can be accommodated by capturing more images where needed to increase accuracy. Unfortunately, in the prior art, a photographer would either have to return from a site to process the images to determine if any more images are needed, often necessitating a second trip to the site, or have take the image processing computers to the site. With the present invention, images can be captured and sent to the server for processing with the server interactively responding with requests for the additional images. Thus, the server would process the captured images to determine if a good stereo image can be created. If portions of the stereo image are unacceptable, the server can signal, via the digital still video camera, the photographer to capture additional images.
Face recognition is a similar example. The capture device and the server could cooperate to interactively perform stereo matching, with the server requesting additional captures to improve face recognition. This would overcome the need for subjects to have stereo photographs stored in a laboratory.
Another use of the present invention is to obtain photocopies in locations, such as libraries, where it is not convenient to bring the item to be copied to a photocopy machine. At photocopier resolutions, a single uncompressed page image might require about 15 megabits of memory (1 bit/pixel ×400 dpix×8.5″×11″=1496 mbit). In order to reduce the memory requirements, the image can be compressed at the DSVC, but this requires considerable computation power at the DSVC. With the present invention, a low resolution image (e.g., 100 dpi) can be captured and sent to the server station. The server station then analyzes the low resolution image and identifies all white or black areas of the image as well as boundaries of the areas. To convert to a higher resolution image, the server represents each low resolution pixel with sixteen high resolution pixels. Where the image is all black or all white the high resolution pixels are correctly colored, while the blocks of sixteen high resolution pixels near an edge might not all be one color. To refine these areas, the server station sends image capture instructions to the DSVC instructing it to capture additional information from the edge areas.
Once the image is created at the server station with the desired high resolution, it can be sent to an printer or facsimile machine, typically one located near the user of the DSVC. A user of the DSVC desiring a photocopy could then indicate, using command input 32, the telephone number of a nearby facsimile machine. The DSVC would then obtain a low resolution image of the page of which a hard copy is desired, and send a low resolution image to server station 14. Server station 14 then determines the areas of the image for which additional information is needed. Server station 14 communicates the locations of those areas on the image and the DSVC recaptures those areas of the image. The increased resolution required for the high resolution image can be obtained by using a higher resolution lens on the DSVC, or simply capturing multiple images at low resolution and averaging. The resulting image can be compressed by server station 14 if the printing device is a facsimile machine, so that server station 14 need only transmit a compressed facsimile file. Alternatively, server station 14 can retransmit the compressed file to remote station 12, which would then dial the facsimile machine directly through cellular telephone network 16.
In
Yet another application is stereoscopic matching. Suppose remote station 12 is carried by a geologist who is backpacking to a remote region and desires to capture three-dimensional (3D) images of a landscape. Stereoscopic images are formed from two images of one scene taken at slight offset of each other. In many stereoscopic systems, the precise relative position of the camera between the two images is needed. However, it is now possible to perform stereographic “matching” (alignment of the two images to create the 3D effect) without alignment information. One such system is the C3D technology sold by The Turing Institute of Glasgow, Scotland. Combining that system with the present invention, the geologist could upload the dual images and have a C3D system at the server station immediately evaluate the images to determine if a lock on a 3D image can be made. If not, the server station sends a message to the geologist to reposition the camera and recapture an image, thus avoiding a second trip to the site for image capture.
The above description is illustrative and not restrictive. Many variations of the invention will become apparent to those skilled in the art upon review of this disclosure. For example, the server station 14 can be either a stationary system or a semi-portable system, so long as it need not be as portable as remote station 12. Also, the remote station 12 might be controlled from server station 14 by allowing remote station 12 to receive command messages from server station 14 over cellular system 16. The scope of the invention should, therefore, be determined not with reference to the above description, but instead should be determined with reference to the appended claims along with their full scope of equivalents.
Hull, Jonathan J., Cullen, John F.
Patent | Priority | Assignee | Title |
10237067, | Sep 30 2002 | MYPORT, INC | Apparatus for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval |
10721066, | Sep 30 2002 | MYPORT, INC | Method for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval |
7778438, | Sep 30 2002 | MYPORT, INC | Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval |
7778440, | Sep 30 2002 | MYPORT IP, INC | Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval |
8060109, | Aug 04 1997 | Enovsys LLC | Authorized location reporting mobile communication system |
8068638, | Sep 30 2002 | MYPORT IP, INC | Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval |
8135169, | Sep 30 2002 | MYPORT IP, INC | Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval |
8195188, | Aug 04 1997 | SPRINT SPECTRUM, L P | Location reporting satellite paging system with optional blocking of location reporting |
8509477, | Sep 30 2002 | MyPort Technologies, Inc. | Method for multi-media capture, transmission, conversion, metatags creation, storage and search retrieval |
8559942, | Aug 04 1997 | Enovsys LLC | Updating a mobile device's location |
8577955, | Sep 29 2003 | OL SECURITY LIMITED LIABILITY COMPANY | Method and system for distributing images to client systems |
8687841, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method for embedding searchable information into a file, encryption, transmission, storage and retrieval |
8706078, | Aug 04 1997 | MERGENET SOLUTIONS, INC | Location reporting satellite paging system with privacy feature |
8949380, | Sep 29 2003 | OL SECURITY LIMITED LIABILITY COMPANY | Method and system for distributing images to client systems |
8983119, | Sep 30 2002 | MyPort Technologies, Inc. | Method for voice command activation, multi-media capture, transmission, speech conversion, metatags creation, storage and search retrieval |
9070193, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method to embed searchable information into a file, encryption, transmission, storage and retrieval |
9159113, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval |
9214037, | Sep 29 2003 | OL SECURITY LIMITED LIABILITY COMPANY | Method and system for distributing images to client systems |
9589309, | Sep 30 2002 | MyPort Technologies, Inc. | Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval |
9832017, | Sep 30 2002 | MYPORT, INC | Apparatus for personal voice assistant, location services, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatag(s)/ contextual tag(s), storage and search retrieval |
9922391, | Sep 30 2002 | MyPort Technologies, Inc. | System for embedding searchable information, encryption, signing operation, transmission, storage and retrieval |
Patent | Priority | Assignee | Title |
4884132, | Nov 25 1986 | DICAM, INC | Personal security system |
5151946, | Aug 24 1989 | NOKIA MOBILE PHONES U K LIMITED | Variable configuration portable telephone |
5177784, | Nov 15 1990 | Head-set telephone device and method | |
5220420, | Sep 27 1990 | ACTIVEVIDEO NETWORKS, INC | Interactive home information system for distributing compressed television programming |
5485504, | Aug 07 1991 | DRNC HOLDINGS, INC | Hand-held radiotelephone with video transmission and display |
5491507, | Oct 23 1992 | Hitachi, LTD | Video telephone equipment |
5546445, | Dec 26 1991 | EMSAT ADVANCED GEO-LOCATION TECHNOLOGY, LLC | Cellular telephone system that uses position of a mobile unit to make call management decisions |
5550646, | Sep 13 1993 | THE CHASE MANHATTAN BANK, AS COLLATERAL AGENT | Image communication system and method |
5557254, | Nov 16 1993 | IFLEET, INC | Programmable vehicle monitoring and security system having multiple access verification devices |
5557320, | Jan 31 1995 | Video mail delivery system | |
5579239, | Feb 16 1994 | SAMSUNG ELECTRONICS CO , LTD | Remote video transmission system |
5598536, | Aug 09 1994 | Dialogic Corporation | Apparatus and method for providing remote users with the same unique IP address upon each network access |
5606365, | Mar 28 1995 | Intellectual Ventures Fund 83 LLC | Interactive camera for network processing of captured images |
5666159, | Apr 24 1995 | SCA VENTURES, LLC | Electronic camera system with programmable transmission capability |
5712679, | Jan 16 1989 | COLES, CHRISTOPHER F , MR | Security system with method for locatable portable electronic camera image transmission to a remote receiver |
5726660, | Dec 01 1995 | CUFER ASSET LTD L L C | Personal data collection and reporting system |
5893037, | Dec 09 1994 | Apple Inc | Combined electronic/silver-halide image capture system with cellular transmission capability |
6028679, | Nov 13 1995 | NETFAX DEVELOPMENT, LLC; JOSEPH J BELLINGER AS CH 7 BANKRUPTCY TRUSTEE FOR NETFAX, INC | Internet global area networks fax system |
JP3109891, | |||
JP4117849, | |||
JP4150175, | |||
JP5167965, | |||
JP6133081, | |||
JP6152587, | |||
JP6268582, | |||
JP7046525, | |||
JP8032915, | |||
JP8046943, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 08 2000 | Ricoh Corporation | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Sep 18 2007 | ASPN: Payor Number Assigned. |
Jan 08 2010 | ASPN: Payor Number Assigned. |
Jan 08 2010 | RMPN: Payer Number De-assigned. |
Jan 29 2010 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Mar 20 2010 | 4 years fee payment window open |
Sep 20 2010 | 6 months grace period start (w surcharge) |
Mar 20 2011 | patent expiry (for year 4) |
Mar 20 2013 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 20 2014 | 8 years fee payment window open |
Sep 20 2014 | 6 months grace period start (w surcharge) |
Mar 20 2015 | patent expiry (for year 8) |
Mar 20 2017 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 20 2018 | 12 years fee payment window open |
Sep 20 2018 | 6 months grace period start (w surcharge) |
Mar 20 2019 | patent expiry (for year 12) |
Mar 20 2021 | 2 years to revive unintentionally abandoned end. (for year 12) |