Disclosed is an embroidery data creating device for creating an embroidery data to be used by a sewing machine. In the embroidery data creating device, an image data, which consists of a plurality of pixel data, corresponding to a line-drawn image is converted into a thin line image, and then closed paths are determined with use of 8-connection method. After embroidery attribution is applied to a path and/or a region defined by each closed path, the paths and/or the regions are converted into the embroidery data.
|
0. 21. A method for preparing sewing data of an embroidery pattern based on image data of the embroidery pattern comprising:
reducing thickness of lines in the image data to produce thin-line image data including at least one thin-line outline that defines a bounded region corresponding to a region of the embroidery pattern; and
extracting the bounded region defined by the at least one thin-line outline.
0. 20. An embroidery data processor for preparing sewing data of an embroidery pattern based on image data of the embroidery pattern, the embroidery data processor reducing thickness of lines in the image data to produce thin-line image data including at least one thin-line outline defining a bounded region corresponding to a region of the embroidery pattern, and
extracting the bounded region defined by the at least one thin-line outline.
14. A method for creating embroidery data to be used by a sewing machine, said method comprising the steps of:
storing image data corresponding to a line-drawn image;
applying a thinning operation to said image data to obtain a thin line image;
determining closed paths based on said thin line image;
selecting at least one of a path and a region defined by said path for each of said determined closed paths; and
converting said at least one of said path and said region defined by said path into said embroidery data.
1. An embroidery data creating device for creating embroidery data to be used by a sewing machine, said embroidery data creating device comprising:
means for storing image data corresponding to a line-drawn image;
means for applying a thinning operation to said image data to obtain a thin line image;
means for determining closed paths based on said thin line image;
means for selecting at least one of a path and a region defined by said path for each of said closed paths determined by said determining means; and
means for converting said at least one of said path and said region defined by said path into said embroidery data.
17. A computer readable memory medium for a computer program, said memory medium comprising a computer program, said computer program providing a method for creating embroidery data to be used by a sewing machine comprising the steps of:
storing image data corresponding to a line-drawn image;
applying a thinning operation to said image data to obtain a thin line image;
determining closed paths based on said thin line image;
selecting at least one of a path and a region defined by said path for each of said determined closed paths; and
converting said at least one of said path and said region defined by said path into said embroidery data.
2. The embroidery data creating device according to
3. The embroidery data creating device according to
4. The embroidery data creating device according to
5. The embroidery data creating device according to
6. The embroidery data creating device according to
7. The embroidery data creating device according to
8. The embroidery data creating device according to
9. The embroidery data creating device according to
10. The embroidery data creating device according to
11. The embroidery data creating device according to
12. The embroidery data creating device according to
13. The embroidery data creating device according to
15. The method according to
16. The method according to
18. The computer readable memory medium of
19. The computer readable memory medium of
|
The present invention relates to an embroidery data creating device for processing an outline data of an original image to create an embroidery data corresponding to the original image.
Presently, there are data creating devices that create embroidery data for use with industrial sewing machines. These data creating devices are computer controlled and are capable of creating high-accuracy embroidery data in a relatively short period of time. Usually these data creating devices are provided with a computer, an image scanner, a hard disk drive, and a CRT (Cathode Ray Tube) display, etc.
Recently, as the performance of personal sewing machines has improved, an embroidery data creating device for use with the personal sewing machine has been sought to satisfy an expanding demand. However, the data creating devices for the industrial sewing machines are complicated, expensive, and are not easy to operate for personal use. Therefore, an inexpensive, easily operable data creating device has been desired. Preferably, such devices are capable of creating embroidery data based on an original, e.g., a freehand line-drawn image drawn on a sheet of paper.
The conventional embroidery data creating devices do not have such a function, and therefore the operator traces an image, which is scanned by the image scanner and displayed on the CRT, with a mouse or the like. Alternatively, a digitizer or the like to create the digital data of the image to the computer should be used. In order to create the high-accuracy embroidery data for stitching a good looking embroidery, a plurality of paths of stitching, and closed regions to be filled with stitches as well as their positions and shapes should be input to the computer.
An embroidery data creating device, which automatically creates the embroidery data, for personal use was disclosed in Japanese Patent Provisional Publication HEI4-174699. The disclosed data creating device is provided with a microcomputer, a small display device, and a keyboard. The device is connected with a monochrome (e.g. black and white) image scanner, and creates the embroidery data as described below.
In this device, firstly the original image is scanned with use of the scanner. Then the scanned image is displayed on the display device. If the displayed image have the desired shape, the embroidery data corresponding to the displayed image is created.
In the embroidery data creating devices of the former type, the operator is required to designate a path of each stitch of the embroidery or to trace the displayed image manually and accurately. It is time consuming, and the larger the image is, the longer time is consumed.
In the embroidery data creating devices of the latter type, the embroidery data creating devices usually deal with a colored image, and do not have a function of processing an outline image or the line-drawn image. Therefore, the embroidery data crating devices of the latter type cannot create sufficient embroidery data, and accordingly the beautiful embroidery may not be produced with use of the embroidery data created based on the line-drawn image. That is, in order to have threads filled in areas defined by the outlines of an image, besides the data for the outlines, another data for the filled portion should be prepared separately. Therefore, in the latter devices, if a line-drawn image is used as an original data, it is difficult to have sufficient embroidery data.
Generally, there are two methods for dealing with an image pattern, i.e., for scanning the image pattern to generate an image data, and creating the embroidery data based on the image data. First one is to obtain a bit map image by scanning an original image. Then stitching points are determined based on the bit map image. The other one is to pick up an outline data (path data) by scanning the image pattern.
Assume that an image shown in
According to the latter method, the outline of the image pattern is obtained according to an edge detection algorithm. Since the outlines defining the regions are obtained, the embroidery data for an region defined by the obtained outline data can be made relatively easily. However, if a region defined by an outline has an elongated shape, it is difficult for a processor (e.g., a CPU) to recognize the direction in which the region is elongated. Generally, when a region is to be filled with a thread, the direction of stitching is fixed. If the elongated direction of the region can be determined, it may be possible to change the stitching direction in accordance with the elongated direction. However, since the elongated direction of the region is not easy to obtaine, the fixed direction is to be referred to in order to create the embroidery data for such a region. As a result, if the stiching direction is not appropriate for such an elongated region, the embroidery produced in accordance with the embroidery data created with use of the fixed stitching direction may not be sufficiently beautiful (see portions “NG” in FIG. 16B). To avoid the problem, various algorithms for automatically determining the direction of the stitch have been suggested. However, sufficient result is not obtained yet, and further a large amount of calculation is required in such algorithms. Therefore, the latter method is not applicable to the inexpensive personal use embroidery data creating device.
Further, even if the image pattern to be scanned is an outline image like coloring pictures for children, when it is scanned by the scanner, the obtained image data of the outline has a certain width (i.e., the line is recognized as a two-dimensional area). Therefore, when the image data is processed and the edge of the outline is detected, two outlines are detected at the both ends of the image of the outline as indicated in FIG. 16C. Since the outline is recognized as an area, even if the original is a line-drawn image, it is difficult to assign various method of stitching a line such as a run-stitch, a zigzag stitch, an E stitch and the like.
Therefore, it is not preferable to detect a plurality of lines (i.e., paths of stitching) for a single outline as described above. Preferably, only one path for one line of the original line-drawn image is to be obtained. For this demand, a thinning method which is known as one of the image data processing methods can be used. If a thin line obtained in the thinning method is used as a line defining the path of stitching, the run-stitch, the zigzag stitch, the E stitch and the like can be freely applied (see FIG. 16D). For example, the width of the zigzag can easily be set and/or adjusted if the single thin line is used for defining the paths and/or regions of the embroidery.
It is an object of the invention to provide an embroidery data creating device capable of creating an embroidery data based on a simple line-drawn original image pattern, and assigning various types of stitching to the paths and regions. Note that a region of the image pattern can be represented with a single path automatically without requiring an operator to trace the line-drawn image manually.
For the above object, according to the invention, there is provided an embroidery data creating device for creating an embroidery data to be used by a sewing machine, the embroidery data creating device comprising means for storing an image data corresponding to a line-drawn image, means for obtaining a thin line image based on the image data, means for determining closed paths based on the thin line image, means for selecting at least one of a path and a region defined by the path for each of the closed paths determined by the determining means, and means for converting the at least one of the path and the region defined by the path into the embroidery data.
Optionally, the converting means comprises means for assigning an attribution to the at least one of the path and the region defined by the path when conversion is executed.
The attribution may be a type of stitch, a color of thread, a pitch of each stitch, a density of stitches and/or a direction of stitch for embroidering.
Further optionally, the image data is a bit map image data may consist of data for a plurality of pixels, and a pixel connectivity of the thin line obtained by the obtaining means is four or eight.
Furthermore, the determining means may convert the thin line image into a chain of connected vectors, the closed path being defined as a path surrounded by the chain of connected vectors.
Still optionally, the embroidery data creating device may store the embroidery data in a memory means. In this case, the memory means can be a detachable card memory.
The data created by the embroidery data creating device 100 is used in a personal sewing machine, an example of which is shown in FIG. 3.
In
The sewing operation and the driving operation of the horizontal driving mechanism 41 are controlled by a microcomputer built in the sewing machine 40 (not shown). The sewing machine 40 has a card insertion unit 43 to which a card memory (flash memory) 10 is to be inserted. The embroidery data is supplied from the card memory 10. Since the embroidery data indicates the amount of movement in X and Y directions for every stitch, the embroidered pattern can be automatically produced (sewn). The embroidery data creating device according to the present invention creates the data to be stored in the card memory 10.
As shown in
As shown in
The image scanner 12 is a monochromatic hand-held scanner that is moved by an operator across an image to be scanned. When the reading section of the scanner 12 faces the image, and is moved along a certain direction while a reading button is depressed, the scanner 12 scans the image and creates binarized (ON or OFF) bit map image data. The binarized data is stored in a image data storing area 4a of the RAM 4 as a raster formatted bit-map having a value of 0 when a corresponding pixel is white, and a value 1 when a corresponding pixel is black.
The embroidery creating device 100 creates the embroidery data based on the original as shown in FIG. 5. The data creating operation is stored in the ROM 3 as a program. The operation will be illustrated with reference to a flowchart shown in FIG. 4. Prior to the data creating operation, an operator prepares an original as shown in FIG. 5. The original is a line-drawn image pattern which is drawn, for example, with use of a black pen on a sheet of white paper.
The process shown in
In step S2, the thinning operation is applied to the binarized image data stored in the image storing area 4a of the RAM 4 to create a thin line image data corresponding to the image pattern A shown in FIG. 5. As described before, and as shown in
As practical methods for achieving the thinning of the binarized bit map image, a plurality of methods are well-known. For example, a sequential thinning method is known. According to the sequential thinning method, firstly a closed region is defined as a region in which black pixels are connected with each other. Then, pixels located at the outer side portion of the closed region are sequentially deleted according to a predetermined rule until no more pixels can be deleted. The rule for deleting the pixel will not be described in detail since there are various methods which are all well-known. Any method can be taken if the width of the line is reduced to one pixel. One well-known example of such methods is a Hilditch method which converts the closed region consisting of a plurality of connected black pixels into an 8-connected line.
At step S3, the line-drawn image corresponding to the image pattern A is converted into chains of line data respectively having lengths and direction. That is, the line-drawn image is converted into a set of short vector data (i.e., vectorization is executed) at S3. As a method of vectorization, for example, a pixel (any pixel) forming the line-drawn image is determined to be a starting point, and by sampling another pixel along the line forming the line-drawn image, a vector is obtained. As another example, a reference vector is determined, and by evaluating the difference between the reference vector and a certain point, significant points can be determined.
An example of the vectorization is disclosed in the Japanese Patent Provisional Publication HEI 8-38756, and detail description will not be provided here.
In step S4, based on the short vectors, a loop formed by the chain of the short vectors is picked up. The loop is a closed path formed by a chain of short vectors, the closed path being non-dense with respect to each other in the graph. Each loop (i.e., the closed path) picked up in this step S4 defines the closed region for stitching embroidery. The loop is picked up in accordance with the following procedure.
In
As shown in
The loops L1 through L7 respectively consist of chains of short vectors representing closed regions (hatched portions of
In step S5 of
In order to set the above items, each loop is displayed on the screen 7a one by one, and in response to the operation of the keys 11, the setting is applied to each loop (path and region).
When the attribution is set, firstly the CPU 2 selects the uppermost region, i.e., the region defined by the loop L1 (
Firstly, the operator depress the fill key 11b. Upon every depression of the fill key 11b, the setting to be applied to the indicated region is changed cyclicly from “without fill”, “black fill”, “red fill”, “green fill”, “yellow fill” and back to “without fill”. In order to select the “red fill”, the fill key 11b is to be depressed twice. Step S53 determines whether the region changing key 11a is depressed. Therefore, when the fill key 11b is depressed first, determination at step S53 is NO and control goes to step S55. At S55, whether the fill key 11b is depressed is examined. Therefore, determination at S55 is YES, and S56 is executed. At S56, as described above, the setting is changed. When the fill key 11b is depressed first time, “black fill” is selected.
Operation of the outline designation key 11c switches the setting of the stitch of the outline from “no-outline stitch”, “black outline stitch”, “red outline stitch”, “green outline stitch”, “yellow outline stitch” in this order, cyclicly (S57:YES and S58). Further operation of the outline designation key 11c brings the setting back to the “no-outline stitch”. In the above described example, “no-outline stitch” is to be made. The initial setting is the “no-outline stitch”, and therefore, the outline designation key 11c is not necessary to be operated (S57:NO). The setting of the outline stitch is indicated by a pair of cocentric circles with inner one being filled, on the screen 7a as shown in FIG. 10. The name of the item currently being set blinks on the screen 7a. In the embodiment, the outline is sewn with the zigzag stitch which is a default stitch.
In order to set the attribution of another region, the operator is required to operate the region change key 11a. When the region change key 11a is operated (S53:YES), another closed region, i.e., the region defined by the loop L2 in the embodiment, is selected (the region blinks on the screen 7a). In order to set “red fill” and “no outline”, the fill key 11b is depressed twice (S55:YES and S56) as is done for the first region defined by the loop L1.
When the region switch key 11a is operated again (S53: YES), another region defined by the loop L3 is selected (S54). As the region defined by the loop L3 is selected, it blinks on the screen 7a (S52). In the example, the region defined by the loop L3 is to be set to be filled with yellow with black outline. For this setting, firstly the fill key 11b is operated three times to select yellow fill (S53:YES and S53). Then, the outline designation key 11c is operated once to set the black outline (S57:YES and S58).
Similar operations are repeatedly executed until setting for all the regions corresponding to the loop L1 through L8 are completed. After the setting for the region defined by the loop L7 is finished, when the region change key 11c is operated again (S53:YES and S59:YES), the attribution setting operation is finished.
The settings are stored in the sewing condition storing area 4b of the RAM 4 as shown in FIG. 12. The sewing condition (i.e., the settings) are represented by numeral values for the outline and the region surrounded by the outline. The colors of stitch are represented by the following numerals.
type of stitch
numeral
No stitch
0
Black stitch
1
Red stitch
2
Green stitch
3
Yellow stitch
4
Therefore, the data stored in the sewing condition storing area 4b represents the setting as follows.
loop L1
Fill (Red)
No outline
loop L2
Fill (Red)
No outline
loop L3
Fill (Yellow)
Outline (Black)
loop L4
Fill (Red)
No outline
loop L5
Fill (Red)
No outline
loop L6
Fill (Green)
Outline (Black)
loop L7
Fill (Green)
Outline (Black)
Note that among the line-drawn image patterns, a stem part is not expressed by the short vector loop. The data corresponding to this part is not described in detail since the creating of the data corresponding to the part which is not expressed with use of short vectors is done according to another algorithm, and the embroidery data for such a part is created to have a predetermined type of stitch.
In the above described example, there is only one image in the original. If there are more than one images, each image is divided into the closed regions similarly to the above-described example, and the setting is done for each closed region.
By step S5 of
For a path, along which a line stitch is produced, the stitching points data are created such that the stitching points are apart by a predetermined amount along the path. The color of the thread to be used for each region is stored as a thread color data in the flash memory 10 as shown in FIG. 14 through the flash memory device 5 together with the stitching points data. As shown in
The embroidery data created as described above and stored in the flash memory 10 can be used in the sewing machine 40 as shown in FIG. 3. In
According to the embroidery data creating device as described above, the thinning operation is performed with respect to a scanned line data, and further the line data is converted into a vector data. Since the vector data indicates the direction where each portion of the outline extends, when a region enclosed by an outline is elongated, the elongated direction can be recognized easily. As described before, in the prior art, since the elongated direction of the elongated region is not easily obtained, the direction of the stitch cannot be determined appropriately. According to the present invention, as the direction of the elongated region can be obtained, the direction of stitches for filling the region can be determined in accordance with the elongated direction. Therefore, according to the embroidery data creating device described above, a freely drawn line image can be used as an original for creating an embroidery data. The line-drawn image is automatically divided into a plurality of closed regions, and sewing condition can be set for each closed regions easily. No extra operation such as manual tracing for generating data to be input to a computer is necessary, and therefore an operator can obtain the desired embroidery data without particular knowledge of the data creating algorithm and/or particular skill therefor.
In the embodiment, the image scanner 12 is a monochrome scanner, and the color is assigned to each closed region on the screen after the image has scanned. However, it is also possible to use a color scanner to scan a color image, and used the color of the original image for designating the color of the embroidery data.
Further, when a color scanner is used, the embroidery data creating device is configured such that only images having a certain color are processed. That is, only a part of the image having a predetermined color can be made into the embroidery data.
The original data is not limited to the data input from the scanner. The original data may be given through a floppy disk, a card memory, through communication lines, and the like.
In the embodiment, the thin line image is vectorized and then the loops are determined. Picking up of the loops may be performed with reference to a bit map image without vectorizing the image data.
Further, in step S5 of
In the embodiment, a hand held scanner is employed. However, the invention is not limited to the described embodiment, but can be modified in various way. For example, instead of the hand held scanner, a desk top scanner can be employed. In the embodiment, in order to change the region to which the attribute is assigned the region change key is to be operated. It is possible to designate the region directly if the embroidery data creating device is provided with a pointing device such as a mouse. In this case, designation of region is performed quickly and the operability of the embroidery data creating device may improve.
Further, the created embroidery data is transmitted to the sewing machine by means of the flash memory. If there is means for connecting the sewing machine and the embroidery data creating device directly (wired or wireless), the created embroidery data can be used without the recording medium such as the flash memory.
The present disclosure relates to subject matters contained in Japanese Patent Applications No. HEI 7-224965, filed on Sep. 1, 1995, and No. HEI 8-102286, filed on Apr. 24, 1996, which are expressly incorporated herein by reference in their entireties.
Patent | Priority | Assignee | Title |
7302308, | Dec 27 2004 | Brother Kogyo Kabushiki Kaisha | Embroidery data processing device |
7930057, | Jul 18 2006 | Brother Kogyo Kabushiki Kaisha | Embroidery data processing apparatus, embroidery data processing program recorded on computer-readable recording medium, and sewing machine |
7962239, | Jul 07 2006 | Brother Kogyo Kabushiki Kaisha | Sewing machine and sewing machine operating program recorded on computer-readable recording medium |
8090466, | Oct 30 2006 | Brother Kogyo Kabushiki Kaisha | Embroidery data creation apparatus and computer-readable medium encoding an embroidery data creation program |
8335584, | May 28 2009 | Brother Kogyo Kabushiki Kaisha | Embroidery data generating apparatus and computer-readable medium storing embroidery data generating program |
8385587, | Jan 13 2006 | N V MICHEL VAN DE WIELE | Method to avoid mixed contours in pile fabrics |
8655474, | Mar 02 2010 | Brother Kogyo Kabushiki Kaisha | Embroidery data generating apparatus, embroidery data generating method, and non-transitory computer-readable medium storing embroidery data generating program |
8682467, | Sep 27 2011 | Brother Kogyo Kabushiki Kaisha | Embroidery data generating device, computer-readable storage medium storing embroidery data processing program and sewing machine |
8694147, | Sep 27 2011 | Brother Kogyo Kabushiki Kaisha | Embroidery data generating device, computer-readable storage medium storing embroidery data processing program and sewing machine |
8731705, | Aug 10 2011 | Brother Kogyo Kabushiki Kaisha | Data generator, computer readable recording medium, and sewing machine |
8774957, | Jan 31 2011 | Brother Kogyo Kabushiki Kaisha | Embroidery data generating device, computer readable medium storing embroidery data processing program, and sewing machine |
8793009, | Aug 03 2011 | Brother Kogyo Kabushiki Kaisha | Data generator, computer readable recording medium, and sewing machine |
9031686, | Sep 10 2012 | Brother Kogyo Kabushiki Kaisha | Embroidery data processor, computer-readable storage medium storing embroidery data processing program and sewing machine |
Patent | Priority | Assignee | Title |
4982674, | May 30 1989 | Brother Kogyo Kabushiki Kaisha | Method of and apparatus for preparing sewing data for a multi-needle embroidery sewing machine |
5054408, | May 30 1989 | Brother Kogyo Kabushiki Kaisha | Method of and apparatus for preparing sewing data for a multi-needle embroidery sewing machine |
5179520, | May 30 1989 | Brother Kogyo Kabushiki Kaisha | Method of and apparatus for preparing sewing data for a multi-needle embroidery sewing machine |
5181176, | Oct 13 1989 | Brother Kogyo Kabushiki Kaisha | Embroidery data preparing apparatus |
5231941, | Aug 24 1991 | Brother Kogyo Kabushiki Kaisha | Sewing machine with embroidery device |
5270939, | Nov 26 1991 | PULSE MICROSYSTEMS LTD | Method for modifying embroidery design programs |
5283748, | Jan 23 1991 | Brother Kogyo Kabushiki Kaisha | Embroidery data producing method and apparatus |
5311439, | Jul 16 1991 | Brother Kogyo Kabushiki Kaisha | Embroidery data processing system and method |
5335182, | Jul 20 1992 | Brother Kogyo Kabushiki Kaisha | Embroidery data producing apparatus |
5379707, | Aug 17 1992 | Brother Kogyo Kabushiki Kaisha | Stitch data preparing device for embroidery sewing machine |
5390126, | Feb 22 1991 | Janome Sewing Machine Co., Ltd. | Embroidering data production system |
5422819, | Feb 22 1991 | Janome Sewing Machine Co., Ltd. | Image data processing system for sewing machine |
5474000, | Nov 30 1993 | Brother Kogyo Kabushiki Kaisha | Apparatus for processing embroidery data |
5499589, | Feb 25 1994 | Brother Kogyo Kabushiki Kaisha | Method and apparatus for producing image data to be used by embroidery data processing apparatus |
5558033, | Jul 29 1994 | Brother Kogyo Kabushiki Kaisha | Image figure processing method and device |
5740056, | Oct 11 1994 | Brother Kogyo Kabushiki Kaisha | Method and device for producing embroidery data for a household sewing machine |
5751583, | Feb 25 1994 | Brother Kogyo Kabushiki Kaisha | Embroidery data processing method |
5839380, | Dec 27 1996 | Brother Kogyo Kabushiki Kaisha | Method and apparatus for processing embroidery data |
6192292, | Feb 20 1997 | Brother Kogyo Kabushiki Kaisha | Embroidery data processor for preparing high quality embroidery sewing |
6356648, | Sep 20 1997 | Brother Kogyo Kabushiki Kaisha | Embroidery data processor |
JP3128085, | |||
JP4174699, | |||
JP549766, | |||
JP7236784, | |||
JP7328255, | |||
JP838756, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Feb 27 2001 | Brother Kogyo Kabushiki Kaisha | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jul 19 2005 | ASPN: Payor Number Assigned. |
Jul 19 2005 | RMPN: Payer Number De-assigned. |
Aug 18 2006 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Apr 14 2008 | RMPN: Payer Number De-assigned. |
Apr 17 2008 | ASPN: Payor Number Assigned. |
Aug 24 2010 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Mar 29 2008 | 4 years fee payment window open |
Sep 29 2008 | 6 months grace period start (w surcharge) |
Mar 29 2009 | patent expiry (for year 4) |
Mar 29 2011 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 29 2012 | 8 years fee payment window open |
Sep 29 2012 | 6 months grace period start (w surcharge) |
Mar 29 2013 | patent expiry (for year 8) |
Mar 29 2015 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 29 2016 | 12 years fee payment window open |
Sep 29 2016 | 6 months grace period start (w surcharge) |
Mar 29 2017 | patent expiry (for year 12) |
Mar 29 2019 | 2 years to revive unintentionally abandoned end. (for year 12) |