An entropy encoder includes an apparatus for producing a data stream which comprises two reference points, of code words of variable lengths, the apparatus comprising a first device for writing at least a part of a code word into the data stream in a first direction of writing, starting from a first reference point, and a second device for writing at least a part of a code word into the data stream in a second direction of writing, which is opposite to the first direction of writing, starting from the other reference point. In particular, when a raster having a plurality of segments is used to write the code words of variable lengths into the data stream, the number of the code words which can be written starting at raster points is doubled, in the best case, such that the data stream of code words of variable lengths is robust toward a propagation of sequence errors.
|
6. Method for reading a data stream which comprises a multitude of raster points as reference points, the raster points specifying a raster, two adjacent raster points defining a segment, in which method the data stream comprises a plurality of sets of code words, a first set of code words being written in the first direction and a second set of code words being written in a second direction, the code words of the second set being assigned to segments of the data stream in accordance with a predetermined assignment rule, such that each code word of a set is assigned to a different segment, wherein a code word of the second set is distributed over more than one segment in accordance with a predetermined regulation, the method comprising:
reading the code words of the first set, starting from a first raster point of a segment, in a first direction of reading which corresponds to the first direction of writing;
reading the code words of the second set, starting from a second raster point of a segment, in a second direction of reading which is opposite to the first direction of reading, wherein it is jumped, for reading the code words of the second set, to the second raster point of a segment in accordance with the predetermined assignment rule, and
when all segments have been searched for code words of the second set in accordance with the predetermined assignment rule and only a part of the code word of the second set has been found in a segment and the code word of the second set is still not complete, jumping to at least one further segment different from the segment, in which the part of the code word of the second set has been found, in accordance with the predetermined rule, and obtaining the at least one code word of the second set completely or a part of the at least one code word from the further segment; and
decoding the code words of the first set and the code words of the second set to obtain a decoded signal.
1. Apparatus for reading a data stream, which comprises a multitude of raster points as reference points, the raster points specifying a raster, two adjacent raster points defining a segment, wherein the data stream comprises a plurality of sets of code words, a first set of code words being written in the first direction and a second set of code words being written in a second direction, the code words of the second set being assigned to segments of the data stream in accordance with a predetermined assignment rule, such that each code word of a set being assigned to a different segment, wherein a code word of the second set is distributed over more than one segment in accordance with a predetermined rule, the apparatus comprising:
a first device for reading in a first direction of reading which corresponds to the first direction of writing;
a second device for reading in a second direction of reading which is opposite to the first direction of reading; and
a control device
for supplying the code words of the first set to the first reading device, each code word of the first set starting at the first raster point of a segment, and
for supplying the code words of the second set to the second reading device, wherein one jumps to the second raster point of a segment in accordance with the predetermined assignment rule, and
wherein the control device is adapted for jumping at least to a further segment different from the segment, in which the part of the code word of the second set has been found, in accordance with the predetermined rule, when all segments have been searched for code words of the second set in accordance with the predetermined assignment rule and at least only a part of the code word of the second set has been found in a segment and the code word of the second set is still not complete, and
wherein the control device is adapted for obtaining the at least one codes word of the second set completely or a further part of the at least one code word of the second set from the further segment; and
a decoder for decoding the code words of the first set and the code words of the second set to obtain a decoded signal.
2. Apparatus as claimed in
4. Apparatus as claimed in
5. Apparatus as claimed in
|
The present invention relates to encoding with code words of variable lengths and, in particular, to producing and reading data streams with code words of variable lengths, which are robust with regard to errors in transmission.
Modern audio encoding or decoding methods which work by the MPEG layer 3 standard, for example, are capable of compressing the data rate of audio signals, e.g. by a factor 12, without noticeably degrading the quality thereof. In order to achieve such a high data rate reduction, an audio signal is sampled, whereby a sequence of discrete-time samples is obtained. As is known in the art, the sequence of discrete-time samples is windowed in order to obtain windowed blocks of time samples. A block of time-windowed samples is then transformed to the frequency range by means of a filter bank, a modified discrete cosine transform (MDCT) or other suitable device, in order to obtain spectral values which, as a whole, represent the audio signal, i.e. the time section determined by the block of discrete-time samples, in the frequency range. Usually, time blocks which overlap at 50% are produced and transformed to the frequency range by means of a MDCT whereby, due to the specific properties of the MDCT, 1024 discrete-time samples, for example, always lead to 1024 spectral values.
It is known that the receptivity of the human ear depends on the momentary spectrum of the audio signal itself. This dependency is covered in the so-called psycho-acoustic model by means of which it has been possible for quite some time to calculate masking thresholds depending on the momentary spectrum. Masking means that a specific tone or a spectral component is hidden in case an adjacent spectral range, for example, has relatively high energy. This fact of masking is utilized in order to quantize as closely as possible the spectral values present after the transformation. The aim is therefore to avoid audible interferences in the re-decoded audio signal on the one hand and to use as few bits as possible on the other hand in order to encode or, in this case, to quantize the audio signal. The interferences introduced by quantization, i.e. quantization noise, are intended to be below the masking threshold and, therefore, to be inaudible. In accordance with known methods, a classification of the spectral values in so-called scale factor bands is carried out, which should correspond to the critical bands, i.e. frequency groups, of the human ear. Spectral values in a scale factor group are multiplied by a scale factor in order to carry out overall scaling of spectral values of a scale factor band. The scale factor bands scaled by the scale factor are then quantized, whereupon quantized spectral values are produced. It is understood that grouping in scale factor bands is not critical. However, it is used in the MPEG layer 3 standards or in the MPEG 2 AAC standard (AAC=advanced audio coding).
A very essential aspect of data reduction lies in entropy encoding of the quantized spectral values, which follows quantizing. Huffman encoding is usually used for entropy encoding. A Huffman coding is understood to mean a coding with a variable length, i.e. the length of the code word for a value to be encoded is dependent on the probability of occurrence thereof. Logically, the most probable character is assigned the shortest code, i.e. the shortest code word, so that very good redundancy reduction can be achieved by means of Huffman encoding. An example for a generally-known coding with a general length is the Morse code.
In the field of audio encoding, Huffman codes are used for encoding the quantized spectral values. A modern audio encoder, which works, for example, in accordance with the MPEG 2 AAC standard, uses different Huffman code tables for encoding the quantized spectral values, which Huffman code tables are assigned to the spectrum by certain criteria on a section-by-section basis. In this process, 2 or 4 spectral values are always encoded together in one code word.
One difference between the method in accordance with MPEG 2 AAC and the method in accordance with MPEG layer 3 is that different scale factor bands, i.e. different spectral values, are grouped into any number of spectral sections. With AAC, one spectral section includes at least four spectral values, but preferably more than four spectral values. The entire frequency range of the spectral values is therefore divided up into adjacent sections, with one section representing one frequency band such that all sections together cover the entire frequency range, which is superimposed by the spectral values after the transformation thereof.
As in the MPEG layer 3 method, one section is assigned to a so-called “Huffman table” from a plurality of such tables in order to achieve a maximum redundancy reduction. In the bit stream of the AAC method, which usually comprises 1024 spectral values, are now the Huffman code words for the spectral values in an ascending order of frequencies. The information on the table used in each frequency section is transferred in the side information. This situation is shown in
As has already been mentioned, it is clearly apparent from
One major drawback with regard to Huffman codes, in the case of faulty channels, is error propagation. It may be assumed, for example, that code word No. 2 in
As a solution to the problem of error propagation, European Patent No. 0 612 156 proposes that a part of the code words of variable lengths be arranged in a raster and that the remaining code words be distributed in the remaining gaps, so that the start of a code word which is arranged at a raster point can be more easily found without full decoding or in the case of an incorrect transmission.
It is true that the known method provides some remedy for error propagation by means of rearranging the code words. For some code words, a fixed location in the bit stream is agreed upon, whereas the remaining gaps are available for the remaining code words. This does not cost any additional bits, but prevents, in the case of an error, error propagation among the rearranged code words.
German Patent Application 19 747 119.6-31, which was published after the filing date of the present application, proposes that not just any code words be located at raster points, but that code words which are significant from a psycho-acoustic point of view, i.e. code words for spectral values which make a significant contribution to the audio signal, be located at raster points. A data stream with code words of variable lengths, such as is produced by such an encoder, is shown in
The advantage of the post-published method illustrated in
In case, for example, the priority code word 2 has been damaged in transmission, it is very likely in the prior art shown in
However, there is no effective protection for non-priority code words. Referring to
DE 691 26 565 T2 relates to a method for transmitting codes of variable lengths. By this method, a data stream is produced in which, starting from the start of the data stream, code words of variable lengths are written in a first direction up to a certain point in the data stream. However, in order to increase error robustness, not the entire data stream is written in one direction, but merely up to the predetermined point. From the end of the data stream, the remainder of the code words of variable lengths is then written in an opposite direction of writing up to the predetermined point, so that a data stream results whose first half comprises code words which are written in the forward direction and whose second half comprises code words which are written in the backward direction.
U.S. Pat. No. 5,852,469 relates to encoding and decoding systems for code words with variable lengths and code words with specified lengths. It is provided, for code words with specified lengths, to provide synchronous positions in the data stream whose distance is equal to the length of the code words of specified lengths. The code words are then entered into the data stream such that they all start at a synchronous position. For code words of variable lengths, a data stream with a start and an end, however without synchronous positions, is provided in order to enter code words of variable lengths in the forward direction, starting from the start of the data stream up to a certain position behind the center of the data stream. Starting from the end of the data stream up to the predetermined position in the center, code words of variable lengths are then entered in the opposite direction of writing.
It is the object of the present invention to render code words of variable lengths more error-robust.
In accordance with a first aspect of the present invention, this object is achieved by an apparatus for producing a data stream, which comprises a multitude of raster points as reference points, the raster points specifying a raster, two adjacent raster points defining a segment, of code words of variable lengths which are divided up into a plurality of sets of code words, the apparatus comprising: a first device for writing at least a part of each code word of a first set of code words into the data stream in a first direction of writing, starting at a first raster point of a segment, respectively; a second device for writing at least a part of a code word of a second set of code words into the data stream in a second direction of writing, which is opposite to the first direction of writing, starting from a second raster point, respectively, the code words of the second set being assigned to segments in accordance with a predetermined assignment rule, such that each code word of the second set is assigned to a different segment, wherein, in case that a code word of the second set does not or not completely fit into the assigned segment, at least a part of this code word or at least a part of the remainder of this code word which does not fit into the assigned segment is written into a different, not fully occupied segment, in accordance with a predetermined rule, by the first device or the second device, after the second device for writing has processed all remaining segments with the other code words of the second set.
In accordance with a second aspect of the present invention, this object is achieved by an apparatus for reading a data stream which comprises a multitude of raster points as reference points, the raster points specifying a raster, two adjacent raster points defining a segment, wherein the data stream comprises a plurality of sets of code words, a first set of code words being written in the first direction and a second set of code words being written in a second direction, the code words of the second set being assigned to segments of the data stream in accordance with a predetermined assignment rule, such that each code word of a set being assigned to a different segment, wherein a code word of the second set may be divided up over more than one segment in accordance with a predetermined rule, the apparatus comprising the following: a first apparatus for reading in a first direction of reading which corresponds to the first direction of writing; a second device for reading in a second direction of reading which is opposite to the first direction of reading; and a control device for supplying the code words of the first set to the first reading device, each code word of the first set starting at the first raster point of a segment, and for supplying the code words of the second set to the second reading device, wherein one jumps to the second raster point of a segment in accordance with the predetermined assignment rule, and wherein, after all segments have been searched for code words of the second set and at least one code word of the second set is not present or not complete, one jumps at least to one further segment in accordance with the predetermined rule in order to obtain the at least one code word of the second set completely or a part of the at least one code word.
In accordance with a third aspect of the present invention, this object is achieved by a method for producing a data stream, which comprises a multitude of raster points (41-47) as reference points, the raster points specifying a raster, two adjacent raster points defining a segment, of code words of variable lengths, which are divided up into a plurality of sets of code words, the method comprising the following steps: writing at least a part of each code word of a first set of code words into the data stream in a first direction of writing, starting from a first raster point of a segment, respectively; writing at least a part of a code word of a second set of code words into the data stream in a second direction of writing which is opposite to the first direction of writing, starting from a second raster point of a segment, respectively, the code words of the second set being assigned to segments in accordance with the predetermined assignment rule, such that each code word of the second set is assigned to a different segment, wherein, in case a code word of the second set does not or not completely fit into the assigned segment, at least a part of this code word or at least a part of the remainder of this code word which does not fit into the assigned segment is written into a different, not fully occupied segment in the first or second direction of writing, in accordance with a predetermined regulation, after all remaining segments have been processed with the other code words of the second set.
In accordance with a fourth aspect of the present invention, this object is achieved by a method for reading a data stream which comprises a multitude of raster points as reference points, the raster points specifying a raster, two adjacent raster points defining a segment, in which method the data stream comprises a plurality of sets of code words, a first set of code words being written in the first direction and a second set of code words being written in a second direction, the code words of the second set being assigned to segments of the data stream in accordance with a predetermined assignment rule, such that each code word of a set is assigned to a different segment, wherein a code word of the second set may be divided up over more than one segment in accordance with a predetermined regulation, the method comprising the following steps: reading the code words of the first set, starting from a first raster point of a segment, in a first direction of reading which corresponds to the first direction of writing; reading the code words of the second set, starting from a second raster point of a segment, in a second direction of reading which is opposite to the first direction of reading wherein it is jumped, for reading the code words of the second set, to the second raster point of a segment in accordance with the predetermined assignment rule, wherein, after all segments have been searched for code words of the second set or at least a code word of the second set is not present or not completely present, one jumps to at least one further segment in accordance with the predetermined rule so as to obtain the at least one code word of the second set completely or a part of the at least one code word.
The present invention is based on the realization that the robustness of a data stream toward transmission errors and, in particular, toward sequence errors with code words of variable lengths can be decisively increased when the data stream is not written only in one direction of writing but is written, additionally, in the other direction of writing. In the most general case, a data stream will always have a start and an end. In the prior art, in the simplest case, the data stream was written onto, starting from the starting point, until it was completed. Thereby it was possible that a transmission error in the first code word could result in that the entire data stream could no longer be decoded correctly, even if all other code words were transmitted correctly. In accordance with the invention, such a data stream may be written such that the first half of the data stream is written starting from the start of the data stream, whereas the second half of the data stream is written starting from the end of the data stream. Even from this simple example, it can be seen that a transmission error in the first half of the data stream no longer has the effect that code words of the second data stream can also no longer be decoded correctly due to sequence errors. This is the case because the decoder knows that after half of the data stream it must continue reading starting from the end of the data stream, to be precise in the opposite direction of reading. Thus, a certain error robustness is obtained merely due to reversing the direction of writing/the direction of reading with virtually no extra effort.
As has already been mentioned, code words with variable lengths are written into a data stream using raster points such that a decoder can decode with a limited number of sequence errors since, by definition, certain code words start at raster points. For maximum error robustness, it will, in principle, be desirable to have a raster which is as narrow as possible, such that a decoder can find the correct starting points of as many code words as possible. On the other hand, an increase in the number of raster points, i.e. a reduction of the segment length, will result in that fewer and fewer code words which, as is known, have variable lengths, completely fit into the raster, which is why measures are taken for the end sections of the same to be written into other segments in order to be able to be detected correctly in decoding. This leads to an increasing additional effort with a raising number of raster points and with a reduction in the segment length.
In the prior art, code words were written merely in one single direction of writing, starting from a raster point, as has been explained with reference to
In addition, remainders of code words may be written in the same direction of writing as the starting sections of the code words or, alternatively, in the opposite direction of writing. It is evident that measures must be taken in order for a decoder, i.e. an apparatus for reading the data stream, to always be fully aware of which direction of writing has been used in writing. This may either be specifically set or be transmitted as side information to the data stream of code words of variable lengths. The same applies also to the segment lengths, wherein the segment length may either be equal or vary over the entire data stream, wherein the current segment length can of course also be specifically set in a decoder or can be transmitted via side information together with the code words of variable lengths.
Preferred embodiments of the present invention will be explained in detail below with reference to the attached drawings, in which:
Before
Therefore, error protection, as is provided by the present invention, must be performed in order to ensure error-robust transmission. The apparatus for producing a data stream of code words of variable lengths in accordance with the present invention may therefore act as a sending or output stage of a Huffman encoder, as it were, whereas the apparatus for reading a data stream of code words of variable lengths may act as a receiving or input stage of a Huffman encoder. It can be seen from this that the present invention is not only applicable to Huffman encoders, but to any code having code words of variable lengths which is susceptible to sequence errors.
An apparatus 30 for reading an error-robust data stream, which apparatus is complementary to the apparatus 10 for producing a data stream, shown in
It is evident that apparatus 30 also contains a branching point 40 and a combination point 42, the feeding-in of the error-robust data stream into the two devices 36 and 38 taking place, for example, based on a specifically set algorithm or based on side information which may also be transmitted, together with the error-robust data stream, from the sender, i.e. the apparatus 10 in
In accordance with a preferred embodiment of the present invention, the segment length, i.e. the length of the segment, is longer than the length of the longest code word of the first set. The code words of the first set are arranged at raster points 41 to 46, wherein, for the last segment No. 6, a raster point is indicated by a dotted line, which raster point is not used, however, since the end 47 of the data stream can also be considered as a raster point as it were and since the raster point indicated by a dotted line is thus superfluous. The first segment No. 6 is therefore longer than the other segments, which is completely irrelevant for the present invention, however. Generally speaking, the segments may have any lengths, which change within the data stream, it being understood that the current length of a segment must be known to the decoder so that the inventive advantages can be utilized.
Firstly, the code words of the first set are written into the data stream in a step a), which results in a fragmentary data stream indicated by 31, in which the code words of the first set are written into a respective segment from left to right, as is indicated by arrows 48 which are to symbolize the direction of writing in the entire
Now the code words of the second set are written into the data stream 31 in a step b). In order to achieve high error robustness, the code words of the second set are not written from left to right like the code words of the first set, but are written from right to left, starting from the second raster point, respectively, e.g. the raster point 42 for the first segment, as is indicated by the respective arrow of writing direction. The writing of the code words of the second set takes place in accordance with a predetermined assignment rule which says, in the example selected, that the first code word of the second set is to be written in the same segment as the first code word of the first set, however always on the condition that there is still room in this segment. The data stream 32 resulting from the first attempt shows that in the first segment there was only so much room for writing the starting section of code word No. 7.
In contrast to the prior art, where the second part of code word No. 7 would have been written into the second segment, the second half of code word No. 7, i.e. 7 b), is stored for writing it into the data stream in a second attempt in accordance with a predetermined regulation, i.e. in accordance with an regulation which must also be known to the decoder.
The code words of the third set 13 to 15 are now to be entered into the resulting data stream 33, which is also still fragmentary. By analogy with step b), this is done preferably by the same assignment rule such that the first code word of the third set is assigned to the first segment, that the second code word of the third set is assigned to the second segment, that the third code word of the third set is assigned to the third segment, etc. This assignment rule is entirely arbitrary for the third set and may also be different from the assignment rule for the second set, with each code word of a set being assigned to a different segment in accordance with the invention. Similarly, the direction of writing can also be selected arbitrarily for each set. Preferably, an alternating writing direction order is used. Alternatively, however, it is also possible to write two adjacent sets using the same direction of writing. In principle, the writing direction may also altered within a set.
The first attempt in step c) was successful only in that the first section of code word No. 15 was entered, resulting in a fragmentary data stream 34. Code words 13, 14 and the second section of code word 15, i.e. 15 b) are stored for being accommodated in the second, third, fourth, fifth and sixth attempts, wherein the second section 15b could be accommodated in the fourth segment in the second attempt (data stream 35), wherein nothing could be accommodated in the third attempt, wherein the starting section of code word 14 could be accommodated in the fourth attempt (data stream 36), wherein the final section of code word 14, i.e. 14b could be accommodated in the fifth attempt (data stream 37) and wherein, finally, the first code word of the third set could be entered in the sixth segment in the sixth and final attempt, which results in the error-robust data stream 38 for the example illustrated here. The method described using
When looking at the robust data stream shown in
By means of an appropriate example,
Subsequently, the code words of the second set are extracted from the remaining data stream 50 in step b). Here, the decoder jumps to the second raster point 42 of the first segment and obtains the starting section of code word 7 of the second set (the first segment is now empty), whereupon it does not read in the second section 7b, but 7a is first stored in order to then read in the second code word of the second set starting from the second raster point of the second segment, etc. The result is a residual data stream 51 in which the first segment has been completely emptied. Since the decoder does not now read the code word 7 continuously, but always reads segment by segment on the basis of the assignment rule used for the apparatus for producing the data stream, the error robustness which has already been described and which strongly reduces propagation of sequence errors is ensured.
In a second attempt for extracting the code words of the second set, the second part of code word 7b is now read in the second segment in accordance with the existing writing direction, whereupon only code words of the third set remain in the resulting data stream 52, and the second segment is empty. These are extracted in step c), wherein the starting section of code word 15 has been initially determined in a first attempt, which is not stored however, since code word 15 has not been found complete in the third segment. The third segment is now empty. In a second attempt, code word 15 can be found complete. However, the search for code word 14 in segment 3 and for code word 15 in segment 14 remained without success, which can be seen by the data stream 54. Nevertheless, in the fourth attempt, the search for code word 14 in the fifth segment lead to a positive result. However, code word 14 was not complete, which is why the starting section 14a was stored in order to examine the remaining data stream 55 in a fifth attempt and to fully read in, in a final sixth attempt, data stream 56, which now only consists of the sixth segment and of code word 13.
Even though in the previous example merely a division of code words into a starting section and a final section was illustrated by way of example, any type of division is possible in principle. Error-robust decoding will be ensured as long as the decoder observes the assignment of code words of the second set or of the third set and of further sets to different segments, respectively. Moreover, it is obvious that the sorting of the final sections of code words into the data stream is arbitrary as long as the decoder or the read-in circuit upstream of the decoder knows exactly which predetermined regulation has been carried out in the encoder.
In order to once again underline the advantages and/or the operation of the present invention, reference is made to the error-robust data stream No. 38 of
If the raster points are chosen such that the segment lengths are longer than the longest length of a code word of the first set, no segment will be filled in completely by the code word of the first set, as can be seen, for example, from the data stream 31 of
Sperschneider, Ralph, Dietz, Martin, Homm, Daniel, Böhm, Reinhold
Patent | Priority | Assignee | Title |
7987410, | Aug 13 2004 | Intellectual Ventures I LLC | Systems and methods for decreasing latency in a digital transmission system |
9014497, | Dec 14 2010 | TELEFONAKTIEBOLAGET L M ERICSSON PUBL | Tile encoding and decoding |
9286698, | Dec 14 2010 | TELEFONAKTIEBOLAGET L M ERICSSON PUBL | Method and device for storing a compression ratio indication in a pixel value buffer in tile encoding |
Patent | Priority | Assignee | Title |
5835144, | Oct 13 1994 | INPHI CORPORATION | Methods of coding and decoding moving-picture signals, using self-resynchronizing variable-length codes |
5852469, | Mar 15 1995 | Kabushiki Kaisha Toshiba | Moving picture coding and/or decoding systems, and variable-length coding and/or decoding system |
20010053184, | |||
AU754877, | |||
DE19747119, | |||
DE3702490, | |||
DE69126565, | |||
EP612156, | |||
JP4504936, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 17 2000 | Fraunhofer-Gesellschaft zur Foerderling der Angewandten Forschung E.V. | (assignment on the face of the patent) | / | |||
Sep 06 2001 | SPERSCHNEIDER, RALPH | Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012190 | /0687 | |
Sep 06 2001 | DIETZ, MARTIN | Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012190 | /0687 | |
Sep 06 2001 | HOMM, DANIEL | Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012190 | /0687 | |
Sep 06 2001 | BOHM, REINHOLD | Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012190 | /0687 |
Date | Maintenance Fee Events |
Apr 07 2012 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Nov 13 2014 | ASPN: Payor Number Assigned. |
Mar 30 2016 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Mar 30 2020 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Oct 07 2011 | 4 years fee payment window open |
Apr 07 2012 | 6 months grace period start (w surcharge) |
Oct 07 2012 | patent expiry (for year 4) |
Oct 07 2014 | 2 years to revive unintentionally abandoned end. (for year 4) |
Oct 07 2015 | 8 years fee payment window open |
Apr 07 2016 | 6 months grace period start (w surcharge) |
Oct 07 2016 | patent expiry (for year 8) |
Oct 07 2018 | 2 years to revive unintentionally abandoned end. (for year 8) |
Oct 07 2019 | 12 years fee payment window open |
Apr 07 2020 | 6 months grace period start (w surcharge) |
Oct 07 2020 | patent expiry (for year 12) |
Oct 07 2022 | 2 years to revive unintentionally abandoned end. (for year 12) |