Disclosed are an apparatus and a method of encoding/decoding a video, particularly a method and an apparatus for storing a quantization parameter differential value in a largest coding unit (LCU) based on quadtree splitting and adaptively predicting a quantization parameter value based on context information on neighboring CUs. Quadtree-based quantization parameter encoding and decoding methods and apparatuses effectively show information on a block having a quantization parameter differential value based on splitting information on a CU and adaptively predict a quantization parameter value using context information including a block size, block partition and a quantization parameter of a neighboring CU.
|
0. 5. A method for decoding a video by a decoding apparatus using derivation of a dequantization parameter, the method comprising:
determining a parameter recorded unit to which a single differential dequantization parameter is applied, wherein when the a parameter recorded unit is split into four coding units based on a block partition flag, the differential dequantization parameter is signaled on a first coding unit and is not signaled on other coding units;
determining a parameter prediction unit used for deriving a predicted dequantization parameter;
deriving the predicted dequantization parameter for the parameter prediction unit, wherein the predicted dequantization parameter is derived using an average value of dequantization parameters of a block neighboring to a left of the parameter prediction unit and a block neighboring above the parameter prediction unit;
deriving the dequantization parameter using the predicted dequantization parameter and the differential dequantization parameter; and
performing dequantization using the dequantization parameter.
0. 1. A method for decoding a video by a decoding apparatus using derivation of a dequantization parameter, the method comprising:
determining a parameter recorded unit for which dequantization parameter information is signaled, wherein the parameter recorded unit is split in a quadtree structure;
determining a parameter prediction unit used for deriving a predicted dequantization parameter, wherein the parameter prediction unit comprises the parameter recorded unit;
deriving the predicted dequantization parameter for the parameter prediction unit, wherein the predicted dequantization parameter is derived using an average value of dequantization parameters of a block neighboring to a left of the parameter prediction unit and a block neighboring above the parameter prediction unit;
deriving a differential dequantization parameter for the parameter recorded unit based on the dequantization parameter information;
deriving the dequantization parameter using a sum of the predicted dequantization parameter and the differential dequantization parameter; and
performing dequantization using the dequantization parameter.
0. 2. The method of
wherein the quantization parameter flag indicates whether information with which the dequantization parameter is predicted for coding unit is present or not.
0. 3. The method of
wherein the parameter recorded unit is split into blocks of lower depth in a quadtree structure when the split flag is equal to 1, and the parameter recorded unit is not split further when the split flag is equal to 0.
0. 4. The method of
wherein the split flag equal to 0 indicates that the differential dequantization parameter is signaled for the parameter recorded unit and the split flag equal to 1 indicates that the parameter recorded unit is split into sub-blocks and the differential dequantization parameter is not signaled for the parameter recorded unit, and
wherein split flags for the sub-blocks are signaled when the split flag is equal to 1.
0. 6. The method of claim 5, wherein the parameter prediction unit is a block which has a size same with one of a coding unit size from a size of a smallest coding unit to a size of a largest coding unit when a quantization parameter flag has a value of true, and
wherein the quantization parameter flag indicates whether information with which the dequantization parameter is predicted for a coding unit is present or not.
|
This The present application is a Continuation Reissue Application of U.S. application Ser. No. 14/815,325, filed Jul. 31, 2015, which is a Reissue Application from U.S. Pat. No. 9,066,098 issued on Jun. 23, 2015 and filed Dec. 30, 2014, which is a Continuation Application of U.S. application Ser. No. 14/096,211, filed on Dec. 4, 2013, which is a Continuation Application of PCT Application No. PCT/KR2012/004881, filed on Jun. 20, 2012 and published as WO 2012/177051 on Dec. 27, 2012, which claims priority to Korean Patent Application No. 10-2011-0060058, filed on Jun. 21, 2011 in the Korean Intellectual Property Office, the entire disclosures of which are incorporated herein by reference for all purposes.
The present invention relates to an apparatus and a method of encoding/decoding a video, and more particularly, to a video encoding/decoding method and apparatus which displays a block having a quantization/dequantization differential value based on a quadtree with respect to coding units (CUs) in a largest coding unit (LCU) and adaptively predicts/decodes a quantization/dequantization parameter value using context information on blocks neighboring to a block to encode/decode.
High Efficiency Video Coding (HEVC) encodes/decodes an input picture by a coding unit (CU). A CU with a largest size in a frame is referred to as a largest coding unit (LCU), which is split into a plurality of CUs based on quadtree splitting information for encoding/decoding. In HEVC, one quantization parameter value is allocated to an LCU, and a quantization parameter value for a current LCU to encode is predicted from a previous LCU according to raster scan order.
In H.265/AVC, encoding/decoding is carried out on a macroblock unit, and a quantization/dequantization value is allocated to each macroblock. A quantization parameter value allocated to each macroblock is predicted from a quantization parameter value of a macroblock located on the left in a frame. A differential value which is generated after prediction of the quantization parameter value is written in a macroblock to encode, thereby conducting encoding. A decoder decodes the quantization parameter value by adding the quantization parameter differential value decoded in entropy decoding and the quantization parameter value of the left macroblock.
However, when a large LCU is allocated as compared with a size of an input picture, a bit rate may not be effectively controlled using a quantization parameter value stored by an LCU. Further, when a quantization parameter value is allocated by a CU, subjective deterioration in image quality may occur due to a difference in quantization parameter value from neighboring CUs. Thus, there is a need for a method of allocating quantization parameter values to various block sizes ranging from a CU to an LCU depending on an input picture and of optimally predicting a quantization parameter using context information on blocks neighboring to a block to encode.
An aspect of the present invention is to provide a method and an apparatus for encoding/decoding quadtree-based quantization/dequantization parameter values based on splitting information on a CU. The quantization/dequantization parameter encoding/decoding method and apparatus are capable of predicting quantization/dequantization parameter values in an effective manner using context information on neighboring blocks.
Technical problems of the present invention are not limited to those mentioned above, and those skilled in the art may understand additional problems not stated herein based on the following description.
An embodiment of the present invention provides a video encoding apparatus which includes a quantization differential value storing block unit determination module to determine a block unit to store a quantization parameter (QP) differential value in splitting a largest coding unit (LCU) of a picture into a plurality of CUs in a quadtree or encoding into a single CU, a quantization module to perform quantization using a quantization value allocated to each block unit, a quantization prediction block determination module to adaptively determine a prediction block using context information on a neighboring block so as to predict a quantization value used by a block to encode, a QP differential value generation module to generate a quantization differential value of the block to encode using a QP of the prediction block determined based on the context information, and a QP storage module to store splitting information on a quantization differential value storage block unit and QP differential values of a corresponding block.
Another embodiment of the present invention provides a video decoding apparatus which includes a dequantization parameter differential value block splitting flag deriving module to decode information on a block having a dequantization parameter differential value in an LCU, a dequantization differential value storage block unit determination module to determine the block having the dequantization parameter differential value in the LCU using a decoded dequantization parameter differential value block splitting flag, a dequantization parameter differential value deriving module to decode a dequantization parameter differential value according to the dequantization parameter differential value block splittting flag, a dequantization parameter value prediction block determination module to determine a block used for prediction based on context information on a neighboring block so as to decode a dequantiation parameter value of a block to decode, a dequantization parameter value deriving module to decode the dequantization parameter value used for dequantization, and a dequantization module to perform dequantization using the decoded dequantization parameter value.
Quadtree-based adaptive quantization/dequantization parameter encoding and decoding methods and apparatuses according to exemplary embodiments of the present invention enable allocation of different levels of quantization parameter differential values when a block is split in a quadtree. Such allocation of different levels of quantization parameter differential values allows accurate adjustment of bit rate as compared with allocation of a single quantization parameter value in an LCU. Further, in predicting/decoding a quantization/dequantization parameter value for each block unit, a prediction direction may be adaptively determined using not only quadtree-based zigzag scanning but also context information on neighboring blocks, thereby resolving subjective deterioration in image quality which may occur due to a substantial difference in quantization value from neighboring blocks.
Hereinafter, quadtree-based adaptive quantization/dequantization parameter encoding and decoding apparatuses according to an exemplary embodiments of the present invention will be described with reference to the accompanying drawings.
Referring to
The quantization differential value storage block unit determination module 100 may determine a block unit to record a quantization differential value for each coding unit (CU) or a group of a plurality of CUs based on information on splitting of a largest coding unit (LCU) of a picture into CUs. Information on a block storing the quantization differential value may have a quadtree structure.
The quantization module 101 performs quantization on an input block using a QP value allocated to the block.
The QP value prediction block determination module 102 determines a prediction block to be used for prediction of a quantization value allocated to each CU or arbitrary CU using context information on a CU neighboring to the CU so as to effectively encode the quantization value. The context information may include a size of the block, a location of the block, and a prediction mode for the block.
The QP differential value generation module 103 generates a QP differential value by subtracting a quantization value of the current block from a QP value of the quantization value prediction block determined by the QP value prediction block determination module 102.
The QP storage module 104 serves to entropy-encode a sequence parameter set, flag information on application/non-application by a slice unit, flag information used to indicate splitting information on a block including a quantization differential value, and a QP differential value for quadtree-based adaptive QP encoding.
Referring to
The dequantization parameter differential value block partition flag deriving module 120 decodes a sequence parameter set and a block partition flag for a block having a dequantization parameter differential value by an LCU in slice data.
The dequantization differential value storage block unit determination module 121 determines blocks to record dequantization parameter differential values using the decoded dequantization parameter differential value block splitting flag and a CU splitting flag. Information on a block to record a quantization differential value may have a quadtree structure.
The dequantization parameter differential value deriving module 122 derives a dequantization parameter differential value of each block determined by the dequantization differential value storage block unit determination module 121.
The dequantization parameter value prediction block determination module 123 derives determines a block for adaptive reference using context information on a neighboring block in dequantization. The context information may include a size of the block, a location of the block, and a prediction mode for the block.
The dequantization parameter value deriving module 124 derives a dequantization parameter value used for the dequantization module 125 by adding a dequantization parameter value of a prediction block derived by the dequantization parameter value prediction block determination module 123 and a dequantization parameter differential value derived by the dequantization parameter differential value deriving module 122.
The dequantization module 125 performs dequantization on the input block using the parameter derived by the dequantization parameter value deriving module 124.
Referring to
The entropy-decoding module 200 includes the dequantization parameter differential value block splitting flag deriving module 120 to derive a block partition flag used for quadtree-based adaptive dequantization, the dequantization differential value storage block unit determination module 121 to determine a block storing a QP from the derived block splitting flag, and the dequantization parameter differential value deriving module 122 to decode a dequantization parameter differential value stored in a corresponding block.
The quadtree-based dequantization parameter deriving module 210 includes the dequantization parameter value prediction block determination module 123 to determine a prediction block for reference in decoding a dequantization parameter and the dequantization parameter value deriving module 124 to derive a dequantization parameter by adding a dequantization parameter of the prediction block and the derived dequantization parameter differential value.
When cu_qp_delta_enabled_flag 300 has a value of 1 in the sequence parameter set, quantization/dequantization parameter differential values of various quadtree blocks ranging from CUs of minimum size to CUs of maximum size in all slices in a sequence may be controlled.
When a slice is split in a quadtree and encoded/decoded, the slice is first split into LCUs that are a quadtree of maximum size, which are then encoded/decoded in sequential scanning order. In encoding/decoding each LCU, an LCU may be further split into a plurality of CUs in a quadtree, and such splitting may be performed until CUs are partitioned into CUs of minimum size.
In
In
A coding tree block expresses a context of a CU. A CU having a 2N×2N size may be split into four CUs having an N×N size and encoded/decoded according to split_coding_unit_flag 420. Alternatively, the CU having a 2N×2N size may not be split into CUs of smaller size any more but be encoded/decoded as it is.
The current CU receives an input of a flag indicating whether a quantization/dequantization parameter differential value exists in a higher CU, that is, cu_qp_delta_exist_flag 421. When the current CU having a 2N×2N size is further split into CUs having an N×N size according to a value of split_coding_unit_flag 420, split_qp_delta_flag 422 is additionally encoded/decoded. Information on such additional splitting is encoded/decoded only when cu_qp_delta_enable_flag 300 stored in the sequence parameter set and cu_qp_delta_exist_flag 421 input from the higher CU have a value of 1. A value of split_qp_delta_flag 422 is encoded/decoded only when the current CU having a 2N×2N size is split into the CU having an N×N size, and is input as the value of cu_qp_delta_exist_flag 421 when the lower CUs having an N×N size are encoded/decoded.
When the value of split_qp_delta_flag 422 is 0, the current CU having a 2N×2N size is partitioned into the CUs having an N×N size but a block storing a quantization/dequantization parameter differential value is not split any more from a 2N×2N size to an N×N size. When the value of split_qp_detla_flag 422 is 0, a value of IsCuQpDeltaCoded 400 is additionally initialized to 0, so that a quantization/dequantization parameter differential value is stored only in a first N×N CU when the current CU is split into the CUs having N×N size.
When a CU is not in a skip mode, a quantization/dequantization parameter differential value may be recorded in the CU. When a value of cu_qp_delta_exist_flag 500 and 421 is 1, a quantization/dequantization parameter differential value exists in the current CU, in which case a value of cu_qp_delta 501 may be stored by a CU according to a value of cu_qp_delta_enabled_flag 300 stored in the sequence parameter set. For example, when the value of cu_qp_delta_exist_flag 500 and 421 is 1 and the value of cu_qp_delta_enabed_flag 300 is 0, cu_qp_delta 501 is not stored.
Alternatively, when a 2N×2N CU is split into four N×N CUs in a quadtree, only one quantization/dequantization parameter differential value may be stored. In this case, the quantization/dequantization parameter differential value is stored in a first CU among the four CUs, while the other three CUs do not record the quantization/dequantization parameter differential value. Here, since the value of split_qp_delta_flag 422 encoded/decoded in the 2N×2N CU is 0, the value of cu_qp_delta_exist_flag 500 input to the N×N CU is 0. Thus, although no cu_qp_delta 501 basically exists in the split four N×N CUs, a value of cu_qp_delta 501 may be stored in a first N×N CU using a variable NIsCuQpDeltaCoded. The value of cu_qp_delta 501 is not stored in the other three CUs since the first CU changes the value of IsCuQpDeltaCoded to 1 after decoding cu_qp_delta 501.
Even in this case, the value of cu_qp_delta 501 may be stored only when the value of cu_qp_delta_enabled_flag 300 stored in the sequence parameter set is 1, simultaneously checking the value of cu_qp_delta_enabled_flag 300.
A 2N×2N LCU to encode/decode may be split into four N×N CUs, each of which may be further partitioned to be processed. Even though the 2N×2N LCU is partitioned into a plurality of CUs to be encoded/decoded, when split_qp_delta_flag 422 has a value of 0 as shown in
A 2N×2N LCU to encode/decode is split into four CUs in a first stage, a second CU of which is further split. In this instance, when a flag indicating splitting into the CUs is encoded/decoded in the first stage, a splitting flag with respect to a quantization/dequantization parameter value, which is split_qp_delta_flag 422 and 631, is additionally encoded/decoded. When a value of split_qp_delta_flag 422 and 631 is 1, all four split CUs have a quantization/dequantization parameter differential value, and thus the splitting flag with respect to the quantization/dequantization parameter value, split_qp_delta_flag 422 and 631, is additionally encoded/decoded.
Even in this case, although the second N×N CU is split into CUs until a third stage, the block splitting flag for quantization/dequantization, split_qp_delta_flag 422 and 631, is 0, and thus a single quantization/dequantization parameter value is allocated for a plurality of CUs.
An encoder allocates a QP value to CU blocks determined by the quantization differential value storage block unit determination module 100 and employs a previously used QP value for remaining blocks as it is. Here, the QP value is predicted from a QP value for previous blocks, and only a QP different value is encoded.
A decoder decodes a dequantization parameter differential value in the dequantization parameter differential value deriving module 122 and derives a dequantization parameter value by adding the differential value with a dequantization parameter value of a block used for prediction.
The QP value prediction block determination module 102 and the dequantization parameter value prediction block determination module 123 serve to determine a neighboring block for reference when the encoder and the decoder predict a QP value of a current block.
In
When an LCU is split into a plurality of CUs to be encoded/decoded, a QP value of a current CU 750 to encode/decode is predicted using an average value, minimum value or maximum value of QP values of two CUs having a largest block size located on a left boundary and an upper boundary of the current CU 750 among CUs neighboring to the current CU 750.
When a QP value of a current CU 840 to encode/decode is predicted, a CU having a largest block size among CUs neighboring to the current CU is used for reference. In this case, when there are a plurality of CUs having a largest block size, an average value, minimum value or maximum value of QP values of CUs is used to predict the QP value of the current CU 840, the CUs including a top CU 820 or La selected among CUs on a left boundary of the current CU 840 and a leftmost CU 800 or Ta preferentially used for reference among CUs on an upper boundary thereof.
When an LCU is split into a plurality of CUs to be encoded/decoded, a QP value of a current CU 890 to encode/decode is predicted using CUs having a largest block size for reference among CUs neighboring to the current CU 890. Here, when there are a plurality of CUs having a largest block size on a left boundary of the current CU 890, a top CU 870 or La is used as a reference block. Likewise, when there are a plurality of CUs having a largest block size on an upper boundary of the current CU 890, a leftmost CU 850 or Ta is used as a reference block. When the reference blocks on the left and top boundaries are determined, the QP value of the current CU 890 to encode/decode is predicted using an average value, minimum value or maximum value of QP values of these two CUs.
When a QP value of a current CU 920 to encode/decode is predicted, all possible reference CUs 900, 901, 902, 910, 911 and 912 or Ta, Tb, Tc, La, Lb and Lc neighboring to the current CU are selected as reference blocks. The encoder predicts the QP value of the current CU 920 to encode using an average value, minimum value or maximum value of QP values of all possible reference CUs and encodes a QP differential value.
The decoder decodes a dequantization parameter value of the CU 920 to decode by adding the decoded QP differential value with an average value, minimum value or maximum value of dequantization parameter values of all possible reference CUs.
When a CU 950 to encode/decode is located in an LCU, a QP value of the CU 950 is predicted using all possible reference CUs 930, 931, 932, 940, 941 and 942 or La, Lb, Lc, Ta, Tb and Tc neighboring to the current CU.
The encoder predicts the QP value of the current CU 950 to encode using an average value, minimum value or maximum value of QP values of all adjacent possible reference CUs and encodes a QP differential value therebetween only.
The decoder decodes a dequantization parameter value of the CU 950 to decode by adding the decoded QP differential value with an average value, minimum value or maximum value of dequantization parameter values of all adjacent possible reference CUs.
When a CU 1020 located on a boundary between LCUs is encoded/decoded, a CU 1012 or Lc having a largest block size among possible reference CUs 1010, 1011 and 1012 or La, Lb and Lc located on a left boundary of the current CU 1020 is used for reference. Here, when there are one or more CUs having a largest block size among the possible reference CUs on the left boundary, a top CU is selected as a reference block.
The encoder predicts a QP value of the CU 1020 to encode using a QP value of the CU 1012 or Lc selected on the left boundary as the reference block and encodes a QP differential value therebetween.
The decoder decodes a dequantization parameter differential value of the CU 1020 to decode and adds the differential value with a dequantization parameter value of the CU 1012 or Lc, thereby decoding a dequantization parameter value of the CU 1020.
When an LCU is split into a plurality of CUs to be encoded/decoded, a CU 1030 or La having a largest block size among CUs 1030, 1031 and 1032 or La, Lb and Lc located on a left boundary of a CU 1050 to encode/decode is used for reference. Here, when there are one or more CUs having a largest block size among the CUs on the left boundary, a top CU 1030 or La is selected as a reference block.
The encoder predicts a QP value of the CU 1050 to encode using a QP value of the CU 1030 or La selected on the left boundary as the reference block and encodes a QP differential value therebetween.
The decoder decodes a dequantization parameter differential value of the CU 1050 to decode and adds the differential value with a dequantization parameter value of the CU 1030 or La, thereby decoding a dequantization parameter value of the CU 1050.
When a CU 1120 located on a boundary between LCUs is encoded/decoded, all possible reference CUs 1110, 1111 and 1112 or La, Lb and Lc located on a left boundary of the current CU 1220 are used as reference blocks.
The encoder predicts a QP value of the CU 1120 to encode using an average value, minimum value or maximum value of QP values of all possible reference CUs 1110, 1111 and 1112 or La, Lb and Lc located on the left boundary and encodes a QP differential value.
The decoder decodes a dequantization parameter differential value of the CU 1120 to decode and decodes a dequantization parameter value of the CU 1120 to decode by adding the differential value with an average value, minimum value or maximum value of dequantization parameter values of all possible reference CUs 1110, 1111 and 1112 or La, Lb and Lc.
When an LCU is split into a plurality of CUs to be encoded/decoded, all possible reference CUs located on a left boundary of a CU 1150 to encode/decode are used as reference blocks.
The encoder predicts a QP value of the CU 1150 to encode using an average value, minimum value or maximum value of QP values of all possible reference CUs located on the left boundary and encodes a QP differential value.
The decoder decodes a dequantization parameter differential value of the CU 1150 to decode and decodes a dequantization parameter value of the CU 1150 to decode by adding the differential value with an average value, minimum value or maximum value of dequantization parameter values of all possible reference CUs located on the left boundary.
Sim, Dong Gyu, Nam, Jung Hak, Jo, Hyung Ho
Patent | Priority | Assignee | Title |
RE47465, | Jun 21 2011 | Dolby Laboratories Licensing Corporation | Method and apparatus for adaptively encoding and decoding a quantization parameter based on a quadtree structure |
RE49330, | Jun 21 2011 | Dolby Laboratories Licensing Corporation | Method and apparatus for adaptively encoding and decoding a quantization parameter based on a quadtree structure |
Patent | Priority | Assignee | Title |
8315310, | Jan 08 2010 | Malikie Innovations Limited | Method and device for motion vector prediction in video transcoding using full resolution residuals |
8340188, | Jan 08 2010 | Malikie Innovations Limited | Method and device for motion vector estimation in video transcoding using union of search areas |
8358698, | Jan 08 2010 | Malikie Innovations Limited | Method and device for motion vector estimation in video transcoding using full-resolution residuals |
8559519, | Jan 08 2010 | Malikie Innovations Limited | Method and device for video encoding using predicted residuals |
8989256, | May 25 2011 | GOOGLE LLC | Method and apparatus for using segmentation-based coding of prediction information |
20050175093, | |||
20050180502, | |||
20080240250, | |||
20110274162, | |||
CN101978697, | |||
EP2506579, | |||
JP2012191294, | |||
JP20135111, | |||
JP2013529021, | |||
JP2013529045, | |||
JP2013542689, | |||
JP2014506752, | |||
KR1020080004855, | |||
KR1020100087600, | |||
KR1020110015002, | |||
WO2009158113, | |||
WO2011064926, | |||
WO2011140211, | |||
WO2012023806, | |||
WO2012042890, | |||
WO2012062161, | |||
WO2012102867, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 29 2013 | SIM, DONG GYU | INTELLECTUAL DISCOVERY CO , LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 045554 | /0326 | |
Aug 29 2013 | NAM, JUNG HAK | INTELLECTUAL DISCOVERY CO , LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 045554 | /0326 | |
Aug 29 2013 | JO, HYUNG HO | INTELLECTUAL DISCOVERY CO , LTD | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 045554 | /0326 | |
Jul 31 2015 | INTELLECTUAL DISCOVERY CO., LTD. | (assignment on the face of the patent) | / | |||
Sep 30 2019 | INTELLECTUAL DISCOVERY CO , LTD | Dolby Laboratories Licensing Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053764 | /0367 |
Date | Maintenance Fee Events |
Jun 28 2018 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Dec 24 2018 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Nov 16 2022 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Jan 16 2021 | 4 years fee payment window open |
Jul 16 2021 | 6 months grace period start (w surcharge) |
Jan 16 2022 | patent expiry (for year 4) |
Jan 16 2024 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 16 2025 | 8 years fee payment window open |
Jul 16 2025 | 6 months grace period start (w surcharge) |
Jan 16 2026 | patent expiry (for year 8) |
Jan 16 2028 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 16 2029 | 12 years fee payment window open |
Jul 16 2029 | 6 months grace period start (w surcharge) |
Jan 16 2030 | patent expiry (for year 12) |
Jan 16 2032 | 2 years to revive unintentionally abandoned end. (for year 12) |