In a music reproducing apparatus for converting audio data into audio data of different data format so as to reproduce it, gapless reproduction and cross-fade reproduction are performed in a switching manner, and generation of a noise at time of the gapless reproduction is repressed. When a reproducing section performs the gapless reproduction, a converting section performs conversion into PCM data to be reproduced latterly using a buffer used for conversion into the PCM data to be reproduced formerly. Further, when the reproducing section performs the cross-fade reproduction, the converting section generates a buffer different from the buffer used for the conversion into the PCM data to be reproduced formerly in a storage section, and performs the conversion into the PCM data to be reproduced latterly using the generated buffer.
|
1. A music reproducing apparatus for performing gapless reproduction for reproducing two audio data sequentially and seamlessly and cross-fade reproduction for reproducing two audio data while performing fade-in and fade-out, the apparatus comprising:
a converting section for generating a buffer in a storage section, and converting first audio data into second audio data of different data format using the generated buffer; and
a reproducing section for performing the gapless reproduction and the cross-fade reproduction on the second audio data, wherein
the converting section
performs conversion into the second audio data to be reproduced latterly using the buffer used for the conversion into the second audio data to be reproduced formerly when the reproducing section performs the gapless reproduction,
generates a buffer different from the buffer used for the conversion into the second audio data to be reproduced formerly in the storage section, and performs the conversion into the second audio data to be produced latterly using the generated buffer when the reproducing section performs the cross-fade reproduction.
5. A storage medium in which a music reproducing program is stored, the music reproducing program allows a computer to function as a music reproducing apparatus for performing gapless reproduction for reproducing two audio data sequentially and seamlessly and
cross-fade reproduction for reproducing two audio data while performing fade-in and fade-out, the program allowing
the computer to function as:
a converting section for generating a buffer in a storage section, and converting first audio data into second audio data of different data format using the generated buffer; and
a reproducing section for performing the gapless reproduction and the cross-fade reproduction on the second audio data,
the converting section
performs conversion into the second audio data to be reproduced latterly using the buffer used for the conversion into the second audio data to be reproduced formerly when the reproducing section performs the gapless reproduction,
generates a buffer different from the buffer used for the conversion into the second audio data to be reproduced formerly in the storage section, and performs the conversion into the second audio data to be reproduced latterly using the generated buffer when the reproducing section performs the cross-fade reproduction.
2. The music reproducing apparatus according to
stores a sampling frequency of the first audio data converted into the second audio data in the storage section,
when the sampling frequency stored in the storage section is different from the sampling frequency of the first audio data converted into the second audio data, generates a buffer that is different from the buffer used for the conversion into the second audio data to be reproduced formerly in the storage section even in a case where the reproducing section performs the gapless reproduction, and performs the conversion into the second audio data to be reproduced latterly using the generated buffer.
3. The music reproducing apparatus according to
4. The music reproducing apparatus according to
the second audio data is PCM data.
|
1. Field of the Invention
The present invention relates to a music reproducing apparatus.
2. Description of the Related Art
A music reproducing program that allows a smartphone or a tablet PC to function as a music reproducing apparatus is present. The mainstream of audio data to be reproduced by the music reproducing apparatus is PCM data that is encoded by a PCM (Pulse Code Modulation) system in which a sampling frequency is 44.1 kHz and the number of quantum bits is 16 bits. In recent years, there have been DSD data that is encoded by a 1-bit DSD (Direct Stream Digital) system in which a sampling frequency is 2.8224 MHz (=44.1 kHz×64) as audio data. However, since a lot of smartphones that function as the music reproducing apparatus cannot directly reproduce DSD data, the music reproducing program occasionally allows the smartphones to convert DSD data into PCM data and reproduce the PCM data. The DSD data is converted into the PCM data by a low-pass filter process for converting DSD data into multi-bit PCM data of high sampling frequency (2.8224 MHz), and a thinning process for thinning out the multi-bit PCM data of high sampling frequency into PCM data of low sampling frequency (44.1 kHz). In the low-pass filter process, a buffer is generated for data delay.
JP 2007-179604 A discloses an apparatus for performing gapless reproduction for reproducing two audio data sequentially and seamlessly so that a soundless portion is not generated between an audio caused by the audio data to be reproduced formerly and an audio caused by the audio data to be reproduced latterly. Further, JP 9-282800 A discloses an apparatus for performing cross-fade reproduction for reproducing two audio data while performing fade-out and fade-in so that while an audio of the audio data to be reproduced formerly is being faded out, an audio of the audio data to be reproduced latterly is faded in.
In smartphones that cannot reproduce the above DSD data, DSD data should be converted into PCM data also in the gapless reproduction and the cross-fade reproduction. When the gapless reproduction is performed, a conventional music reproducing program generates a new buffer at the time of converting the audio data to be reproduced latterly separately from the buffer generated at the time of converting the audio data to be reproduced formerly. For this reason, a noise is generated between the audio of the audio data to be reproduced formerly and the audio of the audio data to be reproduced latterly at the time of the gapless reproduction.
It is an object of the present invention to enable gapless reproduction and cross-fade reproduction to be performed in a switching manner and to repress generation of noises at the time of the gapless reproduction in a music reproducing apparatus for converting audio data into audio data of different data format so as to reproduce it.
A music reproducing apparatus for performing gapless reproduction for reproducing two audio data sequentially and seamlessly and cross-fade reproduction for reproducing two audio data while performing fade-in and fade-out, the apparatus comprising: a converting section for generating a buffer in a storage section, and converting first audio data into second audio data of different data format using the generated buffer; and a reproducing section for performing the gapless reproduction and the cross-fade reproduction on the second audio data, wherein the converting section performs conversion into the second audio data to be reproduced latterly using the buffer used for the conversion into the second audio data to be reproduced formerly when the reproducing section performs the gapless reproduction, generates a buffer different from the buffer used for the conversion into the second audio data to be reproduced formerly in the storage section, and performs the conversion into the second audio data to be produced latterly using the generated buffer when the reproducing section performs the cross-fade reproduction.
In the present invention, when the gapless reproduction is performed, conversion into second audio data to be reproduced latterly is performed by using a buffer used at the time of conversion into second audio data to be reproduced formerly. Therefore, separately from the buffer generated at the time of the conversion into the second audio data to be reproduced formerly, a new buffer is not generated at the time of the conversion into the second audio data to be reproduced latterly. For this reason, the generation of noises is repressed between the audio of the audio data to be reproduced formerly and the audio of the audio data to be reproduced latterly at the time of the gapless reproduction. Further, when the cross-fade reproduction is performed, a buffer different from the buffer used for the conversion into the second audio data to be reproduced formerly is generated, and the conversion into the second audio data to be reproduced latterly is performed by using the generated buffer. For this reason, in the music reproducing apparatus that converts audio data into audio data having a different data format so as to reproduce it, use of a single buffer and generation of a plurality of buffers are switched, so that the gapless reproduction and the cross-fade reproduction can be performed in a switching manner.
Preferably, wherein the converting section stores a sampling frequency of the first audio data converted into the second audio data in the storage section, when the sampling frequency stored in the storage section is different from the sampling frequency of the first audio data converted into the second audio data, generates a buffer that is different from the buffer used for the conversion into the second audio data to be reproduced formerly in the storage section even in a case where the reproducing section performs the gapless reproduction, and performs the conversion into the second audio data to be reproduced latterly using the generated buffer.
When a sampling frequency of first audio data converted into the second audio data formerly is different from a sampling frequency of first audio data converted into the second audio data latterly, the conversion into the second audio data to be reproduced latterly cannot be performed by using the buffer used for the conversion of the second audio data to be reproduced formerly. In the present invention, when the sampling frequency of the first audio data converted into the second audio data formerly is different from the sampling frequency of the first audio data converted into the second audio data latterly, a buffer different from the buffer used for the conversion of the second audio data to be reproduced formerly is generated even at the gapless reproduction, and the conversion into the second audio data to be reproduced latterly is performed by using the generated buffer. For this reason, even when the sampling frequencies of both the former and latter first audio data are different from each other, the first audio data is converted into the second audio data, so that the gapless reproduction can be performed.
Preferably, wherein when the converting section does not perform the conversion into the second audio data to be reproduced formerly, the converting section generates a buffer in the storage section even in the case where the reproducing section performs the gapless reproduction, and performs the conversion into the second audio data to be reproduced latterly using the generated buffer.
When the conversion into the second audio data to be reproduced formerly is not performed, a buffer is not generated in a storage section. For this reason, the conversion into the second audio data to be reproduced latterly cannot be performed by using the buffer. In the present invention, when the conversion into the second audio data to be reproduced formerly is not performed, a buffer is generated even at the gapless reproduction, and the conversion into the second audio data to be reproduced latterly is performed by using the generated buffer. For this reason, even when the conversion into the second audio data to be reproduced formerly is not performed, the first audio data is converted into the second audio data so that the gapless reproduction can be performed.
Preferably, wherein the first audio data is DSD data, the second audio data is PCM data.
In the present invention, the DSD data is converted into the PCM data, and the gapless reproduction and the cross-fade reproduction of the converted PCM data can be performed.
A storage medium in which a music reproducing program is stored, the music reproducing program allows a computer to function as a music reproducing apparatus for performing gapless reproduction for reproducing two audio data sequentially and seamlessly and cross-fade reproduction for reproducing two audio data while performing fade-in and fade-out, the program allowing the computer to function as: a converting section for generating a buffer in a storage section, and converting first audio data into second audio data of different data format using the generated buffer; and a reproducing section for performing the gapless reproduction and the cross-fade reproduction on the second audio data, the converting section performs conversion into the second audio data to be reproduced latterly using the buffer used for the conversion into the second audio data to be reproduced formerly when the reproducing section performs the gapless reproduction, generates a buffer different from the buffer used for the conversion into the second audio data to be reproduced formerly in the storage section, and performs the conversion into the second audio data to be reproduced latterly using the generated buffer when the reproducing section performs the cross-fade reproduction.
An embodiment of the present invention is described below.
The controller 2 controls respective sections composing the smartphone 1 according to an OS (Operating System) program or an application program, and functions as a reproducing section 24 (see
The storage section 3 is composed of a RAM (Random Access Memory) that functions as a main memory of the controller 2, a ROM (Read Only Memory) for storing a control program, and a flash memory for storing programs such as application programs including an OS program and the music reproducing program, and various data such as audio data. The storage section 3 is not limited to the illustrated constitution, and may include an HDD (Hard Disk Drive).
The display section 4 displays various images (includes still images and moving images), and is composed of a liquid crystal panel. The operating section 5 has operation keys for performing various settings, and a touch panel that is linked with the display section 4. A user can input various characters such as telephone numbers and mail addresses and set communication via the operating section 5. The speaker 6 outputs various audios such as music based on audio signals output from the controller 2. The headphone terminal 7 is for connecting a headphone 100. The controller 2 outputs an audio signal to the headphone 100 via the headphone terminal 7. The input/output I/F 8 functions as an interface for data communication between the smartphone 1 and a peripheral device, not shown. The NW communication section 9 can be connected to an internet via a mobile phone network and a mobile phone base station, not shown. The smartphone 1 can telephone and communicate with another terminal via the NW communication section 9. The BT communication section 10 wirelessly communicates with a peripheral device, not shown, that supports the Bluetooth standards based on the Bluetooth standards.
The controller 2 is described below. As shown in
When audio data to be reproduced is PCM data, the decoding section 22 decodes the PCM data. When the audio data to be reproduced is DSD data, the converting section 23 converts the DSD data (first audio data) into PCM data (second audio data) of a different data format. Concretely, the converting section 23 executes a low-pass filter process for converting the DSD data into multi-bit PCM data of a high sampling frequency (for example, 2.8224 MHz), and a thinning process for thinning out the multi-bit PCM data of high sampling frequency into PCM data of low sampling frequency (in this embodiment, 44.1 kHz), so as to convert the DSD data into PCM data. The converting section 23 generates buffers 31 and 32 in the storage section 3 as needed in the low-pass filter process. The sampling frequency of the multi-bit PCM data generated by the low-pass filter process depends on the sampling frequency of the DSD data.
In this embodiment, as shown in
The reproducing section 24 executes reproducing processes such as an equalizing process, a D/A converting process and a volume adjusting process on the data output from the decoding section 22 or the converting section 23, and outputs an audio signal to the speaker 6 or the headphone terminal 7. Further, the reproducing section 24 performs the gapless reproduction for reproducing two audio data sequentially and seamlessly, and the cross-fade reproduction for reproducing two audio data while performing fade-in and fade-out.
An operation of the converting section 23 for converting DSD data into PCM data so as to perform the gapless reproduction is described. When the music reproducing program is activated to firstly convert DSD data into PCM data, the converting section 23 generates the buffer 31 in the storage section 3. The converting section 23 converts the DSD data into PCM data using the buffer 31 generated in the storage section 3. At this time, the converting section 23 stores the sampling frequency of the DSD data converted into the PCM data and information representing that the audio data is the DSD data in the storage section 3 (see
On the other hand, when the sampling frequency of the DSD data converted into the PCM data formerly (the sampling frequency stored in the storage section 3) is different from the sampling frequency of the DSD data converted into the PCM data latterly, the converting section 23 generates the buffer 32, which is different from the buffer 31 used for the conversion of the PCM data to be reproduced formerly in the storage section 3. The converting section 23 performs the conversion into the PCM data to be reproduced latterly using the generated buffer 32. At this time, the converting section 23 stores the sampling frequency of the DSD data converted into the PCM data and information representing that the audio data is the DSD data in the storage section 3 (see
An operation of the converting section 23 for converting DSD data into PCM data so as to perform the cross-fade reproduction is described below. When the music reproducing program is activated to firstly convert DSD data into PCM data, the converting section 23 generates the buffer 31 in the storage section 3. The converting section 23 converts the DSD data into PCM data using the buffer 31 generated in the storage section 3. At this time, the converting section 23 stores the sampling frequency of the DSD data converted into the PCM data and information representing that the audio data is the DSD data in the storage section 3 (see
When the audio data to be reproduced is the PCM data, the decoding section 22 decodes the PCM data. At this time, the decoding section 22 stores the sampling frequency of the PCM data and information representing that the audio data is the PCM data in the storage section 3 (see
Next, a processing operation of the smartphone 1 for reproducing audio data according to the execution of the music reproducing program stored in the storage section 3 is described with reference to a flowchart shown in
The reproducing section 24 determines whether the cross-fade reproduction is performed (S3). When the reproducing section 24 determines that the cross-fade reproduction is performed (S3: Yes), it continues the cross-fade reproduction (S4). When the reproducing section 24 determines that the cross-fade reproduction is not performed (S3: No), it determines whether the cross-fade reproduction is enabled based on settings stored in the storage section 3 (S5). When the reproducing section 24 determines that the cross-fade reproduction is enabled (S5: Yes), it determines whether the reproducing position of the current audio data is within the range of a starting position of the cross-fade reproduction on next audio data based on the reproducing position of the audio data updated at S2 (S6). The starting position of the cross-fade reproduction on next audio data is, for example, 5 seconds before the reproduction end of the reproducing position of the current audio data. When the reproducing section 24 determines that the reproducing position of the current audio data is within the range of the starting position of the cross-fade reproduction on the next audio data (S6: Yes), the reproducing section 24 prepares for the cross-fade reproduction on next audio data (S7). After S7, the reproducing section 24 determines whether the cross-fade reproduction can be performed on the prepared audio data (S8). Concretely, the reproducing section 24 compares the sampling frequency of the audio data obtained at S1 with the sampling frequency of the prepared audio data. When the sampling frequency of the audio data obtained at S1 matches with the sampling frequency of the prepared audio data, the reproducing section 24 determines that the cross-fade reproduction can be performed on the prepared audio data. On the other hand, when the sampling frequency of the audio data obtained at S1 is different from the sampling frequency of the prepared audio data, the reproducing section 24 determines that the cross-fade reproduction cannot be performed on the prepared audio data.
When the reproducing section 24 determines that the cross-fade reproduction can be performed on the prepared audio data (S8: Yes), it executes the process at S1. When the reproducing section 24 determines that the cross-fade reproduction cannot be performed on the prepared audio data (S8: No), or the cross-fade reproduction is not enabled (S5: No), it determines whether the reproducing position of the current audio data is a reproduction end in order to perform the gapless reproduction (S9). When the reproducing section 24 determines that the reproducing position of the current audio data is not the reproduction end (S9: No), it executes the process at S1. When the reproducing section 24 determines that the reproducing position of the current audio data is the reproduction end (S9: Yes), the reproducing section 24 prepares for the gapless reproduction on next audio data (S10). After the process at S10, the reproducing section 24 executes the process at S1.
A processing operation of the smartphone 1 for executing the audio data preparing process (S7 and S10 shown in
When the reproducing section 24 determines that the audio data to be reproduced is DSD data (S101: Yes), it determines whether the cross-fade reproduction is enabled based on the settings stored in the storage section 3 (S103). When the reproducing section 24 determines that the cross-fade reproduction is not enabled (S103: No), the reproducing section 24 determines whether audio data to be reproduced formerly is converted from DSD data into PCM data by the converting section 23 (S104). Since the information about the audio data to be reproduced formerly is stored in the storage section 3 as shown in
When the reproducing section 24 determines that the audio data to be reproduced formerly is converted from DSD data into PCM data by the converting section 23 (S104: Yes), the converting section 23 determines whether the sampling frequency of the DSD data converted into the PCM data formerly (the sampling frequency stored in the storage section 3) matches with the sampling frequency of the DSD data to be converted into the PCM data (S105). When the converting section 23 determines that the sampling frequency of the DSD data converted into the PCM data formerly matches with the sampling frequency of the DSD data to be converted into the PCM data (S105: Yes), it prepares for the conversion from the DSD data into PCM data (S108) using the existent buffer (the buffer used for the conversion into the PCM data that is reproduced formerly) (S107).
When the converting section 23 determines that the sampling frequency of the DSD data converted into the PCM data formerly does not match with the sampling frequency of the DSD data to be converted into the PCM data, namely, they are different from each other (S105: No), or the reproducing section 24 determines that the cross-fade reproduction is enabled (S103: Yes), it generates a new buffer in the storage section 3 (S107). That is to say, the converting section 23 generates the buffer different from the buffer used for the conversion into PCM data to be reproduced formerly in the storage section 3. Further, when the reproducing section 24 determines that the audio data to be reproduced formerly is not converted from the DSD data into the PCM data by the converting section 23 (S104: No), the converting section 23 generates a new buffer (S107). This is because the audio data to be reproduced formerly is the PCM data, and thus a buffer is not generated in the storage section 3. The converting section 23 prepares for the conversion from the DSD data into the PCM data using the buffer generated at S107 (S108). After the process at S102, the decoding section 22 stores the information about the audio data in the storage section 3 (S109) (see
In this embodiment, as described above, when the gapless reproduction is performed, the converting section 23 performs the conversion into the PCM data to be reproduced latterly using the buffer used for the conversion into the PCM data to be reproduced formerly. Therefore, separately from the buffer generated at the time of the conversion into the PCM data to be reproduced formerly, a new buffer is not generated for the conversion into PCM data to be reproduced latterly. For this reason, the generation of noises is repressed between the audio of the audio data to be reproduced formerly and the audio of the audio data to be reproduced latterly at the time of the gapless reproduction. Further, when the cross-fade reproduction is performed, the buffer that is different from the buffer used for the conversion into the PCM data to be reproduced formerly is generated, and the conversion into the PCM data to be reproduced latterly is performed by using the generated buffer. For this reason, in the smartphone 1 that converts audio data into one with different data format so as to reproduce it, the use of single buffer and the generation of a plurality of buffers are switched so that the gapless reproduction and the cross-fade reproduction can be performed in a switching manner.
Further, in this embodiment, when the sampling frequency of the DSD data converted into the PCM data formerly is different from the sampling frequency of the DSD data converted into the PCM data latterly, a buffer that is different from the buffer used for the conversion into the PCM data to be reproduced formerly is generated by the converting section 23 even in the gapless reproduction, and the conversion into the PCM data to be reproduced latterly is performed by using the generated buffer. For this reason, even when the sampling frequencies of the former and latter DSD data are different from each other, the conversion from the DSD data into the PCM data is performed so that the gapless reproduction can be performed.
Further, in this embodiment, when the converting section 23 does not perform the conversion into the PCM data to be reproduced formerly, a buffer is generated even in the gapless reproduction, and the conversion into the PCM data to be reproduced latterly is performed by using the generated buffer. For this reason, even when the conversion into the PCM data to be reproduced formerly is not performed, the DSD data is converted into the PCM data, so that the gapless reproduction can be performed.
The embodiment of the present invention is described above, but the mode to which the present invention is applicable is not limited to the above embodiment and can be suitably varied without departing from the scope of the present invention.
The above embodiment describes the case where the converting section 23 converts DSD data (first audio data) into PCM data (second audio data) having different data format. When audio data (first audio data) of high sampling frequency is converted into audio data (second audio data) of low sampling frequency having different data format (down sampling), the present invention is not limited to the case where DSD data is converted into PCM data.
In the above embodiment, the smartphone 1 is connected to the headphone 100 with wire via the headphone terminal 7. Not limited to this, in a case of a wireless headphone compatible with Bluetooth standards, for example, the smartphone 1 may be wirelessly connected to the headphone via the BT communication section 10.
The above embodiment describes the case where the music reproducing program is installed into the smartphone and the smartphone is made to function as a music reproducing apparatus. Not limited to this, the device that is made to function as the music reproducing apparatus may be a Tablet PC, a feature phone, and a mobile game machine.
The present invention can be suitably employed in the music reproducing apparatus and the music reproducing program for reproducing music.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
4644400, | Apr 09 1984 | NEC Corporation | Digital audio synchronizing system with cross-fade means |
5168363, | Oct 16 1989 | Sony Corporation | Video signal parocessing apparatus with memory and crossfader |
5177801, | Mar 28 1990 | Sony Corporation | Cross fader for editing audio signals |
5803747, | Apr 18 1994 | Yamaha Corporation | Karaoke apparatus and method for displaying mixture of lyric words and background scene in fade-in and fade-out manner |
6362764, | Aug 05 1999 | Yamaha Corporation | Digital to analog conversion apparatus and method with cross-fading between new and old data |
7292902, | Nov 12 2003 | Dolby Laboratories Licensing Corporation | Frame-based audio transmission/storage with overlap to facilitate smooth crossfading |
7302396, | Apr 27 1999 | Intel Corporation | System and method for cross-fading between audio streams |
7933422, | Dec 24 2002 | Yamaha Corporation | Operation panel structure and control method and control apparatus for mixing system |
8423852, | Apr 15 2008 | Qualcomm Incorporated | Channel decoding-based error detection |
8473084, | Sep 01 2010 | Apple Inc.; Apple Inc | Audio crossfading |
8805693, | Aug 18 2010 | Apple Inc. | Efficient beat-matched crossfading |
8904453, | Jun 10 2012 | Apple Inc. | Systems and methods for seamlessly switching between media streams |
20020133357, | |||
20050016364, | |||
20090083047, | |||
20100063825, | |||
20100208901, | |||
20150107442, | |||
JP2005044409, | |||
JP2007179604, | |||
JP2009163192, | |||
JP9282800, | |||
WO2009104402, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Oct 01 2014 | TACHIMORI, NOBUYA | Onkyo Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 034071 | /0748 | |
Oct 14 2014 | Onkyo Corporation | (assignment on the face of the patent) | / | |||
Dec 19 2023 | ONKYO HOME ENTERTAINMENT CORPORATION | Onkyo Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 066074 | /0383 | |
Dec 19 2023 | ONKYO HOME ENTERTAINMENT CORPORATION | Onkyo Corporation | CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF ASSIGNEE ADDRESS SHOULD BE CHUO-KU NOT CHOU-KU PREVIOUSLY RECORDED ON REEL 066074 FRAME 0383 ASSIGNOR S HEREBY CONFIRMS THE ASSIGNMENT | 066343 | /0076 |
Date | Maintenance Fee Events |
Jun 20 2019 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Aug 28 2023 | REM: Maintenance Fee Reminder Mailed. |
Feb 12 2024 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Jan 05 2019 | 4 years fee payment window open |
Jul 05 2019 | 6 months grace period start (w surcharge) |
Jan 05 2020 | patent expiry (for year 4) |
Jan 05 2022 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jan 05 2023 | 8 years fee payment window open |
Jul 05 2023 | 6 months grace period start (w surcharge) |
Jan 05 2024 | patent expiry (for year 8) |
Jan 05 2026 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jan 05 2027 | 12 years fee payment window open |
Jul 05 2027 | 6 months grace period start (w surcharge) |
Jan 05 2028 | patent expiry (for year 12) |
Jan 05 2030 | 2 years to revive unintentionally abandoned end. (for year 12) |