An audio signal processor is composed of a data path unit, a mode register and a state machine unit. The data path unit applies one or more arithmetical operation to an audio signal for performing signal processing of the audio signal. The mode register stores mode information specifying the signal processing to be performed by the data path unit. The state machine unit sequentially feeds control signals according to the mode information for enabling the data path unit to apply one or more arithmetical operation to the audio signal so as to perform the signal processing. The performed signal processing is composed of the one or more arithmetical operations, and is specified by the mode information stored in the mode register.
|
6. A method of processing an audio signal, comprising the steps of:
applying, by a data path unit, at least one arithmetical operation to an audio signal for performing signal processing of the audio signal;
registering mode information into a mode register, which specifies the signal processing to be performed;
sequentially feeding control signals for enabling application of the at least one arithmetical operation by the data path unit to the audio signal so as to perform the signal processing, which includes the at least one arithmetical operation and which is specified by the registered mode information;
generating, by a state machine unit, a control signal every time a clock pulse is supplied at a given period for enabling the data path unit to perform the signal processing specified by the registered mode information stored;
providing the state machine unit with a status signal, which indicates a state of the arithmetical operation under execution; and
determining on the basis of the provided status signal a content of the control signal which should be sent to the data path unit when a next clock pulse is supplied.
1. An audio signal processor comprising:
a data path unit that applies at least one arithmetical operation to an audio signal for performing signal processing of the audio signal;
a mode register that stores mode information specifying the signal processing to be performed by the data path unit; and
a state machine unit that sequentially feeds control signals for enabling the data path unit to apply at least one arithmetical operation to the audio signal so as to perform the signal processing, which includes the at least one arithmetical operation and which is specified by the mode information stored in the mode register, wherein
the state machine unit generates a control signal every time a clock pulse is supplied at a given period for enabling the data path unit to perform the signal processing specified by the mode information stored in the mode register,
the data path unit provides the state machine unit with a status signal, which indicates a state of the arithmetical operation under execution, and
the state machine unit determines on the basis of the provided status signal a content of the control signal which should be sent to the data path unit when a next clock pulse is supplied.
7. A computer implemented method for use in an audio signal processor, the computer implemented method, when executed by the audio signal processor, performs the method comprising the steps of:
applying, by a data path unit, at least one arithmetical operation to an audio signal for performing signal processing of the audio signal;
registering mode information into a mode register, which specifies the signal processing to be performed;
sequentially feeding control signals for enabling application of the at least one arithmetical operation by the data path unit to the audio signal so as to perform the signal processing, which includes the at least one arithmetical operation and which is specified by the registered mode information;
generating, by a state machine unit, a control signal every time a clock pulse is supplied at a given period for enabling the data path unit to perform the signal processing specified by the registered mode information stored;
providing the state machine unit with a status signal, which indicates a state of the arithmetical operation under execution; and
determining on the basis of the provided status signal a content of the control signal which should be sent to the data path unit when a next clock pulse is supplied.
2. The audio signal processor according to
3. The audio signal processor according to
4. The audio signal processor according to
5. The audio signal processor according to
|
The present invention relates to an audio signal processor for performing various acoustic processing for audio signals.
There have been provided audio signal processors capable of performing a plurality of types of arithmetical operations such as filtering, equalizer processing and sound image localization for audio signals. In this regard, filtering and other arithmetical operations each require a relatively large arithmetic circuit including a multiplier and an accumulator. Therefore, if it is attempted to form an audio signal processor capable of performing complicated signal processing composed of a plurality of arithmetical operations, a circuit therefore becomes extremely large. Moreover, the large circuit leads to high power consumption of the audio signal processor due to operation of the circuit. On the other hand, some audio signal processors perform signal processing by receiving audio signals of a plurality of channels in different formats such as, for example, different sampling frequencies. In this type of audio signal processor, signal processing is performed for input digital audio signals using arithmetic circuits prepared for respective channels, the digital audio signals of the respective channels after the signal processing are D/A converted, and then the signals are mixed and output. Since this type of audio equipment has an arithmetic circuit for each channel, it has also a large-sized circuit for signal processing and is high in power consumption. To resolve these drawbacks, there has been provided an audio signal processor for sequentially performing a plurality of types of arithmetical operations such as filtering and equalizer processing with time sharing control by using a common arithmetic circuit. According to this type of audio signal processor, a single arithmetic circuit is used under the time sharing control, and therefore a compact circuitry is achieved. This type of audio signal processor is disclosed in, for example, Patent Document 1, Japanese Laid-Open Patent Publication (Kokai) No. H12(2000)-122650.
The aforementioned conventional audio signal processor sequentially performs predetermined types of arithmetical operations in the fixed order. Therefore, when it is attempted to provide market with audio signal processors different in contents of audio signal processing conforming to various specifications, there is a need for developing and manufacturing audio signal processors for each of the specifications, thereby increasing development and manufacturing costs problematically. As a method of resolving this problem, there is a method of realizing diverse specifications, for example, by preparing a so-called full-featured audio signal processor, which can perform various arithmetical operations such as filtering, equalizer processing and sound image localization, and then omitting filtering for example in some specifications, but not omitting filtering in other specifications or so. For example, in filtering, the omission of the arithmetical operation can be achieved by a method of setting a filter coefficient for a filtering operation at “1” so as to make digital audio signals pass by the arithmetic circuit. Even if being passed by, however, the arithmetic circuit operates at that time and therefore wasteful power is consumed for unnecessary signal processing problematically.
Audio signal processors capable of performing various signal processing for audio data of a plurality of channels are in widespread use. Focusing on a configuration for signal processing, these audio signal processors can be mainly classified into two types. As shown in
According to the aforementioned first audio signal processor, it is possible to reduce power consumption by deactivating data paths of channels not in use. This audio signal processor, however, has a problem that a data path need be provided for each channel, thereby causing a large-sized processor, by which a chip area becomes large when it is formed by an LSI. According to the second audio signal processor, only a single data path need be provided, thereby enabling a small-sized processor device. Therefore, when it is formed by an LSI, the chip area can be reduced. This audio signal processor, however, always performs operations of all channels even if audio data of only a part of channels is input, and therefore it performs essentially unnecessary operations, thereby consuming wasteful power problematically.
In view of the circumstances stated above, the present invention has been provided. Therefore, it is an object of the present invention to provide an audio signal processor capable of holding down power consumption and performing a wide variety of signal processing. It is another object of the present invention to provide an audio signal processor of a plurality of channels capable of achieving a downsized configuration and holding down power consumption.
To achieve the above noted objects, the present invention provides in its one aspect an audio signal processor, which comprises a data path unit that applies one or more arithmetical operation to an audio signal for performing signal processing of the audio signal, a mode register that stores mode information specifying the signal processing to be performed by the data path unit, and a state machine unit that sequentially feeds control signals for enabling the data path unit to apply one or more arithmetical operation to the audio signal so as to perform the signal processing, which is composed of the one or more arithmetical operations and which is specified by the mode information stored in the mode register.
According to this audio signal processor, the data path unit can be caused to perform a variety of signal processing by updating the mode information held in the mode register. Moreover, the data path unit performs only the arithmetical operations forming the signal processing without wasteful operations, thereby holding down the power consumption.
In a preferred mode, the state machine unit feeds the control signal conveying information indicating a location of input data of the audio signal to be subjected to each arithmetical operation and information indicating an output destination for the result of each arithmetical operation.
The inventive audio signal processor may further comprises a plurality of interfaces that receive an audio signal from an outside or generate an audio signal based on a source signal supplied from the outside and that supply the audio signals to the data path unit, wherein the state machine unit generates a control signal for enabling the data path unit to execute an arithmetical operation for converting a format of the audio signals supplied from the interfaces to a predetermined format. In such a case, the state machine unit generates a control signal for enabling the data path unit to execute an arithmetical operation for mixing a plurality of audio signals which have a same format and which are loaded into the data path unit.
Preferably, the state machine unit generates a control signal every time a clock pulse is supplied at a given period for enabling the data path unit to perform the signal processing specified by the mode information stored in the mode register. In such a case, the data path unit provides the state machine unit with a status signal, which indicates a state of the arithmetical operation under execution, and the state machine unit determines on the basis of the provided status signal a content of the control signal which should be sent to the data path unit when a next clock pulse is supplied.
Preferably, the state machine unit sequentially feeds the control signals for enabling the data path unit to continuously execute a plurality of arithmetical operations which constitute the signal processing specified by the mode information.
In another aspect of the invention, there is provided an audio signal processor, which comprises a plurality of interfaces that receive audio data of a plurality of channels, respectively, a detecting unit that generates a status signal indicating whether each channel is an active state or an inactive state based on the audio data of the plurality of the channels inputted via the plurality of the interfaces, and an audio signal processing unit that performs signal processing for the audio data of the plurality of the channels in a time-divisional manner, wherein the audio signal processing unit determines whether each channel is the active state or the inactive state based on the status signal outputted from the detecting unit, and performs the signal processing only for the audio data of the channels in the active state and stops the signal processing for the audio data of the channels in the inactive state.
According to this aspect of the present invention, the detecting unit detects whether each channel is active or inactive, and the audio signal processing unit performs only the signal processing for the audio data of the active channels and stops the signal processing for the audio data of the inactive channels. Therefore, it is possible to prevent wasteful signal processing and to hold down power consumption required for signal processing.
In a preferred mode, the detecting unit generates the status signal indicating that the channel is the inactive state if the audio data of the channel stops over a given period of time. According to this mode, if audio data of a certain channel stops during execution of signal processing of a delay system such as reverberation processing in the audio signal processing unit, signal processing of the relevant channel stops at appropriate timing after an elapse of the given period of time. Therefore, it is possible to prevent a disadvantage that the reverberation processing or the like is interrupted during the execution.
In another preferred mode, the detecting unit generates a first status signal when the audio data of the channel continuously stops for more than a first time period and generates a second status signal when the audio data of the channel continuously stops for more than a second time period longer than the first time period, and the audio signal processing unit stops a part of the signal processing of the channel if the first status signal is generated from the detecting unit for the channel, and stops a whole of the signal processing of the channel if the second status signal is generated for the channel. According to this mode, a given type of signal processing is stopped at the time of an output of the first status signal generated by the stop of the audio data regarding the given type of signal processing not affected if it is interrupted at the time of the stop of the audio data, and other types of signal processing are stopped if the audio data stopped condition continues for a given or longer period of time. Therefore, it is possible to hold down power consumption further in comparison with the aforementioned mode.
Embodiments of the present invention will be described hereinafter by referring to drawings.
The audio signal processor 10 according to this embodiment receives time-series audio data generated by sampling audio waveforms from a source A, receives performance data from a source B, and processes them. In this regard, the source A is, for example, an external device connected to audio equipment on which the audio signal processor 10 is mounted or an audio reproducer such as an MP3 (MPEG 1 layer 3) decoder built in the audio equipment. The source B is, for example, a host processor for controlling the audio signal processor 10 in the audio equipment on which the audio signal processor 10 is mounted.
To receive the audio data from the source A, the audio signal processor 10 is provided with a digital audio I/F 11. In this embodiment, audio data A having a sampling frequency f1 of two channels L and R is entered via the digital audio I/F 11.
Moreover, to acquire audio data by receiving performance data from the source B, the audio signal processor 10 is provided with a CPU I/F 12, a sequencer 13, and a sound source 14. The performance data is supplied to the sequencer 13 via the CPU I/F 12 from the source B. The performance data is sequential data, and the sequential data includes a series of event data specifying controls of the sound source 14 such as note-on and note-off and duration data specifying intervals for sending respective event data to the sound source 14. The sequencer 13 controls timing for sending event data to the sound source 14. More specifically, if certain event data is sent to the sound source 14, the sequencer 13 repeats an operation of awaiting an elapse of the time equivalent to duration data associated with subsequent event data and sending out the subsequent event data to the sound source 14. In a preferred embodiment, the sound source 14 generates stereo-sampled audio data. In this embodiment, when note-on event data is supplied, the sound source 14 outputs audio data B having a sampling frequency f2 of two channels L and R showing different waveforms respectively. In another preferred embodiment, the sound source 14 generates monaural-sampled audio data. In this embodiment, when note-on event data is supplied, the sound source 14 generates monaural audio data having the sampling frequency f2. The audio data is allocated to the audio data B of two channels L and R at a volume ratio corresponding to a coefficient of a panoramic potentiometer indicating a location of sound image localization, and then it is output from the sound source 14.
An audio signal processing unit 20 performs signal processing for the audio data A and B obtained from the digital audio I/F 11 and the sound source 14 respectively and outputs digital signals of the two channels L and R as a result of the processing. Inside the audio signal processing unit 20, a clock generator not shown generates sampling clock pulses CLK having frequency fs and operation clock pulses MCLK faster than CLK. In the audio signal processing unit 20, signal processing for the audio data A and B is performed with being triggered by a generation of a sampling clock pulse CLK every time it occurs. Timing control of the components for the signal processing is performed in synchronization with the operation clock pulses MCLK. In this embodiment, the frequency fs of the sampling clock pulse is the same as the sampling frequency f2 of the audio data B. Therefore, the audio data B can be directly processed in the audio signal processing unit 20 without a conversion of the sampling frequency. The sampling frequency f1 of the audio data A differs from the frequency fs (=f2). Therefore, in this embodiment, the audio data A is captured into the audio signal processing unit 20 and thereafter its sampling frequency is converted from f1 to fs (=f2) as an SRC operation. The SRC operation will be described later.
As shown in
The state machine unit 40 is supplied with a status signal indicating an internal state of the data path unit 30. The state machine unit 40 is a device for monitoring a change in the internal state of the data path unit 30 based on the status signal and for outputting a control signal based on a result of the monitoring to cause the data path unit 30 to perform various signal processing.
The state machine unit 40 has operation state machines 41a to 41h as means for controlling execution of arithmetical operations of the data path unit 30. The following lists arithmetical operations performed by the data path unit 30 under the control of these operation state machines:
a. SRC (Sampling Rate Conversion) Operation
It is processing of reading audio data of the sampling frequency f1 from the memory for storing temporary data 31 and converting it to audio data of the sampling frequency fs (=f2). It is performed under the control of the operation state machine 41a.
b. VOL (Volume) Operation
It is processing of reading audio data from the memory for storing temporary data 31 and adjusting its volume. It is performed under the control of the operation state machine 41b.
c. FADE (Fade) Operation
It is processing of reading audio data from the memory for storing temporary data 31 and temporarily controlling the volume to an inaudible level (muting level). It is performed under the control of the operation state machine 41c.
d. MIX (Digital Mix) Operation
It is processing of reading two types of audio data from the memory for storing temporary data 31 and mixing them. It is performed under the control of the operation state machine 41d.
e. EQ (Digital Equalizer) Operation
It is processing of reading audio data from the memory for storing temporary data 31 and adjusting a level for each frequency band. It is performed under the control of the operation state machine 41e.
f. VSP (Virtual Speaker Position) Operation
As shown in
g. LOAD (Data Load) Operation
It is processing of storing the audio data A and B once into a buffering area of the memory for storing temporary data 31 and delivering these data to an arithmetical operation requiring the data. It is performed under the control of the operation state machine 41g.
h. VSP THRU (VSP Through) Operation
It is processing of reading audio data of the L and R channels from the memory for storing temporary data 31 and performing the VSP operation with an omission of the FIR filtering operation, in other words, performing the shift operation in
The audio signal processing unit 20 in this embodiment can perform various signal processing made of the aforementioned arithmetical operations combined. Signal processing that can be performed by the audio signal processing unit 20 has, as shown in
An operation stage call state machine unit 42 is an assembly of n operation stage call state machines for causing the data path unit 30 to perform respective signal processing corresponding to the modes 0 to n−1 shown in
The operation stage call state machine corresponding to each mode has a function of sequentially starting the operation state machines corresponding to one or a plurality of arithmetical operations forming the signal processing in order to cause the data path unit 30 to perform the signal processing in the mode. The operation state machine started by the operation stage call state machine generates a control signal to cause the data path unit 30 to perform the relevant arithmetical operation. This control signal is supplied to the data path unit 30 via the operation stage call state machine.
Moreover, the operation stage call state machine makes a control to deliver data appropriately between the respective arithmetical operations forming the signal processing. As shown in
The state machine unit 40 has a state machine 43 and a main state machine 44 for totally controlling all of the state machines in the state machine unit 40 in addition to the aforementioned state machines. The state machine 43 is started up by the main state machine 44 when the mode information in the mode register 50 is updated and initializes the memory for storing temporary data 31. It is because, if the mode is switched, a result of the arithmetical operation in the mode before switching remaining in the memory for storing temporary data 31 may affect an arithmetical operation in a mode after the switching. For example, in an arithmetical operation involving delay processing like the VSP operation, unless the memory for storing temporary data 31 is initialized at the time of mode switching, a result of the arithmetical operation in the mode before switching is delivered to an arithmetical operation after the switching, which leads to an unsuccessful result, instead of an intended one. In order to prevent the disadvantage, the state machine 43 is started at the time of mode switching.
An analog unit 60 in
The details of the configuration of the audio signal processor 10 according to this embodiment have been described hereinabove.
Subsequently, an operation according to this embodiment will be described below. While the audio data of the two channels L and R is to be processed by the data path unit 30 in the operation described hereinafter, it is simply referred to as “audio data” to simplify the explanation.
When audio data from the source A and performance data from the source B are supplied to the audio signal processor 10 in
Referring to
In the audio signal processing unit 20, signal processing for the audio data A and B is performed every time a sampling clock pulse CLK is generated. More specifically, if a mode indicated by the mode information in the mode register 50 is, for example, mode 0, the audio signal processing unit 20 sequentially performs a LOAD operation, an SRC operation, a VOL operation, an MIX operation, an EQ operation, a VSP operation, and FADE operation, which form signal processing of the mode 0, with a time sharing control every time a sampling clock pulse CLK is generated as shown.
In the data path unit 30, the LOAD operation is performed according to the control signal sent from the state machine unit 40 as mentioned above. More specifically, the operation coefficient generation circuit 35 gives “1” as an operation coefficient to the multiplier 33, first. The accumulator 34 is put into a through state. In this state, the audio data B is read from the buffering area for the audio data B in the memory for storing temporary data 31. The audio data B passes by the multiplier 33 and the accumulator 34 and is stored in an MIX operation area in the memory for storing temporary data 31. In the state where the SRC operation requires a supplement of the audio data A, the audio data A is read from the buffering area for the audio data A in the memory for storing temporary data 31. This audio data A passes by the multiplier 33 and the accumulator 34 and is stored in an SRC operation area in the memory for storing temporary data 31. When the LOAD operation ends in this manner, the data path unit 30 sends a status signal indicating the end of the LOAD operation to the state machine unit 40.
Upon receiving this status signal, the operation stage call state machine corresponding to the starts up the operation state machine 41a for the SRC operation. The operation state machine 41a generates a control signal for causing the data path unit 30 to perform the SRC operation. This control signal will be described later in detail. The control signal for the SRC operation is sent to the data path unit 30 via the operation stage call state machine corresponding to the mode 0. At the same time, the operation stage call state machine corresponding to the sends a control signal including information specifying the SRC operation area in the memory for storing temporary data 31 as a storage location of input data to be a target of the SRC operation and information specifying the VOL operation area in the memory for storing temporary data 31 as an output destination of the audio data after the sampling rate conversion to the data path unit 30.
In the data path unit 30, the SRC operation is performed based on the control signal sent from the state machine unit 40 in this manner.
Subsequently, the data path unit 30 obtains phase information Δt corresponding to a sampling point subsequent to the sampling point at which the current instantaneous value is obtained and sends it as a status signal to the state machine unit 40. This phase information Δt is to be sent as a part of the control signal from the state machine unit 40 to the data path unit 30 in the subsequent SRC operation. Phase information Δt corresponding to the new sampling point can be obtained by causing the operation unit 32 to perform, for example, processing of adding the frequency ratio f1/fs to the current phase information Δt.
If the phase information Δt exceeds “1” by the addition of the frequency ratio f1/fs, an instantaneous value of the audio waveform to be obtained next is for a time point later than the newest audio data Ak in the SRC operation area. In this situation, the subsequent SRC operation requires a supplement of new audio data Ak+1 and a use of the audio data Ak+1, Ak, Ak−1, and Ak−2. Accordingly, the data path unit 30 sends a status signal, which includes phase information Δt obtained by subtracting “1” from phase information Δt obtained after the addition of the frequency ratio f1/fs and information indicating that it is necessary to add the audio data Ak+1 in the next sampling period, to the state machine unit 40.
In the operation stage call state machine corresponding to the mode 0 in the operation stage call state machine unit 42, the status signal received from the data path unit 30 is stored for the subsequent SRC operation. In some cases, the status signal from the data path unit 30 includes information indicating a need for a supplement of new audio data A. In these cases, when the data path unit 30 is made to perform the LOAD operation in the subsequent sampling period, the operation stage call state machine corresponding to the sends the control signal including information indicating the audio data A storage area and information specifying the SRC operation area in the memory for storing temporary data 31 as an output destination of the audio data A to the data path unit 30 as described above.
The above is the detail of the SRC operation performed by the audio signal processing unit 20.
The sampling frequency f1 of the actual audio data A has a time jitter, and the frequency fs of the sampling clock pulse CLK has a time jitter, too. If phase information Δt is calculated by accumulating fixed values f1/fs as described above when these time jitters are significant, a phase difference between a phase of an instantaneous value of the audio waveform calculated by the SRC operation and a phase of audio data A written into the buffering area for the audio data A increases with time. Thereby, there is a possibility of an occurrence of an overflow or an underflow of the buffering area. To prevent this disadvantage, it is preferable to monitor a remaining amount of audio data A, which has not been read out yet, in the buffering area: if the remaining amount is less than a given value, an increment to be added to the phase information Δt for each sampling period is decreased to prevent the underflow, or if the remaining amount is more than the given value, the increment to be added to the phase information Δt is increased to prevent the overflow. This technology is disclosed in, for example, Patent Document 3 whose patent has been applied by the present applicant.
Patent Document 3 is Japanese Laid-Open Patent Publication (Kokai) No. H11(1999)-55075.
Upon detecting an end of the SRC operation by means of the status signal from the data path unit 30, the operation stage call state machine corresponding to the in the operation stage call state machine unit 42 starts up the operation state machine 41c for the VOL operation. The operation state machine 41c generates a control signal for use in causing the data path unit 30 to perform the VOL operation. This control signal is sent to the data path unit 30 via the operation stage call state machine corresponding to the mode 0. At the same time, the operation stage call state machine corresponding to the mode 0 sends a control signal including information indicating a location of the input data to be a target of the VOL operation and information specifying the MIX operation area in the memory for storing temporary data 31 as an output destination of audio data obtained as a result of the VOL operation to the data path unit 30.
The data path unit 30 performs the VOL operation as described below according to the control signal sent from the state machine unit 40 as described above. First, the audio data A after the SRC operation is read from the VOL operation area in the memory for storing temporary data 31. Then, the operation unit 32 performs the VOL operation for the audio data, and audio data obtained as a result is stored in the MIX operation area in the memory for storing temporary data 31. When the VOL operation ends in this manner, the data path unit 30 sends a status signal indicating this to the state machine unit 40.
Upon detecting the end of the VOL operation by means of the status signal from the data path unit 30, the operation stage call state machine corresponding to the mode 0 in the operation stage call state machine unit 42 starts up the operation state machine 41d for the MIX operation. The operation state machine 41d generates a control signal for causing the data path unit 30 to perform the MIX operation. This control signal is sent to the data path unit 30 via the operation stage call state machine corresponding to the mode 0. At the same time, the operation stage call state machine corresponding to the mode 0 sends a control signal including information indicating a location of the input data to be a target of the MIX operation and information specifying the EQ operation area in the memory for storing temporary data 31 as an output destination of audio data obtained as a result of the MIX operation to the data path unit 30.
The data path unit 30 performs the MIX operation according to the control signal sent from the state machine unit 40 as described above. The MIX operation is intended for the audio data A and B stored in the MIX operation area in the memory for storing temporary data 31. In this regard, the audio data A has been submitted to the above SRC operation and thus becomes sample data of the sampling frequency f2 like the audio data B. Therefore, in the MIX operation, it is only necessary to perform a summation of weights of these audio data. Hereinafter, the operation will be described.
First, the audio data A is read from the MIX operation area and a mixing coefficient defining a weight of the audio data A is output from the operation coefficient generation circuit 35, and then they are supplied to the multiplier 33. The multiplier 33 multiplies the audio data A by the mixing coefficient. A result of the multiplication is supplied to and stored in the accumulator 34. Subsequently, the audio data B is read from the MIX operation area in the memory for storing temporary data 31 and a mixing coefficient defining a weight of the audio data B is output from the operation coefficient generation circuit 35, and then they are supplied to the multiplier 33. The multiplier 33 multiplies the audio data B by the mixing coefficient. A result of the multiplication is supplied to the accumulator 34. The multiplier 34 performs accumulating processing in which the result of the multiplication is added to data that has already been stored. This accumulating processing produces audio data made of the audio data A and B mixed. The audio data after the mixing operation is stored into the EQ operation area in the memory for storing temporary data 31. Upon an end of the mixing operation in this manner, the data path unit 30 sends a status signal indicating it to the state machine unit 40.
Hereinafter, the VSP operation and the FADE operation will be performed basically under the same control as for the above.
During execution of the last FADE operation, the operation stage call state machine corresponding to the mode 0 sends information specifying the analog unit 60 as an output destination of a result of the FADE operation to the data path unit 30. The data path unit 30 sends a result of the FADE operation to the analog unit 60 according to this information.
Upon an end of the last FADE operation, the audio signal processing unit 20 enters an IDLE state. In the IDLE state, the data path unit 30 does not perform any operation for signal processing, thereby holding down the entire power consumption of the audio signal processor 10 to a low level.
Thereafter, when a sampling clock pulse CLK is generated and thereby a new sampling period is started, the signal processing of the mode 0 from the LOAD operation to the FADE operation is performed again as shown in
The above processing is repeated whenever the sampling clock pulse CLK is generated, by which the analog signal after the signal processing in the mode 0 shown in
Also when the mode information specifying another mode is stored in the mode register 50, the signal processing in that mode is performed by the same control as for the above.
In the aforementioned signal processing in the mode 0, the LOAD, SRC, VOL, MIX, EQ, VSP, and FADE operations have been started in this order by working of the operation stage call state machine corresponding to the mode 0. On the other hand, in the signal processing in the mode 1, the LOAD, SRC, VOL, EQ, MIX, VSP, and FADE operations are started in this order by working of the operation stage call state machine corresponding to the mode 1. Moreover, data delivery between the operations is conducted in a different form from that of the mode 0 by working of the operation stage call state machine corresponding to the mode 1.
As stated hereinabove, the audio signal processor 10 according to this embodiment is capable of perform a plurality of types of signal processing whose contents are different from each other by using a common data path unit 30. Furthermore, by previously writing mode information corresponding to desired signal processing into the mode register 50, the audio signal processing unit 20 can be caused to perform the signal processing. Therefore, it is possible to achieve the audio signal processor 10 conforming to a lot of specifications different in types of signal processing by using a single chip. In the audio signal processor 10 according to this embodiment, there is an idle state in which the data path unit 30 does not operate at all during a period from a start of a sampling period to the next sampling period after an execution of the signal processing corresponding to the mode information. Moreover, in the signal processing corresponding to the mode information, the data path unit 30 performs an operation only for the signal processing. Therefore, according to this embodiment, unnecessary operations for the signal processing are avoided, thereby eliminating wasteful power consumption and achieving low power consumption. Therefore, the audio signal processor can be mounted onto a portable electronic device required to be low in power consumption such as, for example, a mobile telephone. Thereby, it becomes possible to provide these devices with high-quality audio signal processing functions.
A configuration of an audio signal processor according to this embodiment is basically the same as that in the first embodiment shown in
As shown in
In this embodiment, the same effect as in the above first embodiment is achieved, too.
(Other Expedients)
While the first embodiment and the second embodiment of the present invention have been described hereinabove, the present invention further has the following expedients:
A third embodiment of the present invention will now be described hereinafter with reference to drawings.
The audio signal processor 10 according to this embodiment has a CH0 interface 70 corresponding to a channel 0, a CH1 interface 71 corresponding to a channel 1, and a CH2 interface 72 corresponding to a channel 2 as interfaces for inputting audio data into the processor. These interfaces 70 to 72 may receive data output from the same source or may receive data output from different sources. Also, these interfaces 70 to 72 may treat data in the same format or may treat data in different formats. For example, there can be a mode such that a certain interface receives and outputs audio data, which is sample data of an audio waveform, while other interfaces receive MIDI or other performance data and generate and output audio data based on it.
An active/inactive channel detecting circuit 80 detects whether the respective channels are active or inactive from the audio data input via the interfaces 70 to 72 of the channels and outputs channel status signals indicating the results.
In this regard, the active/inactive channel detecting circuit 80 does not determine that the channel becomes inactive immediately after an input of audio data indicating a silence, but determines that the channel becomes inactive if a condition where no audio data is input continues for a preset given period of time after an input of audio data indicating a silence. It is because, if the channel status signal indicating an inactive state is immediately output, there is a possibility of interrupting signal processing under execution for audio data that has already been input in the previous sampling period. It will be described later how long period should be set as an indication for determining the inactive state most preferably. In the above embodiment, the channel status signal is generated by detecting that the audio data is not inputted into the channel. Alternatively, the input audio data itself may contain status information indicating the state of the corresponding channel.
An audio signal processing unit 20 performs signal processing for the audio data input via the interfaces 70 to 72 and outputs digital signals of two channels L and R as a result of the processing. An analog unit 60, which comprises mainly a D/A converter, converts the digital signals of the two channels L and R output from the audio signal processing unit 20 to analog signals and outputs them to left and right speakers (not shown).
As shown in
The memory for storing temporary data 31 is used as a temporary storage area for use in temporarily storing audio data to be processed and digital data under signal processing. In this regard, signal processing performed by the audio signal processor 10 includes signal processing of a so-called delay system, and therefore the memory for storing temporary data 31 has a secured FIFO (first-in first-out) memory having a storage area for storing n pieces of audio data. The number of audio data that can be stored in the FIFO, “n” is preset according to a ratio of the longest delay time to a sampling period.
As stated above, the active/inactive channel detecting circuit 80 determines the inactive state only if the condition where no audio data is input continues for the given period of time after the input of audio data indicating a silence. It is most preferable that the period as an indication for determining the inactive state is set to be longer than the longest delay time mentioned above. In signal processing of a delay system such as giving reverberation, a specific area of the memory for storing temporary data 31 is used as a FIFO for delaying audio data to shift the audio data in the FIFO sequentially to a backward storage area every time a sampling period elapses, while operations are sequentially performed by using the audio data in the FIFO. Therefore, even if an input of audio data stops, a certain time lag occurs until an end of the entire signal processing. Accordingly, the period for determining the inactive state is set to end a little later than the time when all audio data in the memory for storing temporary data 31 is cleared. Thereby, it becomes possible to prevent a situation in which signal processing for already input audio data is interrupted.
The operation unit 32 is a device for performing an arithmetical operation for data read from the memory for storing temporary data 31, having a multiplier 33, an accumulator 34, and an operation coefficient generation circuit 35. In this regard, the multiplier 33 is a circuit for multiplying data read from the memory for storing temporary data 31 by an operation coefficient, and the operation coefficient generation circuit 35 is for generating the operation coefficient. The accumulator 34 is a circuit for accumulating a result of the multiplication every time the result is output from the multiplier 33. All of the following are determined according to control signals supplied from the state machine unit 40 (more specifically, a state machine for an arithmetical operation concerned): what operation coefficient should be generated by the operation coefficient generation circuit 35; what operations should be performed by the multiplier 33 and the accumulator 34; which area data in the memory for storing temporary data 31 should be a target of the arithmetical operation; and to which the operation result should be output.
The state machine unit 40 is a device for making controls for state transitions of the data path unit 30. The state machine unit 40 is supplied with a status signal indicating an internal state of the data path unit 30 and monitors a change in the internal state of the data path unit 30 based on the status signal. Then, the state machine unit 40 outputs a control signal based on a result of the monitoring to the data path unit 30 in order to cause the data path unit 30 to perform various signal processing.
As shown in
The main state machine 44 sequentially starts up the operation state machines 410 to 412 in a given order in respective sampling periods. Note that, however, if a channel status signal indicating that a specific channel becomes inactive is output from the active/inactive channel detecting circuit 80 in a certain sampling period, the main state machine 44 skips a start-up of the operation state machine corresponding to the channel and shifts the state machine unit 40 to the next state in the next sampling period. The skip operation of the control of the signal processing corresponding to the inactive channel is repeated until an output of a channel status signal indicating that the channel returns to the active state.
A relation between the state transition of the state machine unit 40 and processing of the operation unit 32 will be described with reference to
If all channels are active, the state machine unit 40 shifts from the “IDLE” state to the “CH0” state due to a start of the sampling period and then shifts from “CH1” to “CH2” and returns to the “IDLE” state, as shown in
If the channel 1 is inactive, the “CH1” state is skipped in the state transition of the state machine unit 40 as shown in
The same is true in a case where a channel status signal indicating that the channel 0 or the channel 2 becomes inactive is output from the active/inactive channel detecting circuit 80. If so, the main state machine 44 skips a start-up of the operation state machine corresponding to the inactive channel. Thereby, the arithmetical operation of the inactive channel need not be performed, thus reducing power consumption necessary for the signal processing operation. Accordingly, it becomes possible to mount the processor on a portable electronic device required to be low in power consumption such as, for example, a mobile phone, and thus possible to provide these devices with high-quality audio signal processing functions.
In the third embodiment, if audio data of a channel continuously stops for a given or longer period of time, an execution of signal processing of the relevant channel is stopped. On the other hand, in this embodiment, the following operation is performed. First, the active/inactive channel detecting circuit 80 outputs a first channel status signal if an input of audio data indicating a silence continues for more than a first time period regarding a certain channel. If an input of audio data indicating a silence continues for more than a second time period longer than the first time period regarding the channel, the active/inactive channel detecting circuit 80 outputs a second channel status signal. The second time period is the same as the duration of a silence for determining that the channel becomes inactive in the third embodiment stated above. In the same manner as for the third embodiment, the operation state machines 410 to 412 of the state machine unit 40 skip signal processing according to the channel status signals. The skip operation, however, is performed in different modes according to whether the first channel status signal is output or the second channel status signal is output.
For example, if the channel 0 is active, the main state machine 44 starts up the operation state machine 410 corresponding to the channel 0. It is assumed that the operation state machine 410 shifts the state of the data path unit 30 in the order of “Process 1,” “Process 2,” “Process 3,” “Process 4,” and “IDLE” to cause the data path unit 30 to perform the signal processing of the channel 0. If the first channel status signal corresponding to the channel 0 is output in this condition, the operation state machine 410 skips “Process 2” not including, for example, a delay process. Thereafter, if the second channel status signal is output regarding the channel 0, the main state machine 44 skips the start-up of the operation state machine 410 corresponding to the channel 0. As a result, all signal processing corresponding to the channel 0 is stopped. Thereafter, if audio data of the channel 0 indicating a sound is input and a channel status signal indicating this is output, the main state machine 44 starts up the operation state machine 410 in the subsequent sampling periods to restart the signal processing corresponding to the channel 0.
In this manner, this embodiment is shown by an arrangement in which individual processing to be performed under the control of the operation state machines 410 to 412 is switched between the start and stop conditions. Therefore, it is possible to perform the following operations: if processing can be stopped immediately after the input of audio data of a silence, for example, in the case of equalizer processing, it is stopped immediately after an output of the first channel status signal; if processing is preferably stopped after awaiting a clearance of all data stored in the memory for storing temporary data 31, for example, in the case of delay system processing, it is stopped at an output of the second channel status signal after that. This enables unnecessary operations to be skipped with higher time resolution and therefore enables holding down power consumption required for signal processing further.
Toda, Hiroyuki, Muraki, Yasuyuki, Nishioka, Naotoshi
Patent | Priority | Assignee | Title |
8457769, | Jan 05 2007 | Massachusetts Institute of Technology | Interactive audio recording and manipulation system |
8681997, | Jun 30 2009 | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | Adaptive beamforming for audio and data applications |
Patent | Priority | Assignee | Title |
4570523, | Jul 20 1982 | Yamaha Corporation | Reverberation tone generating apparatus |
5744741, | Jan 13 1995 | Yamaha Corporation | Digital signal processing device for sound signal processing |
5917781, | Jun 22 1996 | LG Electronics Inc; LC ELECTRONICS INC | Apparatus and method for simultaneously reproducing audio signals for multiple channels |
6397321, | Aug 06 1998 | Yamaha Corporation | Digital signal processor |
JP2000057122, | |||
JP2000122650, | |||
JP5181479, | |||
JP5821299, | |||
TW2654550, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Oct 07 2004 | NISHIOKA, NAOTOSHI | Yamaha Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 015944 | /0366 | |
Oct 07 2004 | TODA, HIROYUKI | Yamaha Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 015944 | /0366 | |
Oct 07 2004 | MURAKI, YASUYUKI | Yamaha Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 015944 | /0366 | |
Oct 28 2004 | Yamaha Corporation | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Apr 05 2012 | ASPN: Payor Number Assigned. |
Feb 13 2013 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Mar 02 2017 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
May 03 2021 | REM: Maintenance Fee Reminder Mailed. |
Oct 18 2021 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Sep 15 2012 | 4 years fee payment window open |
Mar 15 2013 | 6 months grace period start (w surcharge) |
Sep 15 2013 | patent expiry (for year 4) |
Sep 15 2015 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 15 2016 | 8 years fee payment window open |
Mar 15 2017 | 6 months grace period start (w surcharge) |
Sep 15 2017 | patent expiry (for year 8) |
Sep 15 2019 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 15 2020 | 12 years fee payment window open |
Mar 15 2021 | 6 months grace period start (w surcharge) |
Sep 15 2021 | patent expiry (for year 12) |
Sep 15 2023 | 2 years to revive unintentionally abandoned end. (for year 12) |