A multi-channel reverberation system has a substantially constant multi-channel power gain at audio frequencies and comprises multiple signal inputs, one for each input channel, a number of comb filter networks connected to each signal input, each comb filter network including a feed forward stage, a cross-coupling network cross-coupling the comb filters to increase the reverberation echo density, and multiple signal outputs, one for each output channel. Preferably the feed forward stage of each comb filter provides a substantially constant multi-channel power gain at audio frequencies and the cross-coupling matrix is an orthogonal cross-coupling matrix cross-coupling a number of single channel allpass comb filters, positioned immediately before or after the delay lines, to create a multi-channel allpass comb filter with a unitary transfer function matrix at all frequencies.

Patent
   RE39189
Priority
Oct 15 1993
Filed
Oct 17 1994
Issued
Jul 18 2006
Expiry
Jul 18 2023
Assg.orig
Entity
Large
2
16
all paid
0. 7. A multi-channel unitary reverberator comprising:
multiple signal inputs, one for each input channel,
a number of feedback comb filter networks connected one to each signal input, each comb filter network including a feed forward stage to provide a substantially constant multi-channel power gain at audio frequencies, wherein there is one multiplier in each channel residing in both the feed forward and feedback networks,
a cross-coupling network cross coupling the comb filters to increase the reverberation echo density, and
multi signal outputs, one for each output channel.
0. 4. An assisted reverberation or room acoustic enhancement system, comprising:
multiple microphones positioned to pick up reverberant sound in a room,
multiple loudspeakers to broadcast sound into the room, and
a multichannel reverberator, comprising:
multiple signal inputs, one for each input channel and which receive similar bandwidth signals from the microphones;
a number of feed back comb filter networks connected one to each signal input, each comb filter network including a feed forward stage to provide a substantially constant multi-channel power gain at audio frequencies;
a cross-coupling network cross-coupling the comb filters to increase the reverberation echo density;
and multiple signal outputs, one for each output channel.
0. 1. A multi-channel reverberation system comprising:
multiple signal inputs, one for each input channel;
a number of feed back comb filter networks connected one to each signal input, each comb filter network including a feed forward stage to provide a substantially constant multi-channel power gain at audio frequencies;
a cross-coupled network cross-coupling the comb filters to increase the reverberation echo density;
and multiple signal outputs, one for each output channel.
0. 2. A multi-channel reverberation system according to claim 1, wherein the feed forward stage of the comb filters provides a transfer function matrix which is unitary at each frequency in the audio range.
0. 3. A multi-channel reverberation system according to claim 1, wherein the cross-coupling matrix is an orthogonal cross-coupling matrix cross-coupling a number of single channel allpass comb filters, positioned immediately before or after the delay lines, to create a multi-channel allpass comb filter with a unitary transfer function matrix at all frequencies.
0. 5. An assisted reverberation or room acoustic enhancement system according to claim 4, wherein the feed forward stage of the comb filters provides a transfer function matrix which is unitary at each frequency in the audio range.
0. 6. An assisted reverberation or room acoustic enhancement system according to claim 4, wherein the cross-coupling matrix is an orthogonal cross-coupling matrix cross-coupling a number of single channel allpass comb filters, positioned immediately before or after the delay lines, to create a multi-channel allpass comb filter with a unitary transfer function matrix at all frequencies.

The invention relates to assisted reverberation systems and PA or speech reinforcement systems that utilise reverberation devices.

Public address and speech reinforcement systems are used to amplify and broadcast voice signals. In these systems, microphones are placed close to the performers and the microphone signals are amplified, processed and fed to amplifiers and loudspeakers for broadcasting. In such systems, the loudspeaker signals couple back to the microphones, and if the gain is too high, the system can become unstable. This feedback between the loudspeakers and microphones is minimised by using directional microphones and having the microphones close to the performers to maximise the signal level.

An assisted reverberation system is used to improve and control the acoustics of a concert hall (auditorium). There are two fundamental types. The first is the in-line system, in which the direct sound produced on stage by the performer (s) is picked up by microphone(s), processed by feeding it through delays, filters and reverberators, and broadcast into the auditorium from several loudspeakers which may be at the front of the hall or distributed around the walls and ceiling. In an in-line system acoustic feedback (via the auditorium) between the loudspeakers and microphones is not required for the system to work (hence the term in-line). The PA and speech reinforcement systems described above are simple examples of in line systems.

The second type of assisted reverberation system is the non-in-line system in which a number of microphones pick up the reverberant sound in the auditorium and broadcast it back into the auditorium via filters, amplifiers and loudspeakers (and in some variants of the system, via delays and reverberators—see below). The rebroadcast sound is added to the original sound in the auditorium, and the resulting sound is again picked up by the microphones and rebroadcast, and so on. The non-in-line system thus relies on the acoustic feedback between the loudspeakers and microphones for its operation (hence the term non-in-line).

In turn, there are two basic types of non-in-line assisted reverberation system. The first is a narrowband system, where the filter between the microphone and loudspeaker has a narrow bandwidth. This means that the channel is only assisting the reverberation in the auditorium over the narrow frequency range within the filter bandwidth. An example of a narrowband system is the Assisted Resonance system, developed by Parkin and Morgan (1) and used in the Royal Festival Hall in London. The advantage of such a system is that the loop gain may be relatively high without causing difficulties due to instability. A disadvantage is that a separate channel is required for each frequency range where assistance is required.

The second form of non-in-line assisted reverberation system is the wideband system, where each channel has an operating frequency range which covers all or most of the audio range. In such a system the loop gains must be low, because the stability of a wideband system with high loop gains is difficult to maintain. An example of such a system is the Philips MCR (‘Multiple Channel amplification of Reverberation’) system [2,3], which is installed in several concert halls around the world, such as the POC Congress Centre is Eindhoven. It has been shown [3] that the power gain due to the MCR system is given by P MCR = 1 1 - α MCR 2 N ( 1 )
where αMCw is the loop gain and N is the number of microphone, loudspeaker channels. The reverberation time is increased by the same factor.

An improved wideband non-in-line assisted reverberation system has been described in Pct Patent application NZ93/0041[4-6]. In this system (FIG. 1) N microphones pick up the sound in the primary room and the microphone signals are fed into a secondary room and are reverberated and scaled by the loop gain before being fed back into the primary room. In practice the secondary room is replaced with a reverberation matrix. This improved system allows the apparent volume in the primary room to be altered independently of the apparent absorption. The improved system shall be denoted VRA (Variable Room Acoustics). The power gain introduced by the system is given by P VRA = 1 1 - α VRA 2 N ( 2 )
where αVRA is the loop gain. The expression contains the square of the number of channels N, compared with N in the MCR system. This is due to the fact that the primary and secondary rooms have an effective power gain of N. Both systems thus have the same mean power gain for α VRA = α MCR N ( 3 )
The Philips system provides a reverberation time boost which is equal to the power gain. As a result, the reverberation boost is limited by the maximum attainable power gain before instability. The VRA system, however, allows the reverberation time to be boosted over and above the power gain increase by controlling the reverberation time of the secondary room (while holding its gain constant). It has been shown [6] that the VRA system gives a reverberation time boost of T ass T 1 = β ( 1 + β 2 ) - ( β - 1 2 ) 2 + βα VRA 2 N 2 ( 4 )
where Tαss is the assisted reverberation time, T1 is the unassisted reverberation time in the primary room and β is the ratio of the secondary room to primary room reverberation time. The gain in RT is equal to the power gain (equation 2) for β=0, (the equivalent MCR case), and it rises monotonically from the value as β increases.

The main difficulty with non-in-line systems is that they can become unstable, due to the feedback between the microphones and loudspeakers. The problem is minimised by using a large number of channels and keeping the loop gain in each channel low. For example the Philips system typically uses between 60 and 100 channels. However, even with large numbers of channels and low loop gains the sound in the hall can sound ‘coloured’. In a natural room, the sound decay at any position in the room consists of the sum of an infinite number of room modes. Typically all of these room modes have the same or similar decay rates, and as a result the decay in dB is linear [7]. In a non-in-line assisted reverberation system, this similarity of decay results is reduced. As a result, some room modes have longer decay rates, and after a certain time those room modes with the longest decay times dominate the sound of the decay. The decay is perceived as containing one or more ‘ringing tones’, or being ‘coloured’. Those modes which produce ringing tones occur at frequencies where the loop gain through the system is high and where the phase is a multiple of 2π. The feedback at such frequencies is thus positive.

In-line systems attempt to minimise the feedback between loudspeakers and microphones, but the problem is never eliminated completely. Thus, the problem of colouration also occurs in in-line systems.

The improved non-in-line VRA system described in PCT patent application NZ93/00041 provides an increase in the reverberation time over previous systems for the same loop gain. However, the loop gain in the system is more complex, due to the fluctuating frequency response of the secondary room matrix. As a result, the improved system will produce a higher degree of colouration than the MCR system for the same loop gain (equation 3). It would therefore be desirable to design a reverberation matrix that has a low degree of fluctuation in its frequency response.

In the same manner, an in-line system that utilises a reverberator will have a greater propensity to become unstable since the reverberator produces a fluctuating loop gain that at some frequencies is higher than the loop gain without the reverberator. Again, a reverberator with a lower degree of fluctuation in its frequency response will reduce the problem.

In the ease of a single microphone, reverberator and loudspeaker it is obvious that a low degree of fluctuation requires that the reverberator have a constant magnitude at all frequencies, ie it is allpass. Most reverberator structures do not produce such a response, however, since they consist of a parallel connection of comb filters [8]. Allpass comb filter sections are often used following these parallel connections of comb filters to increase the echo density [8,9]; however, it is not likely that a series connection of allpass comb filters alone would produce a reasonable reverberation because the configuration does not simulate a simple sum of decaying exponential modes as occurs in a room.

In the multidimensional case the definition of ‘low fluctuation’ is more complicated since the reverberation matrix contains N2 transfer functions and each output is the sum of N input signals transmitted through N transfer functions.

The present invention provides a class of multichannel reverberator which produces a low degree of fluctuation in a multidimensional sense. The class of reverberator allows the VRA system to produce identical or at least similar colouration performance to the MCR system for the same power gain. It also allows the colouration in in-line systems and PA/speech reinforcement systems to be reduced.

In broad terms the invention comprises:

The invention will now be further described with reference to the accompanying drawings, by way of example and without intending to be limiting. In the drawings,

FIG. 1 shows a VRA assisted reverberation system;

FIG. 2 shows a single channel comb filter which is the basis for many conventional digital reverberators;

FIG. 3 shows a single channel all pass comb filter which is the basis for the reverberation system of the invention;

FIG. 4 shows a common structure for a conventional multi-channel reverberator; and

FIG. 5 shows a structure for an all pass vector comb filter reverberator system of the invention.

Consider an N channel system X(ω) which is excited with unit mean power white noise bandlimited to B Hz at all inputs. If the input signals are all uncorrelated, it can be shown that the mean power output is given by P out = 1 2 B - B B X ( ω ) 2 ω ( 5 )
where the integrand is the (Frobenius) norm squared of the transfer function matrix frequency ω. Thus the power gain, Pout/N, is governed by the average squared norm. In order to study the power gain of the system, at a single frequency, we consider exciting the system with a vector signal consisting of unit power complex sinusoids at all N inputs; s(t)=exp(jωot)u, where
a=(αjφ1, Cjφ2, . . . cjφN)r   (6)
If the phases of the sinusoids are samples from an underlying probability distribution P(φ1, φ2, . . . φN) in which the phase random variables are independent then it can be shown that the sum of the variances at the N outputs is given by
o2=UX(ωα)U2   (7)
Thus the squared norm of X(ω) divided by N is the ‘phase avenged’ power gain. This function allows a definition of ‘low fluctuation’ of the response of an N channel system. An ideal multichannel reverberator for use in a non-in-line assisted reverberation system will have a constant norm for all frequencies. In the multichannel case, such a reverberator may be loosely termed Allpass.

Consider a matrix X which is unitary, ie
x′x=I   (8)
where † denotes the conjugate transpose. The rows (and columns) of X are thus orthonormal vectors. The norm squared of X is given by X 2 = k = 1 N [ X + X ] kk = k = 1 N I kk = N ( 9 )
Hence may unitary matrix has a norm squared equal to the matrix dimension. The wideband or phase averaged power gain is thus equal to core. It will now be shown that for the unitary case the power gain is also one for constant sinusoids at one frequency applied to all inputs. Suppose the matrix X represents the value of a transfer function at frequency ωo−y(t)=exp(jωot)Xu (see equation 6) and the total power in the output is
y(r)†y(t)=mXXm=mm=N   (10)
where the time dependence cancels. Thus the output power is equal to N for constant sinusoidal excitation and is independent of the input phases. The power gain is thus unity at all frequencies. Hence: A linear multichannel system may be termed unitary if its transfer function matrix is unitary at all frequencies. A unitary system has a constant norm and unit power gain for all frequencies.

A unitary system is ideal for use in the VRA system since it has the same power gain at all frequencies and thus will not increase the colouration. It may also be inserted in(O an MCR system without altering the loop gain. The power gain of the VRA system with a unitary reverberator is given by P VRA unitary 1 = 1 1 - α VAR 2 N ( 11 )
which equals PMCR for αVRAMCR.

Most digital reverberators are based on the comb filter, shown in FIG. 2 [8-10]. This circuit produces an impulse response that is in exponentially decaying sequence of delta functions occurring at multiplies of the delay time r=L/f, where fg is the sample rate. The output may be taken from the summer, the delay or the multiplier outputs. The transfer function for the comb filter with output taken from the delay output is X ( z ) = z - L 1 + μ z - L ( 12 )

The single channel comb filter can be made to have a constant magnitude verses frequency response (termed an allpass response) by incorporating a feedforward section into the circuit. An efficient one multiplier form of the allpass form is shown in FIG. 3 [8,9]. The transfer function is given by X ( z ) = μ + z - L 1 + μ z - L ( 13 )
The magnitude squared at Z=exp(jθ) is X ( e j θ ) 2 = 1 + μ 2 + 2 cos ( L θ ) 1 + μ 2 + 2 cos ( L θ ) ( 14 )
which is unity, as required.

Early forms of reverberator were constructed using a number of comb filters in parallel, with the summed outputs being fed into a number of allpass sections to increase the echo density [8]. A more recent structure for multichannel reverberators is as shown in FIG. 4 [9,10]. This structure is an extension of the single channel comb filter which achieves a high echo density by the cross coupling of a number of single channel comb filters, via the cross coupling matrix G. Subsequent allpass sections are not required. The response of the vector comb filter may be determined by assuming that the unput is a vector of discrete signals uf(n) with a vector spectrum
U(z)=(U1(z),U2(z), . . . , UN(z)|T   (15)
The vector spectrum at the output of the adders is given by
V+(z)=U(z)−μGD(z)V+(z)   (16)
where D(z) is a diagonal delay matrix
D(z)=diag[z−L1,z−L2, . . . z−LN]  (17)

Solving for V+(z) allows the output vector spectrum V(z) to be found;
v(z)=D(Z)(I+μGD(z))−1U(z)   (18)
It can be shown [9, 10] that if the gain matrix G is orthonormal, ie GTG=I, then the system is stable for μ<1. The poles of the system are distributed in the z plane around a circle with radius less than unit.

The multichannel reverberator circuit can be made to have allpass properties if a feedforward action is incorporated into the circuit, as in the one dimensional case. An efficient form with a single vector gain element (μ) and single cross coupling matrix G, is shown in FIG. 5. The output vector spectrum is given by
v(z)=[μl+GD(z)][I+μGD(z)┌1U(z)   (19)
The order of the gain and delay matrices may be reversed without altering the allpass properties of the circuit. It may be verified that the transfer function maxtrix is equation 19 is unitary at all frequencies as follows:

At any given frequency ω, the matrix transfer function has the form
x=[μI+GD][I+μGD]−1   (20)
where D=diag[exp(jφ1),exp(jφ2), . . . , exp(jφN]. Now the product GD is a unitary matrix since
(GD)(GD)=DGGD=I   (21)
The eigenvalues decomposition of GD is thus
GD=QΛQ  (22)
where Q is a unitary matrix and Λ is a diagonal matrix of eigenvalues. Since GD is unitary the eigenvalues have unit magnitude, ie
A=diag[e1,e2, . . . eN]  (23)
X may now be written
X=[μl+QΛQ][1+μQΛQ]−1=[Q(μl+Λ)Q][Q(1+μΛ)Q]−1=Q(μI+Λ)Q554Q(I+μΛ)1Q=A(μI+Λ)(I+μΛ)1Q=QΛQ  (24)
where A has the diagonal allpass form A = diag [ μ + 1 1 + μⅇ 1 , μ + 2 1 + μⅇ 2 , μ + N 1 + μⅇ N ] . ( 25 )
We can now write
XX=QAQQΛQ=QA*AQ+  (26)
Hence the transfer matrix X is unitary at all frequencies. The unitary system is formed from a set of N independent single dimensional allpass filters with a precoupling matrix Q(ω) and a post coupling matrix Q(ω).

The foregoing describes the invention including preferred forms thereof. Alterations and modifications as will be obvious to those skilled in the art are intended to be incorporated in the scope hereof.

1) P. H. Parkin and K. Morgan, “Assisted Resonance in the Royal Festival Hall,”J. Acoust. Soc. Amer.. vol. 48, pp 1025-1035, 1970.

2) de Koning, S. H., “The MCR system-multiple channel amplification of reverberation.” Philips Tech. Rev., vol. 41, pp 12-23, 1983/84.

3) A Krokstad, Electroacoustic means of controlling auditorium acoustics, Applied Acoustics vol. 24, pp 275-288, 1988.

4) NZ93/00041, “Wideband assisted reverberation system.” Industrial Research Ltd. May 20, 1993.

5) M. A. Poletti, “On controlling the apparent absorption and volume in assisted reverberation systems,” Acustica, vol. 78.p 61-73. 1993

6) M. A. Poletti, “An improved assisted reverberation system,” Proceedings of the 12th Biennial Conference of the New Zealand Acoustical Society, 2nd and 3rd September, 1993, pp. 107-115

7) H. Kuttruff, Room Acoustics, Applied Science Publishers, 1973.

8) M. R. Schroeder, “Natural sounding artificial reverberation,” J. Audio Eng. Soc., vol. 10, no. 3, pp 219-223, July 1962

9) Jot, “Digital delay networks for designing artificial reverberators,” 90th convention of the Audio Engineering Society. Feb. 19-22, Paris 1991, preprint 3030.

10) Stautner and M. Puckette, “Designing multi channel reverberators.” Computer Music Journal, vol. 6, no. 1, pp 52-65, 1982.

Poletti, Mark

Patent Priority Assignee Title
8116479, Dec 05 2005 HAMADA, HAREO Sound collection/reproduction method and device
9355632, Sep 07 2011 Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V Apparatus, method and electroacoustic system for reverberation time extension
Patent Priority Assignee Title
4338581, May 05 1980 The Regents of the University of California Room acoustics simulator
4366346, Apr 24 1979 U S PHILIPS CORPORATION, A CORP OF DE Artificial reverberation apparatus
4803731, Aug 31 1983 Yamaha Corporation Reverbation imparting device
5109419, May 18 1990 Harman International Industries, Incorporated Electroacoustic system
5131051, Nov 28 1989 YAMAHA CORPORATION, A CORP OF JAPAN Method and apparatus for controlling the sound field in auditoriums
5142586, Mar 24 1988 Birch Wood Acoustics Nederland B.V. Electro-acoustical system
5247474, Apr 18 1991 Fujitsu Ten Limited Coefficients setting method of a reverberation unit
5297210, Apr 10 1992 Shure Incorporated Microphone actuation control system
5530762, May 31 1994 International Business Machines Corporation Real-time digital audio reverberation system
5555306, Apr 04 1991 Trifield Productions Limited Audio signal processor providing simulated source distance control
5621801, Jun 11 1993 Yamaha Corporation Reverberation effect imparting system
DE4022217,
EP335468,
EP480561,
JP4348399,
WO9323847,
///
Executed onAssignorAssigneeConveyanceFrameReelDoc
Oct 17 1994Industrial Research Limited(assignment on the face of the patent)
Feb 01 2013Industrial Research LimitedCALLAGHAN INNOVATION RESEARCH LIMITEDCHANGE OF NAME SEE DOCUMENT FOR DETAILS 0351090026 pdf
Dec 01 2013CALLAGHAN INNOVATION RESEARCH LIMITEDCALLAGHAN INNOVATIONASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0351000596 pdf
Date Maintenance Fee Events
Aug 05 2009M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Jul 18 20094 years fee payment window open
Jan 18 20106 months grace period start (w surcharge)
Jul 18 2010patent expiry (for year 4)
Jul 18 20122 years to revive unintentionally abandoned end. (for year 4)
Jul 18 20138 years fee payment window open
Jan 18 20146 months grace period start (w surcharge)
Jul 18 2014patent expiry (for year 8)
Jul 18 20162 years to revive unintentionally abandoned end. (for year 8)
Jul 18 201712 years fee payment window open
Jan 18 20186 months grace period start (w surcharge)
Jul 18 2018patent expiry (for year 12)
Jul 18 20202 years to revive unintentionally abandoned end. (for year 12)