A multi-channel stereo converter is described comprising stereo magnitude determining means for generating a stereo information signal (a/b; ρ), which represents a degree of stereo between audio input signals (L, R), and transforming means for transforming said audio signals (L, R) based on said stereo information signal (a/b; ρ) into at least a surround signal (S). A space mapping interpretation is presented and an audio center signal may be derived from the stereo input signals as well. The result is more flexibility in application and design, without substantial cross talk in the audio signals.

Patent
   6496584
Priority
Jul 19 2000
Filed
Jul 18 2001
Issued
Dec 17 2002
Expiry
Jul 18 2021
Assg.orig
Entity
Large
45
2
all paid
9. A method for generating audio signals from stereophonic audio signals (L, R), wherein an information signal is derived from said audio signals (L, R) and used for transforming said audio signals (L, R) to such an audio signal (S), characterised in that the information signal is a stereo information signal (a/b; ρ), which represents a degree of stereo between said audio signals (L, R), and that based on said stereo information signal (a/b; ρ) said audio signals (L, R) are transformed into at least a surround signal (S).
1. A multi-channel stereo converter, comprising stereo means for generating an information signal from stereophonic audio signals (L, R) and transforming means coupled to the stereo means for transforming said audio signals (L, R) to a further audio signal (C; S), characterized in that the stereo means are stereo magnitude determining means for generating a stereo information signal (a/b; ρ), which represents a degree of stereo between said audio signals (L, R), and that the transforming means are embodied for transforming said audio signals (L, R) based on said stereo information signal (a/b; ρ) into at least a surround signal (S).
2. The multi-channel stereo converter according to claim 1, characterized in that the transforming means use a relation for said transformation which maps the stereo information signal (a/b; ρ) to an angle (β) onto an audio signals defined plane.
3. The multi-channel stereo converter according to one of the claims 1, characterized in that said transformation uses a goniometric relation.
4. The multi-channel stereo converter according to claim 1, characterized in that the transforming means are embodied for additionally transforming said audio signals (L, R) from an orthogonal representation to a representation, wherein said audio signals (L, R) lie on a straight line, thus revealing an additional audio centre signal (C).
5. The multi-channel stereo converter according to claim 4, characterized in that said additional transformation comprises a vector multiplication with a multiple which lies around two.
6. The multi-channel stereo converter according to claim 1, characterized in that said transformation and/or additional transformation perform(s) a matrix transformation.
7. The multi-channel stereo converter according to claim 6, characterized in that matrix coefficients of said matrix transformation are based on projections of an actual audio signal on principal axes of the audio signals (R, L, C, S).
8. The multi-channel stereo converter according to claim 1, characterized in that the stereo converter is provided with one or more decorrelation filters, for example Lauridsen decorrelation filters, to which filters the surround signal (S) is applied for generating a stereo surround left signal (SL) and a stereo surround right signal (SR).

The present invention relates to a multi-channel stereo converter, comprising stereo means for generating an information signal from stereophonic audio signals (L, R) and transforming means coupled to the stereo means for transforming said audio signals (L, R) to a further audio signal (C; S).

The present invention also relates to a method for generating audio signals from stereophonic audio signals (L, R), wherein an information signal is derived from said audio signals (L, R) and used for transforming said audio signals (L, R) to such an audio signal (S).

Such a multi-channel stereo system and method are known from U.S. Pat. No. 5,426,702. The known system comprises stereo means in the form of a direction detection circuit for generating an information signal, which is derived from stereophonic audio input signals (L, R). The information signal contains a weighting factor measure for the direction of a most powerful sound source. Furthermore the known converter system comprises transforming means coupled to the direction detection circuit for transforming said audio signals (L, R) to a further audio signal in the form of an audio centre signal.

It is a disadvantage of the known multi-channel converter and method that no provisions are made to generate surround audio signals.

Therefore it is an object of the present invention to provide a multi-channel stereo converter system and corresponding method capable of generating and handling a variety of auxiliary audio signals, such as surround, stereo surround and/or centre signals, without substantial cross talk between these auxiliary audio signals.

Thereto the multi-channel stereo converter according to the invention is characterized in that the stereo means are stereo magnitude determining means for generating a stereo information signal (a/b; ρ), which represents a degree of stereo between said audio signals (L, R), and that the transforming means are embodied for transforming said audio signals (L, R) based on said stereo information signal (a/b; ρ) into at least a surround signal (S).

Similarly the method according to the invention is characterized in that the information signal is a stereo information signal (a/b; ρ), which represents a degree of stereo between said audio signals (L, R), and that based on said stereo information signal (a/b; ρ) said audio signals (L, R) are transformed into at least a surround signal (S).

It is an advantage of the multi-channel stereo converter and method according to the present invention that it is capable of generating additional related audio signals, such as surround signals, and left and right stereo surround signals, and/or at wish an audio centre signal, based on the two stereophonic left (L) and right (R) audio signals. This gives a large degree of freedom both in application possibilities and design, without substantial cross talk between output audio signals.

An embodiment of the stereo converter according to the present invention characterized in that the transforming means use a relation for said transformation which maps the stereo information signal (a/b; ρ) to an angle (β) onto an audio signals defined plane. In a very simple to implement embodiment said transformation uses a goniometric relation. In practice one would consider the use of some transformation which maps the stereo information signal (a/b; ρ) to the angle (β), where this angle is between 0 and π/2.

A particular embodiment of the multi-channel stereo converter according to the invention is characterized in that the transforming means are embodied for additionally transforming said audio signals (L, R) from an orthogonal representation to a representation, wherein said audio signals (L, R) lie on a straight line, thus revealing an additional audio centre signal (C).

Advantageously this embodiment provides for a multi-channel configuration having available audio left (L), right (R), surround (S) or surround left (SL) and surround right (SR), and the audio centre signal (C).

Advantageously a vector multiplication with a multiple which lies around two, can in particular with a matrix transformation be implemented easily on chip. In a further embodiment of the multi-channel stereo converter according to the invention matrix coefficients of said matrix transformation are based on projections of an actual audio signal on principal axes of the audio signals (R, L, C, S), either or not combined with other coefficients, such as empirically determined coefficients, to cover for example Dolby® Surround, Dolby Pro Logic®, Circle Surround®, and Lexicon® systems and other surround systems.

In practice a still further embodiment of the multi-channel stereo converter according to the invention is characterized in that the stereo converter is provided with one or more decorrelation filters, for example Lauridsen decorrelation filters, to which filters the stereo surround signal (S) are applied for generating a stereo surround left signal (SL) and a stereo surround right signal (SR). These kind of decorrelation filters are readily available on the market.

At present the multi-channel stereo converter and corresponding method according to the invention will be elucidated further together with their additional advantages while reference is being made to the appended drawing, wherein similar components are being referred to by means of the same reference numerals. In the drawing:

FIG. 1 shows a two dimensional state area defined by a combination of left (L) and right (R) audio signal amplitudes for explaining part of the operation of the multi-channel stereo converter according to the present invention;

FIG. 2 shows a general outline of several embodiments of the multi-channel stereo converter according to the invention;

FIGS. 3(a) and 3(b) show direction vector plots of left and right stereophonic signals; and

FIG. 4 outlines space mapping used in generating a surround signal in the multi-channel stereo converter according to the invention.

FIG. 1 shows a plot of a two-dimensional so called state area defined by momentaneous left (L) and right (R) audio signal amplitudes. Along the vertical axis input signal values of a left (L) audio stereo signal are denoted, while along the horizontal axis input signal values of a right (R) audio stereo signal are denoted. Mono signals emanating from for example speech can be found on a line through the origin of the area making an angle of 45 degrees with the horizontal axis. Stereo music leads to numerous samples shown as dots in the area. The dotted area may have an oblong shape as shown, in which case two orthogonal axes y and q may be defined. Axes y can be seen to have been formed by some average over all dots in the area providing information about a direction of a dominant signal. There are several estimation techniques known to estimate the dominant direction y. The least square method is well known to provide an adequate direction sensing or localization algorithm. Orthogonal to the axes y one may define the axes q, which provides information about an audio signals deviation from the dominant direction y. After determining the direction of these axes y and q, quantities b and a respectively can be determined or estimated, which are quantities defining the dimensions of the dotted area measured along the axes y and q respectively. In addition for example the ratio a/b, or at wish the value of the well known cross correlation ρ of the signals L and R provides stereo magnitude information, which represents a degree of stereo between said audio signals L and R. The cross correlation is defined as:

ρ=Σ(L-L)(R-R)/{Σ(L-L)2(R-R)2}½

where the underscores represent average values. The actual measurement or estimation of the ratio a/b or the cross correlation ρ can take place by any suitable means, and each of these signals can at wish be taken to provide stereo magnitude information.

FIG. 2 shows a combination of several possible embodiments of a multi-channel stereo converter 1. The converter 1 comprises stereo means in the form of stereo magnitude determining means 2 for generating the stereo information signal, which represents said degree of stereo between the audio signals L and R, as explained above. The converter 1 also comprises transforming means 3 for transforming the audio signals L and R based on said stereo information signal into at least a stereo surround signal S, and/or into at least one audio centre signal C, as will be explained later.

The transforming means 3 comprises a direction sensor circuit 4 which provides information in the form of for example coordinates/weights wL and wR, or angular information α concerning the direction of axes y in a way explained in the above. The stereo magnitude determining means 2 may use information from the direction sensor circuit 4, if necessary. Further the weights wL and wR and the stereo information signal a/b or ρ are used in the transforming means 3 to derive in a first possible embodiment a left L, right R, and a surround signal S therefrom. Thereto the transforming means 3 comprise a matrix means 5. A possible transformation implemented by the matrix means 5 based on the stereo magnitude signal and suggested now by way of example is:

β=arcsin (a/b) with 0≦a/b≦1, and 0≦β≦π/2.

By interpreting β as an angle onto the plane defined by the stereo signals L and R a mapping and three dimensional hemisphere presentation occurs, where the surround signal S is created now, whose axes is orthogonal to the stereo signal axes L and R. In this embodiment of the multi-channel stereo converter 1 the signals L and R are transformed into L, R and S. L and R may be mutual orthogonal as shown in FIG. 3(a), or may lie mainly in line as shown in FIGS. 3(b) and 4, which will be explained later on.

In a still further embodiment the mono surround signal S may be transformed further by means of one or more decorrelation filters, for example well known Lauridsen decorrelation filters 6. To the filter 6 the mono surround signal S is applied for generating a stereo surround left signal (SL) and a stereo surround right signal (SR).

In general any kind of transformation, either goniometric or not which maps the stereo information signal a/b; or ρ to the angle β, where this angle is between 0 and π/2 is applicable.

FIG. 2 exposes still another embodiment, wherein the stereo converter 1 comprises a vector multiplicator 7 coupled between the direction sensor 4 and the matrix means 5. The multiplicator 7 performs an additional possible transformation or mapping from the weights wL and wR shown in FIG. 3(a) to new weights cLR and cC shown in FIG. 4 for creating an audio centre signal C. This could be done by for example doubling the angle α. Principally multiplication by any wanted factor preferably close to 2 will do the job of creating the audio centre signal C. In the matrix means 5 its output signals L, R, C, and S are derived from the momentaneous signal values expressed in terms of the signals y and q and based on a matrix whose coefficients depend on the weights wL and wR, as well as on the various projection coefficients outlined in FIG. 4.

An example of a possible mapping, known as matrixing, is given in the matrix hereunder, which produces four channel output signals of L, C, R and S, expressed in terms of time samples k, according to: ( U L ⁡ ( k ) U R ⁡ ( k ) U C ⁡ ( k ) U S ⁡ ( k ) ) = ( C L ⁡ ( k ) W R ⁡ ( k ) C R ⁡ ( k ) - W L ⁡ ( k ) C ' ⁢ c ⁡ ( k ) 0 0 C S ⁡ ( k ) ) ⁢ ( y ⁡ ( k ) q ⁡ ( k ) )

where the base signals y(k) and q(k) are computed using a rotation of the input signals in accordance with:

y(k)=wL(k)xL(k)+wR(k)xR(k)

q(k)=wR(k)xL(k)-wL(k)xR(k),

and C L &af; ( k ) = { - c LR ' &af; ( k ) if &it; &it; c LR ' < 0 0 otherwise &it; &NewLine; &it; C R &af; ( k ) = { c LR ' &af; ( k ) if &it; &it; c LR ' &GreaterEqual; 0 0 otherwise .

In general the matrix coefficients of said matrix transformation are based on projections of an actual audio signal on principal axes shown in FIG. 4 of the audio signals (R, L, C, S). These matrix coefficients may however at wish be combined with coefficients which are partly determined on an empirical basis.

The effects of the doubling or multiplication of a combined with the three dimensional surround transformation explained earlier are shown in full in the space mapping of FIG. 4, revealing the audio signals L, R, C, and S, whereas at wish S may be subdivided using filter 6 in the stereo surround left signal (SL) and the stereo surround right signal (SR). The multiplication or possible doubling of α may be applied more times, for example twice.

At wish the exemplified mappings of FIGS. 3(b) and/or 4 may be generalized to be applicable to more than one audio centre signal C. In that case in the audio planes of the FIGS. 3(b) and 4 additional centre axes for example C' and C" may be defined in which case the actual audio vector can be projected on each of these audio centre axes C, C' and C" revealing the projections CC, CC', and CC"respectively.

Whilst the above has been described with reference to essentially preferred embodiments and best possible modes it will be understood that these embodiments are by no means to be construed as limiting examples of the devices concerned, because various modifications, features and combination of features falling within the scope of the appended claims are now within reach of the skilled person, as explained in the above.

Aarts, Ronaldus Maria, Irwan, Roy

Patent Priority Assignee Title
6882731, Dec 22 2000 Koninklijke Philips Electronics N V Multi-channel audio converter
7359522, Apr 10 2002 Koninklijke Philips Electronics N V Coding of stereo signals
7447321, May 07 2001 Harman International Industries, Incorporated Sound processing system for configuration of audio signals in a vehicle
7451006, May 07 2001 Harman International Industries, Incorporated Sound processing system using distortion limiting techniques
7489792, Sep 23 2002 Koninklijke Philips Electronics N V Generation of a sound signal
7492908, May 03 2002 Harman International Industries, Incorporated Sound localization system based on analysis of the sound field
7499553, May 03 2002 Harman International Industries Incorporated Sound event detector system
7542815, Sep 04 2003 AKITA BLUE, INC Extraction of left/center/right information from two-channel stereo sources
7567676, May 03 2002 Harman International Industries, Incorporated Sound event detection and localization system using power analysis
7660424, Feb 07 2001 DOLBY LABORATORIES LICENSING CORPORAITON Audio channel spatial translation
7672744, Nov 15 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
7715569, Dec 07 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
7760886, Dec 20 2005 Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung E V Apparatus and method for synthesizing three output channels using two input channels
7760890, May 07 2001 Harman International Industries, Incorporated Sound processing system for configuration of audio signals in a vehicle
7783048, Dec 07 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
7783049, Dec 07 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
7783050, Dec 07 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
7783051, Dec 07 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
7895138, Nov 23 2004 Koninklijke Philips Electronics N V Device and a method to process audio data, a computer program element and computer-readable medium
7933415, Apr 22 2002 Koninklijke Philips Electronics N V Signal synthesizing
7986788, Dec 07 2006 LG Electronics Inc Method and an apparatus for decoding an audio signal
8005229, Dec 07 2006 LG Electronics Inc. Method and an apparatus for decoding an audio signal
8031879, May 07 2001 Harman International Industries, Incorporated Sound processing system using spatial imaging techniques
8086334, Sep 01 2004 AKITA BLUE, INC Extraction of a multiple channel time-domain output signal from a multichannel signal
8099293, Jun 08 2004 Bose Corporation Audio signal processing
8213641, May 04 2006 LG Electronics Inc Enhancing audio with remix capability
8265941, Dec 07 2006 LG Electronics Inc Method and an apparatus for decoding an audio signal
8295496, Jun 08 2004 Bose Corporation Audio signal processing
8311227, Dec 07 2006 LG Electronics Inc Method and an apparatus for decoding an audio signal
8335330, Aug 22 2006 DOLBY INTERNATIONAL AB Methods and devices for audio upmixing
8340325, Dec 07 2006 LG Electronics Inc Method and an apparatus for decoding an audio signal
8359113, Mar 09 2007 LG Electronics Inc Method and an apparatus for processing an audio signal
8422688, Sep 06 2007 LG ELECTRONICS, INC Method and an apparatus of decoding an audio signal
8428267, Dec 07 2006 LG Electronics Inc Method and an apparatus for decoding an audio signal
8463413, Mar 09 2007 LG Electronics Inc Method and an apparatus for processing an audio signal
8472638, May 07 2001 Harman International Industries, Incorporated Sound processing system for configuration of audio signals in a vehicle
8488797, Dec 07 2006 LG Electronics Inc Method and an apparatus for decoding an audio signal
8532306, Sep 06 2007 LG Electronics Inc Method and an apparatus of decoding an audio signal
8594817, Mar 09 2007 LG Electronics Inc Method and an apparatus for processing an audio signal
8600533, Sep 04 2003 AKITA BLUE, INC Extraction of a multiple channel time-domain output signal from a multichannel signal
8798275, Apr 22 2002 Koninklijke Philips N.V. Signal synthesizing
9232072, Mar 13 2013 GOOGLE LLC Participant controlled spatial AEC
9408010, May 26 2011 Koninklijke Philips Electronics N V Audio system and method therefor
9418667, Oct 12 2006 LG Electronics Inc Apparatus for processing a mix signal and method thereof
RE43273, Sep 16 2003 Koninklijke Philips Electronics N.V. Generation of a sound signal
Patent Priority Assignee Title
5426702, Oct 15 1992 U S PHILIPS CORPORATION System for deriving a center channel signal from an adapted weighted combination of the left and right channels in a stereophonic audio signal
5796844, Jul 19 1996 Harman International Industries, Incorporated Multichannel active matrix sound reproduction with maximum lateral separation
///
Executed onAssignorAssigneeConveyanceFrameReelDoc
Jul 18 2001Koninklijke Philips Electronics N.V.(assignment on the face of the patent)
Aug 28 2001IRWAN, ROYKoninklijke Philips Electronics N VASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0121780291 pdf
Aug 29 2001AARTS, RONALDUS MARIAKoninklijke Philips Electronics N VASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0121780291 pdf
Date Maintenance Fee Events
May 30 2006M1551: Payment of Maintenance Fee, 4th Year, Large Entity.
Jun 15 2010M1552: Payment of Maintenance Fee, 8th Year, Large Entity.
Jun 16 2014M1553: Payment of Maintenance Fee, 12th Year, Large Entity.


Date Maintenance Schedule
Dec 17 20054 years fee payment window open
Jun 17 20066 months grace period start (w surcharge)
Dec 17 2006patent expiry (for year 4)
Dec 17 20082 years to revive unintentionally abandoned end. (for year 4)
Dec 17 20098 years fee payment window open
Jun 17 20106 months grace period start (w surcharge)
Dec 17 2010patent expiry (for year 8)
Dec 17 20122 years to revive unintentionally abandoned end. (for year 8)
Dec 17 201312 years fee payment window open
Jun 17 20146 months grace period start (w surcharge)
Dec 17 2014patent expiry (for year 12)
Dec 17 20162 years to revive unintentionally abandoned end. (for year 12)