A communication system, comprising a first node, a second node, a serial communication link between the first node and the second node, configured to transmit digital video data from the first node to the second node over one or more video channels of the link. The communication system further including a hybrid link between the first node and the second node, wherein the first node and the second node are configured to transmit at least one stream of data to the other through a hybrid channel over the hybrid link. In the communication system, the bandwidth of the serial communication link is scaled according to a video pixel frequency. Further, the initial locking of the serial communication link is aided by clock information delivered over the hybrid link.
|
23. In a communication system, a method for transmitting and receiving a clock signal and data packet over a high bandwidth bi-directional hybrid link between a first and second node, the method comprising:
delivering, through the hybrid link, a reference clock signal, to aid synchronization of a serial communication link between the first node and the second node, the serial communication link to transmit digital video data and an embedded clock signal from the first node to the second node;
receiving confirmation of synchronization of the serial communication link;
switching the hybrid link from the delivering of the reference clock signal to delivering of data via one or more sub-channels of the hybrid link in response to the receipt of the confirmation of synchronization; and
delivering the data packet via a sub-channel of the one or more sub-channels of the hybrid link after the synchronization of the serial link is established.
18. In a communication system, a method of communication comprising:
transmitting digital video data and an embedded clock signal from a first node to a second node over one or more video channels of a serial communication link, the embedded clock signal being embedded in the video data;
transmitting a reference clock for the serial communication link over a hybrid link from the first node to the second node;
detecting a lock on the serial communication link by the second node;
switching the hybrid link from the transmission of the reference clock to transmission via one or more sub-channels of a hybrid channel in response to the detecting of the lock on the serial communication link;
transmitting at least one stream of supporting data between the first node and the second node over a sub-channel of the one or more sub-channels of the hybrid channel; and
scaling the bandwidth of the serial communication link according to a video pixel frequency.
1. A communication system, comprising:
a first node;
a second node;
a serial communication link between the first node and the second node, configured to transmit digital video data and an embedded clock signal from the first node to the second node over one or more video channels of the link, the embedded clock signal being embedded in the video data; and
a high-bandwidth, bi-directional hybrid link between the first node and the second node wherein the hybrid link is a non-TMDS link, the hybrid link including one or more sub-channels for transmission of data;
wherein the first node and the second node are configured to transmit at least a first stream of data to the other through a hybrid channel over the one or more sub-channels of the hybrid link; and
wherein the hybrid link is configured to deliver a reference clock for the serial communication link, the hybrid link to switch from transmission of the reference clock to transmission of data via the one or more sub-channels including transmission of the first stream of data upon detection of an initial lock of the serial communication link, wherein the initial lock of the serial communication link is aided by the reference clock delivered over the hybrid link.
16. A communication node configured to be coupled to a serial communication link having at least one video channel and a high-bandwidth, bi-directional hybrid channel having at least one sub-channel, the communication node comprising:
an input configured to be coupled to the serial communication link, to receive video data and an embedded clock signal or signals, the embedded clock signal or signals being embedded in the video data;
a hybrid channel interface coupled to receive and transmit user and application data to and from user and application sub-systems and to receive a reference clock signal;
a video output for asserting video data received from the serial communication link; and
circuitry, coupled between said input and each said interface and video output, and configured to recover the embedded clock from the video data,
wherein the received video data is asserted to the video output, and the user and application data is transmitted through a general purpose data channel in the hybrid link;
wherein the communication node is configured to use the reference clock to aid in obtaining a lock on the serial communication link, and wherein, upon detecting the lock on the serial communication link, the hybrid channel interface is to switch from reception of the reference clock signal to receiving and transmitting user and application data via the hybrid link.
13. A communication node configured to be coupled to a serial communication link having at least one video channel and to be coupled to a high-bandwidth bi-directional hybrid link having at least one sub-channel, the communication node comprising:
an input coupled to receive video data and an embedded clock signal or signals from a video system via the serial communication link;
a hybrid channel interface coupled to receive and transmit user and application data to and from a user and application sub-system and to receive a reference clock signal;
video outputs configured to be coupled to the serial communication link, wherein the embedded clock signal is embedded with video data in the serial communication link; and
circuitry coupled between the outputs and each said input and interface, and configured to generate video data and user and application data, wherein the video data is transmitted through the serial communication link, and the user and application data is transmitted through a general purpose data channel in the hybrid link;
wherein the communication node is configured to use the reference clock to aid in obtaining a lock on the serial communication link, and wherein, upon detecting the lock on the serial communication link, the hybrid channel interface is to switch from reception of the reference clock signal to receiving a reference clock signal to receiving and transmitting the user and application data via the hybrid link.
2. The system of
3. The system of
an audio sub-channel for digital audio streaming;
a command sub-channel for content protection, consumer electronics control, and other control commands; and
a data sub-channel for user data transfers.
4. The system of
5. The system of
6. The system of
7. The system of
8. The system of
9. The system of
10. The system of
11. The system of
12. The system of
14. The communication node of
15. The communication node of
17. The communication node of
19. The method of
transmitting digital audio data over an audio sub-channel of the plurality of sub-channels for digital audio streaming;
transmitting command data over a command sub-channel of the plurality of sub-channels for content protection, consumer electronics control, and other control commands; and
transmitting bulk data over a data sub-channel of the plurality of sub-channels for user data transfers.
20. The method of
21. The method of
22. The method of
24. The method of
25. The method of
26. The method of
|
The present invention is directed to systems and methods for transmitting video, audio, command and control data and other information over a bi-directional hybrid link. Preferred embodiments employ clocking embedded in the serial communication link, so that an additional channel, otherwise used for sending clock signals, is available for bi-directional data transfer.
Embodiments of the invention disclosed describe a new method and system for connecting and adding greater functionality to electronic devices. Previous standards in digital connectivity enabled transfer of protected uncompressed video and audio data from a source device (e.g., a DVD player) to a sink device (e.g., a TV) in a unidirectional path.
In typical prior art systems like that illustrated in
Embodiments of the invention disclose a system and method of a high-speed hybrid channel that can carry compressed video, high quality audio, content protection, control signals, and data packets in both directions, i.e. from source to sink and sink to source. Embodiments described disclose both a unique physical and logical layer making it a stand-alone complete standard. Additionally, it would be desirable to have a system that can be made backwards compatible with other existing standards such as HDMI, DVI, and DisplayPort. The embodiments described can be made compatible to other standards such as HDMI, DVI, and DisplayPort.
An embodiment includes a communication system, comprising a first node, a second node, a serial communication link between the first node and the second node, configured to transmit digital video data from the first node to the second node over one or more video channels of the link; and a hybrid link between the first node and the second node, wherein the first node and the second node are configured to transmit at least one stream of data to the other through a hybrid channel over the hybrid link. In a preferred embodiment of the communication system the bandwidth of the serial communication link is scaled according to a video pixel frequency. Further, the initial locking of the serial communication link is aided by clock information delivered over the hybrid link.
Another embodiment includes, in a communication system, a hybrid link between a first node and a second node for transmitting and receiving clock signals and data packets, the said hybrid link comprising a bi-directional channel coupled between the first node and the second node, a first transceiver in the first node, a second transceiver in the second node, wherein the hybrid link delivers the clock signal to aid synchronization between the first node and the second node and wherein the hybrid link delivers the data packet after the synchronization is established.
Another embodiment includes a communication node configured to be coupled to a serial communication link having at least one video channel and a hybrid channel having at least one sub-channel, the communication node comprising an input coupled to receive video data and a clock signal or signals from a video system, a hybrid channel interface coupled to receive and transmit user and application data to and from a user and application sub-system, video outputs configured to be coupled to the serial communication link, wherein the clock signal or signals are embedded with video data in the serial communication link, and circuitry coupled between the outputs and each said input and interface, and configured to generate video data and user and application data, wherein the video data is transmitted through the serial communication link, and the user and application data is transmitted through a general purpose data channel in the hybrid link.
Yet another embodiment includes a communication node configured to be coupled to a serial communication link having at least one video channel and a hybrid channel having at least one sub-channel, the communication node comprising: an input configured to be coupled to the serial communication link, to receive video data, including a clock signal or signals embedded in the video data, a hybrid channel interface coupled to receive and transmit user and application data to and from a user and application sub-systems, a video output for asserting video data received from the serial communication link, and circuitry, coupled between said input and each said interface and video output, and configured to recover a pixel clock from the video data, wherein the received video data is asserted to the video output, and the user and application data is transmitted through a general purpose data channel in the hybrid link.
Yet another embodiment includes, in a communication system, a method of communication comprising transmission of digital video data from a first node to a second node over one or more video channels of a serial communication link, transmission of at least one stream of supporting data between the first and the second node over a hybrid link, and scaling the bandwidth of the serial communication link according to a video pixel frequency.
Still another embodiment includes in a communication system, a method for transmitting and receiving a clock signal and data packet over a hybrid link between a first and second node, the said method comprising delivering, through the hybrid link, the clock signal, to aid synchronization between the first node and the second node such that the hybrid link delivers the data packet after the synchronization is established.
In following the conventions of previously established display interface standards, we will have 3 classes of Digital Interface for Video and Audio (DIVA) devices.
Source:
Devices which transmit a video (and audio, if applicable) signal. Source devices may enforce content protection if required. These devices may or may not have storage capability. Some examples include:
DVD players (both standard definition and high definition)
Digital video recorders
Set top boxes
Desktop and laptop computers
Digital video and image capture devices such as camcorders and cameras
Multimedia mobile phones
Sink:
Devices which receive a video (and audio, if applicable) signal. A Display is defined as a special type of Sink. Examples include:
TVs
PC monitors
Home stereo systems
Repeater:
Any device which includes a Source and Sink function as well as a re-transmission function between the Sink (input) and Source (output) and is software transparent. Examples include:
AV Receivers
Input Selectors/Switches
At any given time, a DIVA cluster of devices will have one master device (typically a TV or Monitor) and several member devices that are under the master device's control. This above list of Source, Sink, and Repeater devices is intended to impart a general understanding of the device types that are expected or available in the market. Other devices and variants are possible as would be apparent to one skilled in the art. A DIVA device may have more than one DIVA input or output. In this case, each DIVA input on a device shall follow all the rules for a DIVA Sink and each DIVA output shall follow all the rules for a DIVA Source.
In an embodiment, the hybrid channel is a high-speed half-duplex channel, made logically a full-duplex bi-directional channel by alternating the direction of transmission. In the embodiment, the audio sub-channel, the command sub-channel and the data sub-channel are time multiplexed over the hybrid channel. The circuitry in the hybrid channel is clocked by the reference clock when the hybrid channel is assigned to the reference clock. The circuitry in the hybrid channel is clocked by the recovered clock from the serial communication channel when the hybrid channel is assigned to other than the reference clock. Additionally, in an alternative embodiment, circuitry in the hybrid channel is clocked by local oscillators when the hybrid channel is assigned to other than the reference clock. In a preferred embodiment the hybrid channel further comprises a lock detection circuit on the second node and a switch that switches between the reference clock and the sub-channels.
Referring back to
In a preferred embodiment of a communication system is included a hybrid link between a first node and a second node for transmitting and receiving a clock signal or signals and a data packet, the said hybrid link comprising a bi-directional channel coupled between the first node and the second node, a first transceiver in the first node, a second transceiver in the second node, wherein the hybrid link delivers the clock signal to aid synchronization between the first node and the second node wherein the hybrid link delivers the data packet after the synchronization is established. Additionally, the data packet is/are a plurality of data packets, and the packet types comprise audio, command, and user bulk data packets.
A preferred embodiment includes, in a communication system, a method of communication comprising transmission of digital video data from a first node to a second node over one or more video channels of a serial communication link, transmission of at least one stream of supporting data between the first and the second node over a hybrid link, and scaling the bandwidth of the serial communication link according to a video pixel frequency. Also, the method includes, in the hybrid link, transmitting a reference clock for the serial communication link, transmitting digital audio data over an audio sub-channel for digital audio streaming, transmitting command data over a command sub-channel for content protection, consumer electronics control, and other control commands, and transmitting bulk data over a data sub-channel for user data transfers. Additionally, the method further comprises alternating the direction of transmission in the hybrid channel such that the hybrid channel functionality is logically that of a full-duplex bi-directional channel. An alternate embodiment comprises time multiplexing over the hybrid channel, the audio sub-channel, the command sub-channel and the data sub-channel. Preferably, the method comprises, in the hybrid channel, detecting a lock from the second node of the hybrid channel and switching, in the hybrid channel, between the reference clock and the sub-channels. Further, the method comprises, arbitrating, in the hybrid channel, between the audio sub-channel, the command sub-channel and the data sub-channel based on a predefined priority. The method further comprises embedding a clock in one or more video data channels of the serial communication link such that a pixel clock is transmitted in the embedded clock channel over the serial communication link. In the hybrid channel, transmission of data packets is of varying sizes, and the method comprises changing the flow direction between the first and second node after every packet transfer.
Another embodiment includes, in a communication system, a method for transmitting and receiving a clock signal and data packet over a hybrid link between a first and second node, the said method comprising delivering, through the hybrid link, the clock signal, to aid synchronization between the first node and the second node such that the hybrid link delivers the data packet after the synchronization is established. A plurality of data packets can be delivered through the hybrid link. The plurality of data packets includes audio data, command data, and bulk user data. Preferably, the hybrid link comprises a bi-directional channel coupled between a first transceiver in the first node and a second transceiver in the second node, and the method further comprises locking of the serial communication link based on clock information delivered over the hybrid link. Note that the packet types and user and application data delivered over the hybrid link can also include compressed video data.
Usage Models:
Like the data types that can be transferred between Source and Sink, usage models will be classified into 4 major categories: Uncompressed Video and Audio from Source to Sink, CE Control, Bulk Data Transfer, and Bi-Directional Audio.
Uncompressed Video and Audio from Source to Sink:
A common usage case is to send uncompressed video and audio data from a video source (such as a DVD player) to a display device. In the embodiment illustrated, the primary video channel employs 1 to 3 twisted pairs to send video data. An ideal embodiment for the interface has a speed of 4.5 Gbps per twisted pair, and 13.5 Gbps total. Optionally, 1 to 4 data channels can be provided. As described in embodiments in the Detailed Description, a unique characteristic of the invention is that the clock of the video channel will be recovered by receiver PHY and the recovered clock will be used for the hybrid channel. Additionally, audio data can be sent through the hybrid channel. Both video and audio data are allowed to pass through Repeater devices before reaching the Sink device. Video data can have a pixel size of 18, 24, 30, 36 or 48 bits. At minimum, in preferred embodiments, video resolution support will support resolutions from VGA (640×480) to 1080p (1920×1080) depending on the display's capabilities. Additional and alternate support variations are possible as would be apparent to one skilled in the art. Further, the usage of data channels can vary by application. Source and Sink devices are allowed to support the minimum number of lanes required for their needs. However, in preferred embodiments, the external cable that is detachable by an end user is required to support at least 3 lanes to maximize the interoperability between Source and Sink devices.
In alternate embodiments, a number of lines can be reserved to maintain backward compatibility with other existing standards. In one embodiment, there are provided five lines, including one twisted pair and three straight lines.
Consumer Electronics (CE) Control:
The system described in the Detailed Description enables control of multiple electronic devices through a single master device. At all times, there will be one master device (in an example embodiment, a TV (Sink) is used as a master device) that can control multiple slave devices. In a preferred embodiment, a slave device can only have one master device. Preferably, device detection and enumeration occurs when a slave device in plugged into a network.
In a preferred embodiment, the master device detects that a DIVA slave device is connected to it. The next time the user queries to see what devices are connected, the new DIVA slave device is listed on the interface for a user to control. In the case that multiple masters are active in a network, all slave devices, in a preferred embodiment, can be detected by the multiple masters, but in an ideal embodiment, a slave can only be under the control of one master. As part of device enumeration, a DIVA slave device provides a list of functions to the DIVA master so that the DIVA master is able to control the DIVA slave device. Also, a set of required commands per device type is listed. In some embodiments, DIVA control can be implemented across various CE device manufacturers to ensure interoperability by requiring devices to support specific functions per device type.
Existing prior art systems like HDMI incorporate CEC functionality allowing for components to be controlled through a TV by using a dedicated CEC control pin to transfer data. In the embodiments disclosed, control data is sent through the high speed hybrid channel, resulting in data transfer with minimal latency, to give better system responsiveness to the end user.
Examples of CE control include the following:
Example 1: A user wishes to control his or her DIVA-compliant DVD Player from their DIVA-compliant TV. Once the DVD player is attached to the TV, the TV is able to detect the DVD player. The user can then turn the DVD player on and off through the TV. Further, the user can discover the features of the DVD player, and its' accessible functions, through the TV. For example, the user can Play, Stop, Pause, FF and RW as well as get to the Title Menu and navigate the menu through the TV remote control.
Example 2: Play a file from PC to TV via DIVA—Assuming that the PC and TV are both DIVA-compliant, the user can query the slave device from the master (say the TV in this case) to see what control functions are available. In addition, the user can navigate through the directory of the PC using his or her TV remote control using, in preferred embodiments, just the up, down, left, right, and enter buttons. Once a media file (such as MP3 or MPEG video) is found, then user should be able to select it and play the file.
Bulk Data Transfer:
By using the data sub-channel of DIVA's hybrid channel as described in the Detailed Description, large data files can be speedily transferred from a source device to a destination device. USB or Ethernet data can be sent directly through the DIVA data sub-channel. In the case USB or Ethernet is not available, an application can send data as a generic DIVA data packet as well. DIVA serves as a way to transport data from source to destination by using the DIVA data packet protocol.
Examples of bulk data transfer include:
Example 1: A User wants to send compressed video data from a TV to a DVR. Using the TV's ASTC or DVB-T tuner, the TV receives MPEG compressed data from an over the air broadcast. The user wants to send the compressed MPEG stream to a DIVA-compliant Digital Video Recorder (DVR) for recording and viewing later. The TV would then send the MPEG file using the data sub-channel of the hybrid channel to the DVR. The assumption here is that the DIVA complaint DVR will have the ability to receive these data packets and store them on its' hard drive.
Example 2: File copy from TV to DVD-R. A user inserts a memory card into a TV and wishes to transfer the media file (such as a JPEG image) to a DVD-R for recording to DVD-ROM. The file can be sent through DIVA's data sub-channel to the destination device. Depending on the application, the protocol for sending the data may be USB or Ethernet. If the data is transferred through USB over DIVA, then both source and destination applications will need to support USB I/O.
Bi-Directional Audio:
The DIVA protocol allows audio data to be sent bi-directionally, both from Source to Sink (forward audio) and Sink to Source (backward audio). The forward audio is the primary audio path which is in sync with the primary video path. The back audio allows a separate audio path from Sink to Source.
Examples of bi-directional audio include:
Example 1: Forward audio: A DIVA set top box sends video through the primary video channel to the TV. The audio is sent through the forward channel audio and is in sync with the video that is sent through the video channel.
Example 2: Backward audio: A user is watching an HD over the air broadcast with surround sound audio. The tuner in use is inside the TV. However, the TV is not capable of outputting surround sound audio. In order to play the sound through his or her AV receiver without adding an additional cable, the user needs a backward audio to send audio data from the TV to the AV receiver. In this case, the AV Receiver will also need to be DIVA-compliant to receive the audio data from the TV.
Foregoing described embodiments of the invention are provided as illustrations and descriptions. They are not intended to limit the invention to precise form described. In particular, it is contemplated that functional implementation of embodiments of the invention described herein may be implemented equivalently in hardware, software, firmware, and/or other available functional components or building blocks, and that networks may be wired, wireless, or a combination of wired and wireless. Other variations and embodiments are possible in light of the above teachings, and it is thus intended that the scope of invention not be limited by this Detailed Description, but by the claims following.
Lee, DongYun, Lee, David, Lee, Bong-Joon, Hahn, John, Kim, Byoung-Woon
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
4575714, | Mar 12 1984 | MOTOROLA, INC , A DE CORP | Module presence sensor |
5428752, | Sep 28 1991 | Motorola, Inc. | Processor system option module identification system |
5783926, | Nov 05 1996 | Unwired Planet, LLC | Apparatus for identifying accessories connected to radiotelephone equipment |
5983288, | Aug 20 1996 | AVAGO TECHNOLOGIES GENERAL IP SINGAPORE PTE LTD | Dynamically configurable personal computer card utilizing variable interrogation signal to detect connected extension |
6339831, | Sep 11 1997 | International Business Machines Corporation | Automatic detecting unit for diagnosing a connection and identifying an external device, information processing apparatus, and external device |
6567007, | Mar 29 1999 | Robert Bosch GmbH | Identifiable electric component, method of identification and evaluation device |
7142094, | Feb 20 2002 | Current Grid, LLC | Last leg power grid high-speed data transmitter and receiver structures |
7295578, | Sep 12 2001 | NEXUS DISPLAY TECHNOLOGIES LLC | Method and apparatus for synchronizing auxiliary data and video data transmitted over a TMDS-like link |
7639765, | Sep 26 2005 | SOCIONEXT INC | Single-line bidirectional communication apparatus and system |
7856561, | Jan 25 2005 | Analog Devices International Unlimited Company | Detecting legacy powered device in power over ethernet system |
7916780, | Apr 09 2007 | Silicon Image, Inc | Adaptive equalizer for use with clock and data recovery circuit of serial communication link |
7936546, | Jan 17 2006 | AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LIMITED | Apparatus and method for classifying a powered device (PD) in a power source equipment (PSE) controller |
7940809, | Apr 09 2007 | Silicon Image, Inc | Digital video interface with bi-directional half-duplex clock channel used as auxiliary data channel |
7958286, | Jul 17 2000 | Silicon Laboratories Inc. | Resistor identification configuration circuitry and associated method |
8122159, | Jan 16 2009 | Allegro MicroSystems, LLC | Determining addresses of electrical components arranged in a daisy chain |
20020171741, | |||
20030043771, | |||
20040073697, | |||
20040267974, | |||
20050004708, | |||
20050004718, | |||
20050132109, | |||
20050162338, | |||
20060100799, | |||
20060164098, | |||
20070200859, | |||
20070257923, | |||
20080005433, | |||
20080008470, | |||
20080028120, | |||
20080122556, | |||
20080150718, | |||
20080301748, | |||
20080317181, | |||
20090013366, | |||
20090245345, | |||
20090248918, | |||
20090260043, | |||
20100100200, | |||
20100283324, | |||
CN101032113, | |||
EP166441, | |||
EP1473941, | |||
JP2004350266, | |||
JP2005051741, | |||
JP2005173553, | |||
JP2005217799, | |||
JP2007134803, | |||
JP2008017438, | |||
JP2008310300, | |||
KR1020050012310, | |||
TW200303711, | |||
TW200843279, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Mar 27 2008 | Silicon Image, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
Dec 09 2017 | 4 years fee payment window open |
Jun 09 2018 | 6 months grace period start (w surcharge) |
Dec 09 2018 | patent expiry (for year 4) |
Dec 09 2020 | 2 years to revive unintentionally abandoned end. (for year 4) |
Dec 09 2021 | 8 years fee payment window open |
Jun 09 2022 | 6 months grace period start (w surcharge) |
Dec 09 2022 | patent expiry (for year 8) |
Dec 09 2024 | 2 years to revive unintentionally abandoned end. (for year 8) |
Dec 09 2025 | 12 years fee payment window open |
Jun 09 2026 | 6 months grace period start (w surcharge) |
Dec 09 2026 | patent expiry (for year 12) |
Dec 09 2028 | 2 years to revive unintentionally abandoned end. (for year 12) |