An audio/video production system is implemented on a PC-based platform, preferably utilizing various forms of removable magnetic, optical, or magneto-optical storage media. Specially modified cameras or other sources provide digitally data-compressed audio and video program materials in two formats, a first format having a higher data-compression ratio and intended for use in off-line systems to develop edit decision lists, and a second format having a lower data-compression ratio and intended for use in on-line editing and to produce the final representations of the programs. Off-line editing decisions may thus be developed on a PC using removable storage media, and final representations of the programs may be produced on-line in accordance with stationary-head or rotary-head digital-tape-based formats, such as DAT, 6-mm or 8-mm tapes. In an alternative embodiment, automatic and unattended editing, or extended program playback of more than 40 hours duration of digital video, is available.
|
40. video recording apparatus, comprising:
an input for receiving video program source material, such material being characterized in having a plurality of sequential frames representative of motion imagery; a video recorder in communication with the input for simultaneously recording information representative of the video program source material, including correlated edit-time-code information, onto first and second storage media, wherein the first storage medium is used to store the sequential frames in a randomly addressable manner, and the second storage medium is used to store the sequential frames in a serially addressable manner, such that each frame stored on one medium is associated with a time code correlated to a corresponding frame stored on the other medium.
22. A digital video recording apparatus adapted or for use with an on-line video editing facility and a personal computer configured to perform off-line editing, including edit-list development, the apparatus comprising:
a camera outputting information representative of a video program; means to digitally compress the program information at a plurality of compression ratios ; a removable disk to store a highly compressed randomly addressable version of the program information suitable for off-line editing using the personal computer; and a removable tape drive to store a less compressed serially addressable version of the program information suitable for on-line editing; both versions of the program being stored with correlated edit-time-code information, thereby enabling the on-line editing to use the edit list developed during off-line editing.
10. The method of producing a final video program, comprising the steps of:
providing video program source material in first and second digital formats, the material in the first format being compressed relative to the material in the second format; recording the material in the first and second formats, respectively, onto first and second removable storage media along with correlated edit-time-code information; interfacing the first storage medium to an off-line video editing system to develop edit decision information; transferring the edit decision list to an on-line video editing system; accessing the program material in the second storage medium using the on-line video editing system; and editing the material in the second format on the second storage medium in accordance with the edit decision list to produce a final video program.
24. A digital audio/video production system, comprising:
(a) digital video recording apparatus, including: an input to receive a video program, first and second removable digital storage media, and means to simultaneously record the program, including correlated edit-time-code information, onto the first and second removable storage media in first and second formats, respectively, the first format being data-compressed relative to the information in the second format; (b) a first video editing system, including: means to receive the first removable storage medium; and controls enabling an operator to edit the program in the first format and develop a set of edit decision directives; and (c) a second video editing system, including: means to receive the second removable storage medium, means to receive the edit decision directives, and means to edit the program information in the second format in accordance with the edit decision directives to create a final video production. 34. A video production method, comprising the steps of:
simultaneously recording information representative of a video program, such material being characterized in having a multitude of sequential frames used to portray motion imagery plus correlated edit-time-code information, onto first and second removable digital storage media in first and second formats, respectively, the pro,ram information in the first format being data-compressed relative to the program information in the second format both formats including information representative of each frame characterizing the program; receiving the program in the first removable storage medium format at a first video editing facility and editing the program information at the first facility in the first format to develop a see set of edit decision directives based upon the edit-mime time-code information; and receiving the program in the second removable storage medium and format with edit decision directives at a second video editing facility and editing the program information at the second facility in the second format in accordance with the edit decision directives so as to create a final video production.
1. A digital audio/video production system adapted for use with an on-line video editing facility, the production system comprising:
a digital video recorder capable of simultaneously recording information representative of the same program source material, including correlated edit-time-code information, onto first and second removable storage media in first and second formats, respectively, the information in the first format being data-compressed relative to the information in the second format; a programmed personal computer configured to receive the first removable storage medium, enabling an operator to edit the information representative of the program source material in the first format in off-line fashion so as to develop an edit decision list; and means to transfer the edit decision list to an on-line video editing facility, the on-line editing facility being further configured to receive the second removable storage medium, whereby an operator of the on-line facility may edit the program source material in the second format using the edit decision list to create a final video production.
12. A digital video production system adapted to deliver program material and an accompanying edit decision list to an on-line video editing facility for the purpose of creating a final program, the system comprising:
digital video recording apparatus, including: an input to receive a video program, means to digitally compress the program in accordance with more than one compression ratio, an interface to a first removable storage medium, an interface to a second removable storage medium, and means no to simultaneously record the video program onto the first removable storage medium at a first compression ratio and onto the second removable storage medium at a second compression ratio, the first compression ratio being greater than the second; and an off-line digital video editing system, including: an interface co to receive the first removable storage medium, a display to review portions of the video program, enabling a user to make edit decisions concerning the program, and an interface to third removable storage medium to store a list of the edit decision, whereby an on-line video editing facility, upon receiving the second and third storage medium, may be used to produce a final, edited version of the program in accordance with the decision list.
2. The digital video production system of
3. The digital video production system of
4. The digital video production system of
5. The digital video production system of
6. The digital video production system of
7. The digital video production system of
8. The digital video production system of
9. The digital video production system of
14. The digital video production system of
15. The digital video production system of
16. The digital video production system of
17. The digital video production system of
18. The digital video production system of
19. The digital video production system of
20. The digital video production system of
21. The digital video production system of
23. The digital video recording apparatus of
25. The digital audio/video production system of
26. The digital audio/video production system of
27. The digital audio/video production system of
28. The digital audio/video production system of
29. The digital audio/video production system of
30. The digital audio/video production system of
31. The digital audio/video production system of
32. The digital audio/video production system of
33. The digital audio/video production system of
35. The video production method of
36. The video production method of
37. The video production method of
38. The video production method of
39. The video production method of
44. The apparatus of
45. The apparatus of
47. The apparatus of
48. The apparatus of
49. The apparatus of
50. The apparatus of
|
This is a continuation-in-part of U.S. application Ser. No. 08/298,104, filed Aug. 30, 1994Audio/Video Interleave (Audio/Video Interleave) file format. As an alternative, an independent system for recording audio signals may be implemented either by employing separate digital recording provisions controlled by the same system and electronics, or by implementing completely separate equipment external to the camera system described above.
FIG. 3 shows an off-line digital video editing system, implemented with a PC-based edit controller having provisions for accepting materials in the form of removable storage media. The controller 102 is preferably of conventional design, but operates at least at the level of current Intel Pentium or high-level "486" processors. The unit is equipped with a color display, and preferably includes a PCI internal bus structure, and provisions for interfacing with a removable PCMCIA storage card 104. In one embodiment this card 104 is implemented with magnetic or magneto-optical disks, or with an optical disc unit. Alternatively, a stand-alone external data storage unit (not shown) could be interfaced through the PCMCIA facilities, or by way of an SCSI-type interface.
As an optional feature, a PCMCIA expansion adapter 106 may be provided, so that a plurality of PCMCIA cards or PCMCIA devices 108 may be accessed conveniently through a single PCMCIA slot on the PC, as shown. This expansion adapter is provided with internal selection and multiplexing circuitry, so that each plug-in card or device may be accessed independently and without interference with any other card or device in [he the expansion adapter. The selection may be performed by employing techniques well-known in the art, such as the addressing schemes utilized for SCSI or GPIB data busses. Since a single 420 MByte PCMCIA card module is capable of holding 75 minutes of programming material with image dimensions in pixels of 320×240, 4:2:2 sampling and a 50:1 data compression ratio, an expansion adapter equipped with ten PCMCIA slots and plug-in cards is capable of providing ten hours of original program material, and this programming capacity is capable of being further expanded with other types of PCMCIA-compatible devices. As a further option, a custom-designed PC could be provided with multiple PCMCIA slots to accept a plurality of storage devices without the need for an external expansion adapter.
In operation, the off-line digital video editing system PC is used to edit and combine the materials stored on various data-storage devices, producing an edit decision list which then may be utilized by an on-line editing system. The availability of multiple storage devices enables the operator to rehearse and then confirm "A/B-roll" edits with only two storage devices, and "A/B/C-roll" edits with three storage devices. When equipped with expansion provisions or additional SCSI-bus devices, the system is capable of controlling the various storage devices so as to produce highly complicated sequences in a convenient and timely manner. While the lower-quality (higher data-compression ratio) program materials are utilized only for determining the edit points (edit decision list) for the program, the off-line editing system described herein below is capable of producing the final edited version of the program with high-quality results in accordance with the preferred embodiment.
The versatility of the system may be further enhanced if planning for the program is begun by providing script and staging information to the computer in advance of editing, or even in advance of filming or taping the original production. The script may be provided as a simple text file, or as a formatted word processor file, such as used in "WordPerfect" or "Word for Windows". As an alternative, the file may be of a custom format, as is commonly used by professional scriptwriters. This script and staging information is then reformatted to include specific commands, such as when to switch camera coverage to a particular actor, or the choice of a particular camera angle. Further details may now be included, such as the ability to identify close-up camera coverage, or points at which specific visual special effects (such as split-screen views or chroma-keyed backgrounds) or sound effects are to be incorporated. The modified script file is then used to guide the operator of the off-line editing system in making edit decisions to match the program materials to the script, to make any modifications to the script that are necessitated by the circumstances of the taping, or to take advantage of any unforeseen artistic opportunities presented by the actual taped materials.
In addition, it is common practice in broadcast-television news studios to use remotely-controlled cameras to telecast the live programs. These cameras are mounted on motorized bases which are capable of moving the cameras to any desired position on the stage, within the physical limits imposed by the stage itself (such as the length of the camera cables or the clearance available for cameras to move relative to each other on the stage). The zoom-lenses, pan-tilt mounts, and camera electronic control settings are manipulated through the camera remote-control facilities, which may include either separate electronic control panels or alternatively computer interfaces with appropriate control software, such as the unit described by washino Washino, U.S. Pat. No. 5,325,202. By coupling the software script materials to instructions for control of the camera movements, the capabilities of all of these systems may be optimized. The modified script file must be prepared before the actual taping occurs, however, and should include the physical layout of the sets and props for each scene.
The staging information described herein above, is identified by special camera-remote-control software, and the camera control operator is provided with a graphical interface which depicts the layout of the set and the "blocked" positions of the actors and props for a given scene. This system preferably also includes a user interface (such as a touch-screen or a mouse) to enable the camera control operator to program the cameras to be in the correct location, and to have the correct zoom-lens and pan-tilt positions, to capture the scene as desired, as described in co-pending application U.S. Ser. No. 08/050,861. At this time, the operator optionally may add information to control automated lighting systems, which are well-known in the are art of the film, video and stage production. This enhanced version of the modified script file is then used to direct camera actions during the actual taping of the scenes, and is further modified as part of the off-line editing process as the EDL is developed, as described above, in accordance with the invention.
An on-line digital video editing system is depicted in block-diagram form in FIG. 4. The functional operation of the editing system follows that of the digital video editing system disclosed in FIG. 2, or in an alternative embodiment, may be implemented in a more sophisticated form, as described in our co-pending application "Multi-Format Audio/Video Production System," U.S. application Ser. No. 08/298,104 filed Aug. 30, 1994. This system is implemented with a PC-based edit controller 206 having separate provisions for accepting removable storage media. In the preferred embodiment, the digital video tapes recorded by the system of FIG. 2 are installed in a tape-storage "jukebox" 208 for easy access during editing. Such tape cassette handling devices are well-known in the art of computer data storage, and are generally utilized for data back-up applications or for archival storage.
The edits incorporated into the edit decision list are utilized to sequence the various digital tapes so as to assemble a recording of the desired program materials into a final finished product, which is then recorded on the videotape recorder 202. This video recorder may be implemented as any of the commonly used choices for analog recorders, including, among others, 1" C-format, Betacam, Betacam-SP, U-matic-SP, and Hi-8. If implemented as a digital recorder, the available choices include, among others, D-1, D-2, D-3, D-5, DCT, and Digital Betacam. Furthermore, the final format could be another digital data tape such as the type used for program source material or any other removable storage media. Since the time-code identification numbers on the removable media of the off-line system correlate with those utilized in the on-line system, no conversion or adaptation of the edit decision list is needed. The video monitor 204 is used to manipulate the windows-based edit system control software, and to view the program materials as the edit process proceeds. This process will be essentially automatic, as all of the necessary decisions already have been made in the off-line editing process as described above. In addition, this is an appropriate time for adding digital video effects to the program or to implement any special effects included in the program script.
The invention may be used for other applications limited to record/playback, without implementing the full range of editing features. For example, in applications such as master playback for video duplication, the program master nape tape must be played, rewound to the beginning, and then restarted, on a repeating cycle. In facilities employing a conventional video tape recorder, this represents a great deal of physical stress on the program master tape, thereby requiring a large number of copies of this master tape when many production runs are required to complete an order. In addition, some production time is lost due to the rewinding process itself. In a disk-based application of the system disclosed herein, there is no significant deterioration of the master program even in repeated usage, and it is possible to begin playing a program at any point desired, with essentially no delay due to cueing the program media to the physical location containing that part of the recorded program. In order to provide the necessary recording time duration, additional hard-disk drives would be added to achieve the required playback duration. Based on an MPEG-2 data-compression ratio of 20:1 (with a 4:2:2 recording system for NTSC signals), two hours of digital video would require approximately 8 GB of disk storage capacity. Disk-drives offering capacity of 9 GB are currently available, and until removable media achieve comparable levels, a program would accordingly be loaded into internal or external disk-storage units from the required number of removable media units.
The invention may also be employed as a playback unit for cable television usage or other extended-playing time applications. By adding as many "juke-box" units as desired, it is a simple matter to extend the playback time capability of the system, with each "juke-box" providing approximately 40 hours of digital video playback. By fully utilizing the RAM-based audio/video buffering capabilities discussed with reference to FIG. 2, it is possible to supply digital video playback on a continuous basis by changing the tape storage cassettes or cartridges "on-the-fly" while video playback proceeds. If provided with computer-readable identification codes on each cassette or cartridge, the computer is able to locate the "juke-box" and the particular physical storage slot containing program materials that previously have be scheduled for playback. Identification and library management systems of this type are well-known in the art, and are in common usage implemented as "cart-machines" employed for playback of commercial advertisements or other program materials at broadcast stations. In addition, playback at any frame rate or television system standard would be available, in accordance with our co-pending U.S. application Ser. No. 08/298,104 filed Aug. 30, 1994.
The versatility of the Digital Video Production System may be enhanced further, if planning for the program is begun by providing script and staging information to the computer in advance of editing, or even in advance of filming or taping the original production. Computer software having access to the script materials will enable the operator to match the scenes to the recorded video materials quickly, thereby speeding the editing process. In addition, it is common practice in broadcast-television news studios to use remotely-controlled cameras to telecast the live programs. By coupling the software script materials to instructions for control of the camera movements, the capabilities of all of these systems will be optimized.
Washino, Kinya, Schwab, Barry H.
Patent | Priority | Assignee | Title |
10056111, | May 09 2002 | GRASS VALLEY CANADA | Systems, methods, and computer program products for multiple aspect ratio automated simulcast production |
10210254, | Feb 12 2005 | Thomas Majchrowski & Associates, Inc. | Methods and apparatuses for assisting the production of media works and the like |
10210903, | May 09 2002 | GVBB Holdings S.A.R.L. | Systems, methods, and computer program products for multiple aspect ratio automated simulcast production |
10360944, | May 09 2002 | GRASS VALLEY CANADA | Systems, methods, and computer program products for multiple aspect ratio automated simulcast production |
10499091, | Sep 17 2002 | HAWK TECHNOLOGY SYSTEMS, L L C | High-quality, reduced data rate streaming video production and monitoring system |
10514815, | Feb 14 2005 | Thomas Majchrowski & Associates, Inc. | Multipurpose media players |
10546612, | May 09 2002 | GRASS VALLEY CANADA | Systems, methods, and computer program products for automated real-time execution of live inserts of repurposed stored content distribution |
10582168, | Feb 14 2013 | RED.COM, LLC | Green image data processing |
10945004, | Sep 17 2002 | HAWK TECHNOLOGY SYSTEMS, L L C | High-quality, reduced data rate streaming video production and monitoring system |
11109114, | Apr 18 2001 | GRASS VALLEY CANADA | Advertisement management method, system, and computer program product |
11395017, | Sep 17 2002 | HAWK TECHNOLOGY SYSTEMS, L.L.C. | High-quality, reduced data rate streaming video production and monitoring system |
11467706, | Feb 14 2005 | THOMAS M. MAJCHROWSKI & ASSOCIATES, INC. | Multipurpose media players |
11503294, | Jul 05 2017 | RED.COM, LLC | Video image data processing in electronic devices |
11657103, | Feb 12 2005 | Thomas Majchrowski & Associates, Inc. | Methods and apparatuses for assisting the production of media works and the like |
11818351, | Jul 05 2017 | RED.COM, LLC | Video image data processing in electronic devices |
6658196, | Nov 05 1997 | Sony Corporation | Editing technique merging video signals recorded on the same optical disk |
6804300, | Dec 27 1999 | Kabushiki Kaisha Toshiba | Television audiovisual, recording and reproducing apparatus using personal computer, method of supplying power to PC card, and PC card |
6839801, | Jan 06 2003 | International Business Machines Corporation | Deferred writing of data to be synchronized on magnetic tape employing a non-volatile store |
6909874, | Apr 12 2000 | GVBB HOLDINGS S A R L | Interactive tutorial method, system, and computer program product for real time media production |
6952221, | Dec 18 1998 | THOMSON LICENSING S A | System and method for real time video production and distribution |
7024677, | Dec 18 1998 | Thomson Licensing | System and method for real time video production and multicasting |
7266636, | Jan 06 2003 | International Business Machines Corporation | Deferred writing of data to be synchronized on magnetic tape employing a non-volatile store |
7302644, | Dec 18 1998 | Thomson Licensing | Real time production system and method |
7386218, | Apr 17 2002 | Dell Products L.P.; Dell Products L P | Method and apparatus for automatic video CD authoring |
7437053, | Jan 15 2003 | Panasonic Corporation | Digital video recorder, method of driving the video recorder and program |
7830413, | Feb 23 1995 | CERBERUS BUSINESS FINANCE, LLC, AS COLLATERAL AGENT | Combined editing system and digital moving picture recording system |
7830967, | Dec 28 2007 | RED COM, LLC | Video camera |
7835920, | Dec 18 1998 | MAGNOLIA LICENSING LLC | Director interface for production automation control |
8006184, | Dec 18 1998 | THOMSON LICENSING S A | Playlist for real time video production |
8174560, | Apr 11 2007 | RED COM, LLC | Video camera |
8204750, | Feb 14 2005 | THOMAS MAJCHROWSKI & ASSOCIATES, INC | Multipurpose media players |
8237830, | Apr 11 2007 | RED COM, LLC | Video camera |
8358357, | Apr 11 2007 | RED COM, LLC | Video camera |
8560951, | Dec 18 1998 | PARKER VISION, INC | System and method for real time video production and distribution |
8577683, | Aug 15 2008 | Thomas Majchrowski & Associates, Inc. | Multipurpose media players |
8819087, | Feb 12 2005 | Thomas Majchrowski & Associates, Inc. | Methods and apparatuses for assisting the production of media works and the like |
8872933, | Apr 11 2007 | RED COM, LLC | Video camera |
8878952, | Apr 11 2007 | RED COM, LLC | Video camera |
9019393, | Apr 11 2007 | RED COM, LLC | Video processing system and method |
9123380, | May 09 2002 | GRASS VALLEY CANADA | Systems, methods, and computer program products for automated real-time execution of live inserts of repurposed stored content distribution, and multiple aspect ratio automated simulcast production |
9230299, | Apr 11 2007 | RED COM, LLC | Video camera |
9245314, | Apr 11 2007 | RED COM, LLC | Video camera |
9436976, | Apr 11 2007 | RED COM, LLC | Video camera |
9521384, | Feb 14 2013 | RED COM, LLC | Green average subtraction in image data |
9558786, | May 09 2002 | GRASS VALLEY CANADA | Systems, methods, and computer program products for multiple aspect ratio automated simulcast production |
9596385, | Apr 11 2007 | RED COM, LLC | Electronic apparatus |
9711180, | May 09 2002 | GRASS VALLEY CANADA | Systems, methods, and computer program products for automated real-time execution of live inserts of repurposed stored content distribution |
9716866, | Feb 14 2013 | RED COM, LLC | Green image data processing |
9787878, | Apr 11 2007 | RED COM, LLC | Video camera |
9792672, | Apr 11 2007 | RED COM, LLC | Video capture devices and methods |
9864478, | Feb 14 2005 | Thomas Majchrowski & Associates, Inc. | Multipurpose media players |
RE41968, | Apr 21 1993 | Multi-Format, Inc. | Dual compression format digital video production system |
RE42020, | Apr 21 1993 | Multi-Format, Inc. | Dual compression format digital video production system |
RE42160, | Apr 21 1993 | Multi-Format, Inc. | Dual compression format digital video production system |
Patent | Priority | Assignee | Title |
5164839, | Dec 27 1988 | BURST COM, INC | Method for handling audio/video source information |
5218672, | Jan 19 1990 | Sony Electronics INC | Offline editing system with user interface for controlling edit list generation |
5459582, | Dec 04 1989 | Canon Kabushiki Kaisha | Video signal processing system for taking into a memory a specified picture extracted from moving images |
5572499, | Apr 10 1991 | Canon Kabushiki Kaisha | Image processing apparatus for storing image data in storage medium and/or for reproducing image stored in storage medium |
5649046, | Dec 07 1992 | Quantel Limited | Video processing system with random access framestore for video editing |
JP358044856A, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 30 1998 | Multi-Format, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Jul 14 2003 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Jul 27 2007 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Aug 28 2004 | 4 years fee payment window open |
Feb 28 2005 | 6 months grace period start (w surcharge) |
Aug 28 2005 | patent expiry (for year 4) |
Aug 28 2007 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 28 2008 | 8 years fee payment window open |
Feb 28 2009 | 6 months grace period start (w surcharge) |
Aug 28 2009 | patent expiry (for year 8) |
Aug 28 2011 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 28 2012 | 12 years fee payment window open |
Feb 28 2013 | 6 months grace period start (w surcharge) |
Aug 28 2013 | patent expiry (for year 12) |
Aug 28 2015 | 2 years to revive unintentionally abandoned end. (for year 12) |