A medical signal processing device processes an image signal received in accordance with a result of examining inside of a subject. The image signal includes pixel data groups that are data of respective pixels different from each other and received by the medical signal processing device in parallel. The medical signal processing device includes a distribution processing unit configured to generate distributed image signals by distributing the pixel data groups, and the distribution processing unit distributes the pixel data groups such that, among the pixel data groups, pieces of data at bit positions of most significant digits of the pixel data groups of pixels adjacent to each other are included in the respective distributed image signals different from each other. The distributed image signals are transmitted to an external medical control device through respective signal transmission paths.
|
1. A medical signal processing device, comprising:
processing circuitry including hardware and configured to
receive an image signal, wherein the image signal includes a plurality of pixel data groups of respective pixels arrayed at a constant interval among pixels sequentially arrayed in a predetermined direction in an image made of pixels arrayed in a matrix, wherein the pixel data groups are data of respective pixels different from each other, and wherein the pixel data groups are received in parallel,
generate a plurality of distributed image signals by distributing the pixel data groups,
distribute the pixel data groups such that, among the pixel data groups, pieces of data at bit positions of most significant digits of the pixel data groups of pixels adjacent to each other are included in the respective distributed image signals different from each other, and
control transmission of the distributed image signals to an external medical control device through a plurality of respective signal transmission paths.
5. A medical observation system comprising:
a medical signal processing device including processing circuitry including hardware and configured to receive an image signal, wherein the image signal includes a plurality of pixel data groups of respective pixels arrayed at a constant interval among pixels sequentially arrayed in a predetermined direction in an image made of pixels arrayed in a matrix, wherein the pixel data groups are data of respective pixels different from each other, and wherein the pixel data groups are received in parallel, to generate a plurality of distributed image signals by distributing the pixel data groups, to distribute the pixel data groups such that, among the pixel data groups, pieces of data at bit positions of most significant digits of the pixel data groups of pixels adjacent to each other are included in the respective distributed image signals different from each other, and control transmission of the distributed image signals to an external medical control device through a plurality of respective signal transmission paths;
a plurality of signal transmission paths through which the respective distributed image signals transmitted from the medical signal processing device are transmitted; and
a medical control device including second processing circuitry including hardware and configured to receive the distributed image signals through the signal transmission paths and restore the image signal based on the distributed image signals.
2. The medical signal processing device according to
3. The medical signal processing device according to
4. The medical signal processing device according to
6. The medical observation system according to
detect a signal transmission failure in the signal transmission paths,
give notification of predetermined information, and
give notification of the predetermined information when a transmission failure is detected.
7. The medical observation system according to
the signal transmission paths each include a light transmission path through which an optical signal is transmitted, and
the medical observation system includes:
an electrical-optical conversion circuitry configured to convert a plurality of electric signals based on the distributed image signals into a plurality of respective optical signals, and output the optical signals to the respective signal transmission paths, and
an optical-electrical conversion circuitry configured to convert the optical signals received through the signal transmission paths into a plurality of respective electric signals, and output the electric signals to the medical control device.
|
The present application claims priority to and incorporates by reference the entire contents of Japanese Patent Application No. 2016-006644 filed in Japan on Jan. 15, 2016.
The present disclosure relates to a medical signal processing device.
Medical observation systems in the medical field are configured to capture an image of the inside of a subject such as a human (inside of a living body) to observe the inside of this living body (for example, refer to Japanese Patent Laid-open No. 2009-61032 and Japanese Patent Laid-open No. 2006-26134).
Medical observation systems disclosed in Japanese Patent Laid-open No. 2009-61032 and Japanese Patent Laid-open No. 2006-26134 (“electronic endoscope systems” in Japanese Patent Laid-open No. 2009-61032 and Japanese Patent Laid-open No. 2006-26134) each include a medical observation device (“electronic endoscope” in Japanese Patent Laid-open No. 2009-61032 and Japanese Patent Laid-open No. 2006-26134) configured to capture an image of the inside of a living body and output an image signal, a control device (“video processor” in Japanese Patent Laid-open No. 2009-61032 and “processor” in Japanese Patent Laid-open No. 2006-26134) configured to receive the image signal from the medical observation device and process the image signal to generate a display image signal, and a signal transmission path (“wireless connector” in Japanese Patent Laid-open No. 2009-61032 and “signal line” in Japanese Patent Laid-open No. 2006-26134) through which the image signal from the medical observation device is transmitted to the control device.
When a failure occurs in transmission of the image signal due to, for example, breaking of the signal transmission path, the control device is unable to appropriately generate the display image signal and display an image suitable for observation.
In the medical observation system disclosed in Japanese Patent Laid-open No. 2009-61032, when a signal transmission state in the signal transmission path is detected and the detected transmission state is inappropriate for transmission, an operator is warned or notified by, for example, a buzzer. However, in the medical observation system disclosed in Japanese Patent Laid-open No. 2009-61032, an image suitable for observation may not be displayed until the signal transmission path is replaced by, for example, the operator in response to this warning or notification.
The medical observation system disclosed in Japanese Patent Laid-open No. 2006-26134 is provided with at least two signal transmission paths through which an identical image signal is transmitted. With this configuration, in the medical observation system disclosed in Japanese Patent Laid-open No. 2006-26134, when a transmission failure occurs in one of the signal transmission paths, the image signal may be transmitted to the control device through the other signal transmission path, which achieves continuous display of an image suitable for observation. However, one of the signal transmission paths is unnecessary when no transmission failure occurs. In other words, in the medical observation system disclosed in Japanese Patent Laid-open No. 2006-26134, the above-described signal transmission path needs to be redundantly provided, which prevents simplification of the structure.
It has been desired to achieve a technique of performing, with a simplified structure, continuous display of an image suitable for observation when a transmission failure occurs in a signal transmission path.
There is a need for a medical signal processing device and a medical observation system capable of performing, with a simplified structure, continuous display of an image suitable for observation when a transmission failure occurs in a signal transmission path.
A medical signal processing device according to one aspect of the present disclosure receives an image signal in accordance with a result of examining inside of a subject and processes the image signal. The image signal includes a plurality of pixel data groups of respective pixels arrayed at a constant interval among pixels sequentially arrayed in a predetermined direction in an image made of pixels arrayed in a matrix, the pixel data groups are data of respective pixels different from each other, the pixel data groups are received by the medical signal processing device in parallel, the medical signal processing device includes a distribution processing unit configured to generate a plurality of distributed image signals by distributing the pixel data groups, the distribution processing unit distributes the pixel data groups such that, among the pixel data groups, pieces of data at bit positions of most significant digits of the pixel data groups of pixels adjacent to each other are included in the respective distributed image signals different from each other, and the distributed image signals are transmitted to an external medical control device through a plurality of respective signal transmission paths.
Configurations to achieve the present disclosure (hereinafter referred to as embodiments) will be described below with reference to the accompanying drawings. The embodiments described below, however, are not intended to limit the present disclosure. In description of the drawings, any identical parts are denoted by an identical reference numeral.
First Embodiment
Schematic Configuration of Medical Observation System
The medical observation system 1 is used in the medical field to observe the inside of a subject such as a human (inside of a living body). As illustrated in
The endoscope 2 examines the inside of the living body and outputs an image signal (a plurality of transmission image signals) in accordance with a result of this examination. As illustrated in
The insertion unit 21 is hard or at least partially soft, has an elongated shape, and is inserted into the inside of the living body. The insertion unit 21 includes an optical system that includes one or a plurality of lenses and through which an object image is condensed.
The light source device 3 is connected with one end of the light guide 8, and supplies, under control of the control device 6, this one end of the light guide 8 with light for illumination of the inside of the living body.
The light guide 8 has one end detachably connected with the light source device 3 and the other end detachably connected with the insertion unit 21. The light guide 8 transfers the light supplied by the light source device 3 from the one end to the other end to supply the light to the insertion unit 21. The light supplied to the insertion unit 21 is emitted from a leading end of the insertion unit 21 and incident on the inside of the living body. The light (object image) incident on the inside of the living body is condensed through the optical system in the insertion unit 21.
The camera head 22 is detachably connected with a base end of the insertion unit 21. The camera head 22 captures, under control of the control device 6, the object image condensed through the insertion unit 21 and generates an image capturing signal (image signal). The camera head 22 also generates a plurality of transmission image signals from this image signal and outputs these transmission image signals. In the first embodiment, the camera head 22 converts these transmission image signals into optical signals and outputs these transmission image signals as the optical signals.
The configuration of the camera head 22 will described later in detail.
The first transmission cable 23 has one end detachably connected with the control device 6 through a connector CN1 (
The electric wires 231 are electric wires for transmitting, for example, a control signal, a synchronizing signal, a clock, and electrical power output from the control device 6 to the camera head 22. In
The optical fibers 232 are optical fibers for transmitting, to the control device 6, the transmission image signals (optical signals) output from the camera head 22. In the first embodiment, the four optical fibers 232 of first to fourth optical fibers 2321 to 2324 (refer to
The optical fibers 232 included in the first transmission cable 23 each function as a signal transmission path according to the present disclosure.
The display device 4 includes a display exploiting, for example, liquid crystal or organic electro luminescence (EL), and displays an image based on image signals processed at the control device 6.
The second transmission cable 5 has one end detachably connected with the display device 4 and the other end detachably connected with the control device 6. The second transmission cable 5 transmits image signals processed at the control device 6 to the display device 4.
The control device 6 includes, for example, a central processing unit (CPU) and performs overall control of operation of the light source device 3, the camera head 22, and the display device 4.
The configuration of the control device 6 will be described later in detail.
The third transmission cable 7 has one end detachably connected with the light source device 3 and the other end detachably connected with the control device 6. The third transmission cable 7 transmits, to the light source device 3, a control signal from the control device 6.
Configuration of Camera Head
The following describes the configuration of the camera head 22.
For the purpose of description,
As illustrated in
The lens unit 221 includes one or a plurality of lenses movable along an optical axis and images the object image condensed through the insertion unit 21 onto an imaging plane of the imaging unit 223 (an image sensor 2231 (refer to
The drive unit 222 operates, under control of the control device 6, the optical zoom mechanism and the focus mechanism described above to change the angle of view and the focus of the lens unit 221.
The imaging unit 223 images the inside of the living body under control of the control device 6. The imaging unit 223 includes a sensor chip on which, for example, the image sensor 2231 (refer to
Further in the first embodiment, the imaging unit 223 outputs the image signal after the A/D conversion through 10 channels (first to tenth channels CA to CJ (
The image signal from the imaging unit 223 according to the first embodiment may be output as differential signals for the respective channels. In this case, for example, the signal processing unit (not illustrated) described above may be provided with a differential conversion unit (not illustrated) configured to convert the image signal after the A/D conversion into differential signals, and the transmission signal processing unit 224 to be described later may be provided with a restoring unit (not illustrated) configured to restore the differential signals to the original image signal.
The number of bits per pixel in the image signal output from the imaging unit 223 is 10 in the first embodiment, but may be any other number.
In
In the first embodiment, as illustrated in
In the pieces of pixel data vertically arranged in
Specifically, the imaging unit 223 outputs, in parallel through the first to the tenth channels CA to CJ as described above, pieces of pixel data (serial data) generated at 10 pixels each in an order of the address number.
In the first embodiment, as illustrated in
Although not illustrated in
Each image signal output in parallel through the first to the tenth channels CA to CJ described above corresponds to a pixel data group according to the present disclosure.
In
The transmission signal processing unit 224 functions as a medical signal processing device according to the present disclosure and executes, on the image signal (in 10 bits through 10 channels) from the imaging unit 223, various kinds of processing such as S/P conversion processing, transmission image signal generation processing (mapping processing and auxiliary data addition processing), encoding processing (N bit/M (>N) bit conversion processing (in the first embodiment, 8 bits/10 bits conversion processing)), and P/S conversion processing. As illustrated in
The S/P conversion unit 226 executes the S/P conversion processing on the image signal (serial data in 10 bits through 10 channels) output from the imaging unit 223 and converts the image signal into parallel data.
Numbers (“0” to “4249”) illustrated in
Specifically, as illustrated in (a) in
In the first embodiment, address numbers of “0” to “4249” are provided and thus the number of pixels in the effective image region of the image sensor 2231 is 4250, but the present disclosure is not limited thereto. The number of pixels in the effective image region of an image sensor in use may be changed to any other number as appropriate.
The signal processing unit 227 generates a plurality of transmission image signals by executing the transmission signal generation processing (the mapping processing and the auxiliary data addition processing) on the first to the tenth image signals FS1 to FS10 (parallel data) generated at the S/P conversion unit 226.
In the first embodiment, as illustrated in
As illustrated in
The distribution processing unit 2271 generates four of first to fourth distributed image signals DS1 to DS4 by distributing (executing the mapping processing on) the first to the tenth image signals FS1 to FS10 (parallel data) generated at the S/P conversion unit 226.
In the first embodiment, the distribution processing unit 2271 distributes the first to the tenth image signals FS1 to FS10 such that, among the first to the tenth image signals FS1 to FS10, pieces of data of MSBs of the image signals of pixels adjacent to each other are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4. The distribution processing unit 2271 distributes the first to the tenth image signals FS1 to FS10 such that among the first to the tenth image signals FS1 to FS10, pieces of data at the bit positions of the second MSBs (in the first embodiment, bit position “8”) of the image signals of pixels adjacent to each other are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4. In addition, the distribution processing unit 2271 distributes the first to the tenth image signals FS1 to FS10 such that, among the first to the tenth image signals FS1 to FS10, data of the MSB of one of the image signals of pixels adjacent to each other and data at the bit position of the second MSB of the other image signal are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4. The distribution processing unit 2271 also distributes the first to the tenth image signals FS1 to FS10 such that data of the MSB of pixel data generated at each pixel and data at the bit position of the second MSB of this pixel data are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4.
The following describes the first to the fourth distributed image signals DS1 to DS4 generated at the distribution processing unit 2271 with reference to the bit string of word WD illustrated in
In (a) to (d) in
Among the first to the tenth image signals FS1 to FS10, image signals of pixels adjacent to each other and image signals of pixels separate from each other exemplarily include image signals described below.
For example, the first image signal FS1 includes pieces of pixel data generated at pixels of address numbers “0”, “10”, “20”, . . . . The second image signal FS2 includes pieces of pixel data generated at pixels of address numbers “1”, “11”, “21”, . . . . Thus, the first and the second image signals FS1 and FS2 are image signals of pixels (address numbers) adjacent to each other. The fifth image signal FS5 includes pieces of pixel data generated at pixels of address numbers “4”, “14”, “24”, . . . . Thus, the first and the fifth image signals FS1 and FS5 are image signals of pixels (address numbers) separate from each other.
Then, as described above, the distribution processing unit 2271 distributes the first to the tenth image signals FS1 to FS10 such that pieces of data of MSBs of the image signals of pixels adjacent to each other are included in distributed image signals different from each other. As a result, as illustrated in (a) in
As described above, the distribution processing unit 2271 distributes the first to the tenth image signals FS1 to FS10 such that pieces of data at bit positions “8” of image signals of pixels adjacent to each other are included in distributed image signals different from each other, data of the MSB of one of the image signals of pixels adjacent to each other and data at bit position “8” of the other image signal are included in distributed image signals different from each other, and data of the MSB and data at bit position “8” of pixel data generated at an identical pixel are included in distributed image signals different from each other. As a result, as illustrated in (a) in
Pieces of data at bit positions “7” to “0” may be distributed such that the pieces are included randomly in the first to the fourth distributed image signals DS1 to DS4. Alternatively, the pieces may be distributed such that the pieces are included in a distributed image signal including data of bit position “8” of pixel data generated at this pixel as illustrated in
In the distribution as illustrated in
In
The data addition unit 2272 generates the first to the fourth transmission image signals TS1 to TS4 by adding auxiliary data to (executing the auxiliary data addition processing on) each of the four of the first to the fourth distributed image signals DS1 to DS4 to enable execution of the 8 bits/10 bits conversion processing at a later stage.
In the first embodiment, the data addition unit 2272 adds auxiliary data of 11 bits per word to each of the first and the second distributed image signals DS1 and DS2 (21 bits). The data addition unit 2272 adds auxiliary data of 3 bits per word to each of the third and the fourth distributed image signals DS3 and DS4 (29 bits).
The auxiliary data added to the first to the fourth distributed image signals DS1 to DS4 may be any data that allows execution of the 8 bits/10 bits conversion processing at a later stage.
The drivers 228 are provided in accordance with the number of transmission image signals generated at the signal processing unit 227. Specifically, in the first embodiment, as illustrated in
The transmission signal processing unit 224 described above is achieved by a programmable logic device such as a field-programmable gate array (FPGA).
The electrical-optical conversion unit 225 converts the first to the fourth transmission image signals TS1 to TS4 (serial data) output from the transmission signal processing unit 224 (the four of the first to the fourth drivers 2281 to 2284) into optical signals, and outputs the optical signals to the first transmission cable 23 (the first to the fourth optical fibers 2321 to 2324). Then, the first to the fourth optical fibers 2321 to 2324 transmit the first to the fourth transmission image signals TS1 to TS4 to the control device 6.
Configuration of Control Device
The following describes the configuration of the control device 6 with reference to
As illustrated in
The optical-electrical conversion unit 61 converts the four optical signals (the four of the first to the fourth transmission image signals TS1 to TS4) received through the first to the fourth optical fibers 2321 to 2324 into electric signals (serial data).
The received signal processing unit 62 functions as a medical control device according to the present disclosure and executes, on the four pieces of serial data (the four of the first to the fourth transmission image signals TS1 to TS4) output from the optical-electrical conversion unit 61, various kinds of processing such as transmission failure detection processing, the S/P conversion processing, decoding processing (M bit/N (<M) bit conversion processing (in the first embodiment, 10 bits/8 bits conversion processing)), mapping decoding processing, and the P/S conversion processing. As illustrated in
The signal detection units 621 are provided in accordance with the number of optical fibers 232 (the first to the fourth transmission image signals TS1 to TS4) included in the first transmission cable 23. Specifically, in the first embodiment, the four signal detection units 621 are provided. Hereinafter, the signal detection units 621 corresponding to the first to the fourth transmission image signals TS1 to TS4 are referred to as first to fourth signal detection units 6211 to 6214, respectively (
As illustrated in
The CDR unit 624 executes CDR processing that recovers the superimposed clock signal from the first transmission image signal TS1 (serial data) input to the optical-electrical conversion unit 61 through the optical fiber 232 (first optical fiber 2321) and converted at the optical-electrical conversion unit 61. Then, when the execution of the CDR processing is successful (the recovery of the superimposed clock signal is successful), the CDR unit 624 outputs processing execution information indicating the successful execution to the transmission failure detection unit 622. When the execution of the CDR processing is failed, the CDR unit 624 outputs, to the transmission failure detection unit 622, failed execution information indicating the failure, and identification information for identifying the optical fiber 232 (first optical fiber 2321) corresponding to the CDR unit 624.
The S/P conversion unit 625 executes the S/P conversion processing on the first transmission image signal TS1 (serial data) after the CDR processing to convert the signal into parallel data.
The K code detection unit 626 detects the K code from the first transmission image signal TS1 (parallel data) after the S/P conversion processing at the S/P conversion unit 625 to perform timing detection of data, and executes K code detection processing that acquires the effective data from the first transmission image signal TS1 (parallel data). Then, when the execution of the K code detection processing is successful (the acquisition of the effective data is successful), the K code detection unit 626 outputs processing execution information indicating the successful execution to the transmission failure detection unit 622. When the execution of the K code detection processing is failed, the K code detection unit 626 outputs, to the transmission failure detection unit 622, failed execution information indicating the failure, and identification information for identifying the optical fiber 232 (first optical fiber 2321) corresponding to the K code detection unit 626.
In the first embodiment, the K code detection unit 626 is employed, but the present disclosure is not limited thereto. When information other than the K code is inserted into the first to the fourth transmission image signals TS1 to TS4 by the camera head 22, a component having a function of detecting this information (component that outputs, to the transmission failure detection unit 622, for example, whether this information may be detected) may be employed.
The decoding unit 627 executes the decoding processing (in the first embodiment, 10 bits/8 bits conversion processing) on the first transmission image signal TS1 (effective data (parallel data) acquired at the K code detection unit 626) after the K code detection processing at the K code detection unit 626.
The transmission failure detection unit 622 detects any failure of transmission of optical signals through the first to the fourth optical fibers 2321 to 2324 based on the information output from the first to the fourth signal detection units 6211 to 6214 (the CDR unit 624 and the K code detection unit 626), and specifies an optical fiber in which a transmission failure has occurred.
Specifically, the first to the fourth signal detection units 6211 to 6214 and the transmission failure detection unit 622 execute the transmission failure detection processing to detect any failure of transmission of optical signals through the first to the fourth optical fibers 2321 to 2324, and specifies an optical fiber in which the transmission failure has occurred.
Then, the transmission failure detection unit 622 outputs transmission failure information (information indicating whether a transmission failure has occurred, and when a transmission failure occurs, an optical fiber in which this transmission failure has occurred) to the control unit 65.
The signal restoring unit 623 restores image signals (the first to the tenth image signals FS1 to FS10 (parallel data)) before the mapping processing at the camera head 22 by executing the mapping decoding processing on the first to the fourth transmission image signals TS1 to TS4 (parallel data) after the decoding processing at the decoding units 627 in the first to the fourth signal detection units 6211 to 6214.
Specifically, the signal restoring unit 623 extracts the first to the fourth distributed image signals DS1 to DS4 from the first to the fourth transmission image signals TS1 to TS4 after the decoding processing at the decoding units 627 in the first to the fourth signal detection units 6211 to 6214, respectively. Then, the signal restoring unit 623 restores image signals (the first to the tenth image signals FS1 to FS10) before the mapping processing at the camera head 22 by executing the inverse processing (mapping decoding processing) of the mapping processing at the camera head 22 on these extracted first to fourth distributed image signals DS1 to DS4.
Similarly to the transmission signal processing unit 224, the received signal processing unit 62 described above is achieved by a programmable logic device such as an FPGA.
The image processing unit 63 executes, on an image signal (serial data) restored at the received signal processing unit 62, various kinds of image processing such as development processing (demosaic processing), noise reduction, color correction, color enhancement, and outline enhancement.
The display control unit 64 generates a display image signal from the image signal (serial data) after the various kinds of image processing at the image processing unit 63, and outputs the display image signal to the display device 4 through the second transmission cable 5. Then, the display device 4 displays an image (hereinafter referred to as an observation image) based on this display image signal. When a transmission failure is detected by the transmission failure detection unit 622, the display control unit 64 generates an image signal for displaying, on the display device 4, a superimposed image obtained by superimposing, on the observation image, a message indicating the occurrence of the transmission failure and a message indicating an optical fiber in which the transmission failure has occurred, and outputs the image signal to the display device 4 through the second transmission cable 5. Then, the display device 4 displays the superimposed image (image in which the messages are superimposed on the observation image) based on this image signal.
In other words, the display device 4 functions as a notification unit according to the present disclosure. The display control unit 64 functions as a notification control unit according to the present disclosure.
The control unit 65 includes, for example, a CPU, and controls operation of the light source device 3, the drive unit 222, the imaging unit 223, and the transmission signal processing unit 224, and operation of the entire control device 6 by outputting a control signal through the third transmission cable 7 and the electric wires 231.
The input unit 66 includes, for example, an operation device such as a mouse, a keyboard, or a touch panel to receive an operation by a user.
The output unit 67 includes, for example, a speaker or a printer to output various kinds of information. When a transmission failure is detected by the transmission failure detection unit 622, the output unit 67 outputs sound indicating the occurrence of the transmission failure, and sound indicating an optical fiber in which this transmission failure has occurred.
In other words, the output unit 67 functions as the notification unit according to the present disclosure. The control unit 65 functions as the notification control unit according to the present disclosure.
The notification unit according to the present disclosure is not limited to the display device 4 and the output unit 67, but may be, for example, an LED that gives notification of predetermined information by lighting or flashing.
The medical observation system 1 according to the first embodiment described above achieves an effect described below.
In
Specifically, in 10-bit pixel data, as illustrated in
In the medical observation system 1 according to the first embodiment, the first to the tenth image signals FS1 to FS10 are distributed into the first to the fourth distributed image signals DS1 to DS4 such that, among the first to the tenth image signals FS1 to FS10, pieces of data of MSBs of the image signals of pixels adjacent to each other are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4. In the medical observation system 1, the first to the tenth image signals FS1 to FS10 are distributed into the first to the fourth distributed image signals DS1 to DS4 such that, among the first to the tenth image signals FS1 to FS10, pieces of data at bit positions “8”, which are the second MSBs, of the image signals of pixels adjacent to each other are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4. In the medical observation system 1, the first to the tenth image signals FS1 to FS10 are distributed into the first to the fourth distributed image signals DS1 to DS4 such that, among the first to the tenth image signals FS1 to FS10, data of the MSB of one of the image signals of pixels adjacent to each other and data at bit position “8” of the other image signal are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4. In the medical observation system 1, the first to the tenth image signals FS1 to FS10 are distributed into the first to the fourth distributed image signals DS1 to DS4 such that data of the MSB of pixel data generated at each pixel and data at bit position “8” of the pixel data are included in respective distributed image signals different from each other among the first to the fourth distributed image signals DS1 to DS4.
As a result, the first distributed image signal DS1 includes data of the MSBs of the first image signal FS1 including pieces of pixel data generated at pixels of address numbers “0”, “10”, “20”, . . . , the fifth image signal FS5 including pieces of pixel data generated at pixels of address numbers “4”, “14”, “24”, . . . , and the ninth image signal FS9 including pieces of pixel data generated at pixels of address numbers “8”, “18”, “28”, . . . , and pieces of data at bit positions “8” of the third image signal FS3 including pieces of pixel data generated at pixels of address numbers “2”, “12”, “22”, . . . , and the seventh image signal FS7 including pieces of pixel data generated at pixels of address numbers “6”, “16”, “26”,
Thus, when a transmission failure occurs in the first optical fiber 2321, as illustrated in
The second distributed image signal DS2 includes data of the MSBs of the second image signal FS2 including pieces of pixel data generated at pixels of address numbers “1”, “11”, “21”, . . . , the sixth image signal FS6 including pieces of pixel data generated at pixels of address numbers “5”, “15”, “25”, . . . , and the tenth image signal FS10 including pieces of pixel data generated at pixels of address numbers “9”, “19”, “29”, . . . , and pieces of data at bit positions “8” of the fourth image signal FS4 including pieces of pixel data generated at pixels of address numbers “3”, “13”, “23”, . . . , and the eighth image signal FS8 including pieces of pixel data generated at pixels of address numbers “7”, “17”, “27”, . . . .
Thus, when a transmission failure occurs in the second optical fiber 2322, as illustrated in
In other words, the first to the tenth image signals FS1 to FS10 are distributed such that data of the MSB and data at bit position “8” of pixel data generated at an identical pixel are included in distributed image signals different from each other. With this configuration, when a transmission failure occurs in any of the first to the fourth optical fibers 2321 to 2324 and data of one of the MSB and bit position “8” of each pixel data included in a distributed image signal corresponding to the optical fiber in which this transmission failure has occurred is lost, the loss may be compensated with data of the other of the MSB and bit position “8” of each pixel data included in a distributed image signal transmitted through an optical fiber in which no transmission failure has occurred. In other words, a transmission failure in any of the first to the fourth optical fibers 2321 to 2324 only causes the reduction in the luminance value but not losses of images at pixels on the hatched vertical lines in
In addition, the first to the tenth image signals FS1 to FS10 are distributed such that, among the first to the tenth image signals FS1 to FS10, pieces of data of MSBs of the image signals of pixels adjacent to each other are included in distributed image signals different from each other, pieces of data at bit positions “8” of these image signals are included in distributed image signals different from each other, and data of the MSB of one of these image signals and data of bit position “8” of the other image signal are included in distributed image signals different from each other. With this configuration, as illustrated in
Thus, the observation images FG1 and FG2 suitable for observation may be displayed when a transmission failure occurs in any of the first to the fourth optical fibers 2321 to 2324.
At least two signal transmission paths through which an identical image signal is transmitted are not included in the medical observation system 1 according to the first embodiment, thereby achieving a simplified structure without a redundant signal transmission path that is unnecessary when no transmission failure occurs.
In the medical observation system 1 according to the first embodiment, when a transmission failure is detected, notification of predetermined information (information indicating the occurrence of the transmission failure and an optical fiber in which the transmission failure has occurred) is given through the display device 4 and the output unit 67.
This configuration allows a user such as a doctor to recognize the occurrence of the transmission failure in any of the first to the fourth optical fibers 2321 to 2324. This may also suggest, to this user, replacement of the optical fiber in which the transmission failure has occurred.
In the first embodiment described above, the electrical-optical conversion unit 225 is provided to the camera head 22, but the present disclosure is not limited thereto. For example, the electrical-optical conversion unit 225 may be provided to the first transmission cable 23 including the connector CN2. Moreover, at least part or all of the internal configuration (function) of the transmission signal processing unit 224 as the medical signal processing device according to the present disclosure may be provided to the first transmission cable 23 including the connector CN2. In this case, an electric signal is output from the camera head 22, converted into an optical signal at the electrical-optical conversion unit 225 provided to the first transmission cable 23, and transmitted as a transmission image signal through the optical fibers 232 (signal transmission paths).
Second Embodiment
The following describes a second embodiment of the present disclosure.
In the following description, any component identical to that in the first embodiment described above is denoted by an identical reference sign, and detailed description thereof will be omitted or simplified.
In the medical observation system 1 according to the first embodiment described above, the present disclosure is applied to the endoscope 2 including the camera head 22.
In a medical observation system according to the second embodiment, however, the present disclosure is applied to what is called a video scope including an imaging unit at a leading end of an insertion unit of an endoscope.
As illustrated in
As illustrated in
As illustrated in
Although not illustrated in detail, built-in components similar to the transmission signal processing unit 224 and the electrical-optical conversion unit 225 described in the first embodiment above are included inside the operation unit 22A. The image signal generated at the imaging unit described above is processed at this transmission signal processing unit. The universal code 23A has a configuration substantially same as the first transmission cable 23 described in the first embodiment above. Then, a plurality of transmission image signals (optical signals) processed (generated) inside the operation unit 22A (the transmission signal processing unit and the electrical-optical conversion unit) are output to the control device 6 through the universal code 23A.
When a soft endoscope (the endoscope 2A) is used as in the second embodiment described above, the same effect as that of the first embodiment described above is achieved.
Third Embodiment
The following describes a third embodiment of the present disclosure.
In the following description, any component identical to that in the first embodiment described above is denoted by an identical reference sign, and detailed description thereof will be omitted or simplified.
In the medical observation system 1 according to the first embodiment described above, the present disclosure is applied to the endoscope 2 including the camera head 22.
In a medical observation system according to the third embodiment, however, the present disclosure is applied to a surgical microscope configured to capture an enlarged image of a predetermined viewing region in the inside of a subject (the inside of a living body) or on the surface of the subject (the surface of the living body).
As illustrated in
As illustrated in
As illustrated in
Instead of being provide movable on the floor surface, the base unit 25 may be fixed on, for example, a ceiling or a wall surface to support the support unit 24. The base unit 25 may include a light source unit configured to generate illumination light to be emitted to the object from the surgical microscope 2B.
Although not illustrated in detail specific, the microscope unit 22B includes an imaging unit configured to generate an image signal by capturing an image of the inside of the living body, and built-in components similar to the transmission signal processing unit 224 and the electrical-optical conversion unit 225 described in the first embodiment above. The image signal generated at the imaging unit is processed at the transmission signal processing unit. Then, a plurality of transmission image signals (optical signals) processed (generated) at the microscope unit 22B (the transmission signal processing unit and the electrical-optical conversion unit) are output to the control device 6 through the first transmission cable 23 wired along the support unit 24.
When the surgical microscope 2B is used as in the third embodiment described above, the same effect as that of the first embodiment described above is achieved.
Other Embodiments
The configurations to achieve the present disclosure are described above, but the present disclosure is not limited to the first to the third embodiments described above.
In the first to the third embodiments described above, a plurality of transmission image signals are transmitted as optical signals from the camera head 22, the operation unit 22A, and the microscope unit 22A to the control device 6, but the present disclosure is not limited thereto. The transmission image signals may be transmitted as electric signals. In other words, the optical fibers 232 as signal transmission paths according to the present disclosure included in the first transmission cable 23 and the universal code 23A may be replaced with electric wires. In this case, the electrical-optical conversion unit 225 and the optical-electrical conversion unit 61 are omitted.
In the transmission signal processing unit 224 according to the first to the third embodiments described above, the auxiliary data addition processing is executed after the mapping processing, but the present disclosure is not limited thereto. The mapping processing may be executed after the auxiliary data addition processing (in which auxiliary data is added to the first to the tenth image signals FS1 to FS10, and the first to the fourth transmission image signals TS1 to TS4 are generated by distributing the first to the tenth image signals FS1 to FS10 to which this auxiliary data is added).
In the first to the third embodiments described above, the scheme of distribution of the first to the tenth image signals FS1 to FS10 to generate the first to the fourth distributed image signals DS1 to DS4 is not limited to the distribution schemes described in the first to the third embodiments above. Any other distribution scheme may be employed as long as, among the first to the tenth image signals FS1 to FS10, pieces of data of MSBs of the image signals of pixels adjacent to each other are included in distributed image signals different from each other through the scheme.
A medical signal processing device according to the present disclosure generates a plurality of distributed image signals by distributing a plurality of pixel data groups received by the medical signal processing device in parallel such that, among the pixel data groups, pieces of data at the bit positions of the most significant digits of the pixel data groups of pixels adjacent to each other are included in the respective distributed image signals different from each other. Then, the distributed image signals are transmitted to an external medical control device through a plurality of respective signal transmission paths.
A transmission failure that has occurred in any of the signal transmission paths results in a loss of a distributed image signal corresponding to the signal transmission path in which this transmission failure has occurred. The distributed image signals generated at the medical signal processing device according to the present disclosure include one of pieces of data at the bit positions of the most significant digits of the pixel data groups of pixels adjacent to each other, but do not include the other piece of data. In pixel data, the amount of data at the bit position of the most significant digit is larger than the amount of data at any other bit position, and thus the data at the bit position of the most significant digit is extremely important.
With this configuration, unlike a configuration in which a plurality of distributed image signals are generated by distributing a plurality of pixel data groups such that pieces of data at the bit positions of the most significant digits of the pixel data groups of pixels adjacent to each other are included in an identical distributed image signal, any loss of data at the bit position of the most significant digit occurs at pixels separate from each other, not at pixels adjacent to each other, when a transmission failure occurs in any of the signal transmission paths. An image in which a loss of data at the bit position of the most significant digit occurs at pixels separate from each other allows easier entire recognition thereof than an image in which a loss of data at the bit position of the most significant digit occurs at pixels adjacent to each other.
With this configuration, an image suitable for observation may be continuously displayed when a transmission failure occurs in a signal transmission path. In addition, a simplified structure without a redundant signal transmission path that is unnecessary when no transmission failure occurs may be achieved because the distributed image signals different from each other are transmitted to the external medical control device through the respective signal transmission paths.
A medical observation system according to the present disclosure includes the medical signal processing device and the medical control device described above, and thus provides an effect similar to the above-described effect of the medical signal processing device.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5649897, | Nov 02 1994 | Terumo Kabushiki Kaisha | Endoscope apparatus for compensating for change in polarization state during image transmission |
5878159, | May 01 1997 | ANDROMIS S A | Method for processing endoscopic images obtained with multicore fibers or multifibers |
6016211, | Jun 19 1995 | Optoelectronic smart pixel array for a reconfigurable intelligent optical interconnect | |
6697101, | Sep 20 1999 | PENTAX Corporation | Electronic endoscope |
7292275, | Mar 22 2001 | EVIDENT CORPORATION | Exposure control device for microscope imaging |
7587261, | Jun 28 1996 | Metrovideo, Inc. | Image acquisition system |
8449453, | Jul 12 2010 | Olympus Corporation | Endoscopic image processing apparatus and endoscope system |
20070276198, | |||
20080123097, | |||
20110213203, | |||
20120127292, | |||
20120308149, | |||
20130012777, | |||
20130266078, | |||
20150022647, | |||
20150305603, | |||
JP200626134, | |||
JP200961032, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Nov 30 2016 | MICHIHATA, TAIHEI | SONY OLYMPUS MEDICAL SOLUTIONS INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041034 | /0920 | |
Dec 20 2016 | SONY OLYMPUS MEDICAL SOLUTIONS INC. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Apr 22 2022 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Nov 20 2021 | 4 years fee payment window open |
May 20 2022 | 6 months grace period start (w surcharge) |
Nov 20 2022 | patent expiry (for year 4) |
Nov 20 2024 | 2 years to revive unintentionally abandoned end. (for year 4) |
Nov 20 2025 | 8 years fee payment window open |
May 20 2026 | 6 months grace period start (w surcharge) |
Nov 20 2026 | patent expiry (for year 8) |
Nov 20 2028 | 2 years to revive unintentionally abandoned end. (for year 8) |
Nov 20 2029 | 12 years fee payment window open |
May 20 2030 | 6 months grace period start (w surcharge) |
Nov 20 2030 | patent expiry (for year 12) |
Nov 20 2032 | 2 years to revive unintentionally abandoned end. (for year 12) |