A communication management system includes a storage unit configured to store therein destination information of a first communication terminal that establishes a first session with a relay device that relays communication data, destination information of a conversion system that performs mutual conversion between communication schemes of communication data transmitted from the first communication terminal and a second communication terminal and establishes a second session with the relay device, and destination information of the second communication terminal that establishes a third session with the conversion system; a receiving unit configured to receive start request information to start communication between the communication terminals from the first communication terminal; an extracting unit configured to extract destination information of each communication terminal and the conversion system stored in the storage unit, based on the received start request information; and a transmitting unit configured to transmit the extracted destination information to the relay device.
|
1. An apparatus comprising:
a memory that stores first address information of a first communication terminal and second address information of a second communication terminal;
a receiver that receives first start request information to start communication between the first communication terminal and the second communication terminal using a first communication method or second start request information to start communication between the first communication terminal and a third communication terminal, from the first communication terminal, the third communication terminal transmitting and receiving communication data using a second communication method different from the first communication method; and
a transmitter that:
transmits, to a relay device, first session request information including at least the first address information of the first communication terminal and the second address information of the second communication terminal to establish a session for transmitting and receiving communication data based on the first communication method between the first communication terminal and the second communication terminal through the relay device when the receiver receives the first start request information, and
transmits, to the relay device, second session request information including at least the first address information of the first communication terminal and third address information of the third communication terminal to transmit and receive communication data between the first communication terminal and the third communication terminal through a conversion system that performs mutual conversion between the first communication method and the second communication method as well as through the relay device to which the transmitter transmits the first session request information, when the receiver receives the second start request information,
wherein the second session request information is used in order to allow the relay device to instruct the conversion system to start the session.
11. A method comprising:
storing, using a memory, first address information of a first communication terminal and second address information of a second communication terminal;
receiving, using a receiver, first start request information to start communication between the first communication terminal and the second communication terminal using a first communication method or second start request information to start communication between the first communication terminal and a third communication terminal, from the first communication terminal, the third communication terminal transmitting and receiving communication data using a second communication method different from the first communication method;
transmitting, using a transmitter to a relay device, first session request information including at least the first address information of the first communication terminal and the second address information of the second communication terminal to establish a session for transmitting and receiving communication data based on the first communication method between the first communication terminal and the second communication terminal through the relay device when the receiver receives the first start request information; and
transmitting, using the transmitter to the relay device, second session request information including at least the first address information of the first communication terminal and third address information of the third communication terminal to transmit and receive communication data between the first communication terminal and the third communication terminal through a conversion system that performs mutual conversion between the first communication method and the second communication method as well as through the relay device to which the transmitter transmits the first session request information, when the receiver receives the second start request information,
wherein the second session request information is used in order to allow the relay device to instruct the conversion system to start the session.
20. A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a computer, cause the computer to execute a method comprising:
storing first address information of a first communication terminal and second address information of a second communication terminal;
receiving first start request information to start communication between the first communication terminal and the second communication terminal using a first communication method or second start request information to start communication between the first communication terminal and a third communication terminal, from the first communication terminal, the third communication terminal transmitting and receiving communication data using a second communication method different from the first communication method;
transmitting, to a relay device, first session request information including at least the first address information of the first communication terminal and the second address information of the second communication terminal to establish a session for transmitting and receiving communication data based on the first communication method between the first communication terminal and the second communication terminal through the relay device when a receiver receives the first start request information; and
transmitting, to the relay device, second session request information including at least the first address information of the first communication terminal and third address information of the third communication terminal to transmit and receive communication data between the first communication terminal and the third communication terminal through a conversion system that performs mutual conversion between the first communication method and the second communication method as well as through the relay device to which the transmitter transmits the first session request information, when the receiver receives the second start request information,
wherein the second session request information is used in order to allow the relay device to instruct the conversion system to start the session.
29. A system comprising:
a first communication terminal;
a second communication terminal that transmits and receives communication data with the first communication terminal using a first communication method;
a memory that stores first address information of the first communication terminal and second address information of the second communication terminal;
a receiver that receives first start request information to start communication between the first communication terminal and the second communication terminal using the first communication method or second start request information to start communication between the first communication terminal and a third communication terminal, from the first communication terminal, the third communication terminal transmitting and receiving communication data using a second communication method different from the first communication method; and
a transmitter that:
transmits, to a relay device, first session request information including at least the first address information of the first communication terminal and the second address information of the second communication terminal to establish a session for transmitting and receiving communication data based on the first communication method between the first communication terminal and the second communication terminal through the relay device when the receiver receives the first start request information, and
transmits, to the relay device, second session request information including at least the first address information of the first communication terminal and third address information of the third communication terminal to transmit and receive communication data between the first communication terminal and the third communication terminal through a conversion system that performs mutual conversion between the first communication method and the second communication method as well as through the relay device to which the transmitter transmits the first session request information, when the receiver receives the second start request information,
wherein the second session request information is used in order to allow the relay device to instruct the conversion system to start the session.
2. The apparatus according to
processing circuitry that extracts address information to be transmitted to the relay device, based on the received first start request information or the received second start request information, wherein
the memory stores identification information for identifying the third communication terminal, another instance of address information of the conversion system, and the third address information of the third communication terminal in association with one another,
the receiver receives the identification information of the third communication terminal when receiving the second start request information from the first communication terminal, and
the processing circuitry searches the memory based on the received identification information of the third communication terminal and extracts the another instance of address information of the conversion system and the third address information of the third communication terminal.
3. The apparatus according to
the processing circuitry determines whether a communication method used by each communication terminal is a predetermined communication method,
the memory stores communication method information representing the communication method used by each communication terminal in association with identification information of each communication terminal,
the processing circuitry searches the memory based on the received identification information of the third communication terminal, and extracts a corresponding communication method information,
the processing circuitry determines whether the communication method represented by the extracted corresponding communication method information is the communication method used by the first communication terminal, and
when the processing circuitry determines that the communication method represented by the extracted corresponding communication method information is not the communication method used by the first communication terminal, the processing circuitry searches the memory based on the identification information of the third communication terminal received by the receiver, and extracts the another instance of address information of the conversion system and the second address information of the second communication terminal.
4. The apparatus according to
the communication method is represented by a call control method for establishing or disconnecting a connection with a destination of a communication and a coding method for converting the communication data into IP packets, and
when the communication method represented by the corresponding communication method information extracted by the processing circuitry is different from the communication method used by the first communication terminal in at least one of the call control method and the coding method, the processing circuitry determines that the communication method represented by the corresponding communication method information extracted by the processing circuitry is not the communication method used by the first communication terminal.
5. The apparatus according to
the memory stores address information representing a destination of the first communication terminal in association with identification information for identifying the first communication terminal,
the receiver receives the identification information of the first communication terminal from the first communication terminal when receiving the first start request information, and
the processing circuitry searches the memory based on the received identification information of the first communication terminal, and extracts a corresponding destination information of the first communication terminal.
6. The apparatus according to
the first communication method and the second communication method include at least a session control protocol and a video coding method, and
the first communication method and the second communication method differ in at least one of the session control protocol and the video coding method.
7. The apparatus according to
the video coding method for the first communication method is H.264/Scalable Video Coding (SVC), and
the video coding method for the second communication method is H.264/Advanced Video Coding (AVC).
8. The apparatus according to
the first communication method and the second communication method differ in both of a session control protocol and a video coding method.
9. The apparatus according to
10. The apparatus according to
the second session request information further includes another instance of address information of the conversion system, and
the first session request information does not include the another instance of address information of the conversion system.
12. The method according to
extracting, using processing circuitry, address information to be transmitted to the relay device, based on the received first start request information or the received second start request information;
storing identification information for identifying the third communication terminal, another instance of address information of the conversion system, and the third address information of the third communication terminal in association with one another;
receiving, using the receiver, the identification information of the third communication terminal when receiving the second start request information from the first communication terminal; and
searching, using the processing circuitry, the memory based on the received identification information of the third communication terminal, and extracting the another instance of address information of the conversion system and the third address information of the third communication terminal.
13. The method according to
determining, using the processing circuitry, whether a communication method used by each communication terminal is a predetermined communication method;
storing communication method information representing the communication method used by each communication terminal in association with identification information of each communication terminal;
searching, using the processing circuitry, the memory based on the received identification information of the third communication terminal, and extracting a corresponding communication method information;
determining, using the processing circuitry, whether the communication method represented by the extracted corresponding communication method information is the communication method used by the first communication terminal; and
when the processing circuitry determines that the communication method represented by the extracted corresponding communication method information is not the communication method used by the first communication terminal, searching, using the processing circuitry, the memory based on the identification information of the third communication terminal received by the receiver, and extracting the another instance of address information of the conversion system and the second address information of the second communication terminal.
14. The method according to
when the communication method represented by the corresponding communication method information extracted by the processing circuitry is different from the communication method used by the first communication terminal in at least one of the call control method and the coding method, determining, using the processing circuitry, that the communication method represented by the corresponding communication method information extracted by the processing circuitry is not the communication method used by the first communication terminal.
15. The method according to
storing address information representing a destination of the first communication terminal in association with identification information for identifying the first communication terminal;
receiving, using the receiver, the identification information of the first communication terminal from the first communication terminal when receiving the first start request information; and
searching, using the processing circuitry, the memory based on the received identification information of the first communication terminal, and extracting a corresponding destination information of the first communication terminal.
16. The method according to
the first communication method and the second communication method include at least a session control protocol and a video coding method, and
the first communication method and the second communication method differ in at least one of the session control protocol and the video coding method.
17. The method according to
the video coding method for the first communication method is H.264/Scalable Video Coding (SVC), and
the video coding method for the second communication method is H.264/Advanced Video Coding (AVC).
18. The method according to
the first communication method and the second communication method differ in both of a session control protocol and a video coding method.
19. The method according to
21. The non-transitory computer-readable storage medium according to
extracting address information to be transmitted to the relay device, based on the received first start request information or the received second start request information;
storing identification information for identifying the third communication terminal, another instance of address information of the conversion system, and the third address information of the third communication terminal in association with one another;
receiving the identification information of the third communication terminal when receiving the second start request information from the first communication terminal; and
searching a memory based on the received identification information of the third communication terminal, and extracting the another instance of address information of the conversion system and the third address information of the third communication terminal.
22. The non-transitory computer-readable storage medium according to
determining whether a communication method used by each communication terminal is a predetermined communication method;
storing communication method information representing the communication method used by each communication terminal in association with identification information of each communication terminal;
searching the memory based on the received identification information of the third communication terminal, and extracting a corresponding communication method information;
determining whether the communication method represented by the extracted corresponding communication method information is the communication method used by the first communication terminal; and
when the communication method represented by the extracted corresponding communication method information is determined not to be the communication method used by the first communication terminal, searching the memory based on the identification information of the third communication terminal received by the receiver, and extracting the another instance of address information of the conversion system and the second address information of the second communication terminal.
23. The non-transitory computer-readable storage medium according to
when the communication method represented by the extracted corresponding communication method information is different from the communication method used by the first communication terminal in at least one of the call control method and the coding method, determining that the communication method represented by the extracted corresponding communication method information is not the communication method used by the first communication terminal.
24. The non-transitory computer-readable storage medium according to
storing address information representing a destination of the first communication terminal in association with identification information for identifying the first communication terminal;
receiving the identification information of the first communication terminal from the first communication terminal when receiving the first start request information; and
searching the memory based on the received identification information of the first communication terminal, and extracting a corresponding destination information of the first communication terminal.
25. The non-transitory computer-readable storage medium according to
the first communication method and the second communication method include at least a session control protocol and a video coding method, and
the first communication method and the second communication method differ in at least one of the session control protocol and the video coding method.
26. The non-transitory computer-readable storage medium according to
the video coding method for the first communication method is H.264/Scalable Video Coding (SVC), and
the video coding method for the second communication method is H.264/Advanced Video Coding (AVC).
27. The non-transitory computer-readable storage medium according to
the first communication method and the second communication method differ in both of a session control protocol and a video coding method.
28. The non-transitory computer-readable storage medium according to
|
This application is a continuation of U.S. Ser. No. 14/368,986, filed Jun. 26, 2014, the entire content of which is incorporated herein by reference, and claims the benefit of priority under 35 U.S.C. 119 to National Stage Application No. PCT/JP12/084288, filed Dec. 26, 2012, Japanese Application No. 2011-285768, filed Dec. 27, 2011 and Japanese Application No. 2012-262456, filed Nov. 30, 2012.
The present invention relates to management of first and second communication terminals that transmit and receive predetermined call data.
In recent years, with the request for reduction of business trip expenses and a business trip time, call systems in which video conferences are performed through a communication network such as the Internet are in widespread use. In this call system, a video conference can be conducted such that image data and audio data are transmitted and received between a plurality of call terminals.
Besides a call system of a type in which image data and audio data are transmitted and received directly between call terminals, video conference systems of a type in which a plurality of relay devices are used to relay image data and audio data between a plurality of call terminals have been emerged (see Japanese Patent Application Laid-open No. 2008-227577).
However, in the video conference call system according to the related art, it is difficult to implement a call between call terminals using different call schemes. In other words, when call terminals differ in call scheme from each other, for example, when call terminals differ in at least one of a call control scheme (a call control protocol) for establishing or disconnecting a connection with a destination of a call and a coding scheme for converting image data and audio data into IP packets, there occurs a problem in that it is difficult to implement a call between the call terminals.
It is an object of the present invention to at least partially solve the problems in the conventional technology.
According to an embodiment, a communication management system for managing first and second communication terminals that transmit and receive predetermined communication data. The communication management system includes a storage unit configured to store therein destination information representing a destination of the first communication terminal that establishes a first communication session with a relay device that relays the communication data, destination information representing a destination of a conversion system that performs mutual conversion between a communication scheme of communication data transmitted from the first communication terminal and a communication scheme of communication data transmitted from the second communication terminal and establishes a second communication session with the relay device, and destination information representing a destination of the second communication terminal that establishes a third communication session with the conversion system; a receiving unit configured to receive start request information to start communication between the first communication terminal and the second communication terminal from the first communication terminal; an extracting unit configured to extract destination information of each of the first and the second communication terminals and the conversion system stored in the storage unit, on the basis of the received start request information; and a transmitting unit configured to transmit the extracted destination information to the relay device.
The above and other objects, features, advantages and technical and industrial significance of this invention will be better understood by reading the following detailed description of presently preferred embodiments of the invention, when considered in connection with the accompanying drawings.
Hereinafter, embodiments of the present invention will be described with reference to
Overall Configuration of Embodiment
The call terminals (10aa, 10ab, 10ac, . . . ), the relay device 30a, and the router 70a are connected to perform communication with one another via a local area network (LAN) 2a. The call terminals (10ba, 10bb, 10bc, . . . ), the relay device 30b, and the router 70b are connected to perform communication with one another via a LAN 2b. The LAN 2a and the LAN 2b are connected to perform communication with each other via a dedicated line 2ab including the router 70ab. Further, the LAN 2a, the LAN 2b, and the dedicated line 2ab are constructed in a predetermined region X. For example, the region X is Japan, the LAN 2a is constructed in a business office in Tokyo, and the LAN 2b is constructed in a business office in Osaka.
Meanwhile, the call terminals (10ca, 10cb, 10cc, . . . ), the relay device 30c, and the router 70c are connected to perform communication with one another via a LAN 2c. The call terminals (10da, 10db, 10dc, . . . ), the conversion system 80, and the router 70d are connected to perform communication with one another via a LAN 2d. Further, the LAN 2c and the LAN 2d are connected to perform communication with each other via a dedicated line 2cd including the router 70cd. Further, the LAN 2c, the LAN 2d, and the dedicated line 2cd are constructed in a predetermined region Y. For example, the region Y is the USA, the LAN 2c is constructed in a business office in New York, and the LAN 2d is constructed in a business office in Washington D.C. The region X and the region Y are connected to perform communication with each other via the Internet 2i from the routers (70ab, 70cd).
In the following, a “call terminal” is referred to simply as a “terminal”, and a “call management system” is referred to simply as a “management system”. An arbitrary one of a plurality of terminals (10aa, 10ab, . . . ) is referred to as a “terminal 10”, an arbitrary one of a plurality of displays (120aa, 120ab, . . . ) is referred to as a “display 120”, and an arbitrary one of a plurality of relay devices (30a, 30b, 30c) is referred to as a “relay device 30”. Further, a terminal serving as a request source that requests a start of a video conference is referred to as a “request source terminal”, and a terminal serving as a destination (a relay destination) that is a request destination is referred to as a “destination terminal”. Further, an arbitrary one of the routers (70a, 70b, 70c, 70d, 70ab, 70cd) is referred to as a “router 70”.
The call management system 50, the program providing system 90, and the maintenance system 100 are connected to the Internet 2i. In the present embodiment, the conversion system 80 is connected to the router 70d in the LAN 2d in the region Y. The call management system 50, the program providing system 90, and the maintenance system 100 may be installed in the region X or the region Y or may be installed in any other region.
In the present embodiment, a communication network 2 of the present embodiment is constructed by the LAN 2a, the LAN 2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, the LAN 2c, and the LAN 2d. In the communication network 2, there may be a place in which communication is performed in a wireless manner such as WiFi (Wireless Fidelity) or Bluetooth (registered trademark) as well as a wired manner.
In
Each terminal 10 may be used not only for a call between a plurality of business offices or a call between different rooms in the same business office but also for a call within the same room, a call between an indoor place and an outdoor place, or a call between outdoor places. When each terminal 10 is used outdoor, communication is performed by a wireless manner such as a cellular telecommunication network.
Each terminal 10 illustrated in
Here, the examples of the call control scheme includes (1) a session initiation protocol (SIP), (2) a H.323, (3) a protocol extended from the SIP, (4) a protocol of an instant messenger, (5) a protocol using a MESSAGE method of the SIP, (6) a protocol of Internet Relay Chat (IRC), and (7) a protocol extended from a protocol of an instant messenger. Of these, for example, (4) the protocol of the instant messenger is a protocol used for (4-1) an extensible messaging and presence protocol (XMPP) or (4-2) a protocol used in ICQ (registered trademark), AIM (registered trademark), Skype (registered trademark), or the like. Further, for example, (7) the protocol extended from the protocol of the instant messenger is jingle.
Among a plurality of terminals 10, a terminal 10 that uses a communication scheme in which a call control scheme is a protocol of an instant messenger (or a protocol extended from a protocol of an instant messenger), and a coding scheme is a scalable video coding (SVC) is referred to as a “dedicated terminal A”. Further, among a plurality of terminals 10, a terminal 10 that has an IP address that is not managed by the call management system 50 and uses a communication scheme in which at least one of the call control scheme and the coding scheme is different from one of the dedicated terminal A is referred to as a “non-dedicated terminal D”. Further, in the present embodiment, “dedicated terminal A” is described as a terminal which is manufactured, sold, or managed by a specific company, and the “non-dedicated terminal D” is described as a terminal which is manufactured, sold, or managed by a company other than the specific company. In the present embodiment, since terminals which are manufactured, sold, or managed by different companies are likely to differ in communication scheme from each other, the description will proceed with this example. In addition, as examples of two terminals having different communication schemes, among terminals manufactured or sold by the same company, a terminal which is new in a manufacturing or selling time is referred to as a “dedicated terminal A”, and an old terminal is referred to as a “non-dedicated terminal D”.
Each relay device 30 is a computer system that relays call data between the plurality of terminals 10. The call management system 50 is a computer system that performs login authentication from the terminal 10, management of a call status of the terminal 10, management of a destination list, and management of a communication status of the relay device 30 in an integrated fashion. An image of image data may be either or both of a moving image and a still image.
The conversion system 80 undertakes a signaling gateway that performs conversion of a call control signal and a video/audio gateway that performs encoding of call data. In other words, the conversion system 80 is a gateway that performs mutual conversion of a communication scheme of call data transmitted from a request source terminal and a communication scheme (a call control scheme and a coding scheme) of call data transmitted from a destination terminal, and converts at least one of a call control scheme and a coding scheme.
The program providing system 90 is a computer system that provides programs to be used to the terminal 10, the relay device 30, the call management system 50, the conversion system 80, and the maintenance system 100 via the communication network 2, respectively.
The maintenance system 100 is a computer system that performs maintenance, management, or repair of at least one of the terminal 10, the relay device 30, the call management system 50, the conversion system 80, and the program providing system 90. For example, when the maintenance system 100 is installed inside the country, and the terminal 10, the relay device 30, the call management system 50, the conversion system 80, or the program providing system 90 is installed outside the country, the maintenance system 100 remotely performs maintenance, that is, maintenance, management, or repair of at least one of the terminal 10, the relay device 30, the call management system 50, the conversion system 80, and the program providing system 90 via the communication network 2. Further, the maintenance system 100 performs maintenance such as management of a model number, a manufacturing number, a sales destination, a repair check, or a failure history of at least one of the terminal 10, the relay device 30, the call management system 50, the conversion system 80, and the program providing system 90 without the communication network 2.
Next, a first communication pattern for implementing a call between two dedicated terminals A will be described with reference to
Referring to
In
Here, the resolution of an image of image data handled by the first communication pattern illustrated in
There are a low-resolution image including 160×120 pixels as illustrated in (a) of
Next, a second communication pattern for implementing a call between a dedicated terminal A and a non-dedicated terminal D will be described with reference to
Referring to
Further, four communication sessions to transmit and receive four pieces of data, that is, high-resolution image data, moderate-resolution image data, low-resolution image data, and audio data based on H.264/SVC through the relay device 30 are established between the request source terminal (an example of a first communication terminal) and the conversion system 80. In
Further, two communication sessions to transmit and receive two pieces of data, that is, moderate-resolution image data and audio data based on H.264/AVC are established between the conversion system 80 and the destination terminal (an example of a second communication terminal). In
Here, the resolution of an image of image data handled by the second communication pattern illustrated in
In the first communication session sed11 and the second communication session sed12 illustrated in
Hardware Configuration of Embodiment
Next, a hardware configuration of the present embodiment will be described.
An operation panel 1150 is formed on the right sidewall surface 1130 of the housing 1100, and the operation panel 1150 is provided with a plurality of operation buttons 108a to 108e, a power supply switch 109, and an alarm lamp 119, which will be described later, and also provided with an output surface 1151 formed by a plurality of audio output holes through which a sound from a built-in speaker 115, which will be described later, is output. An accommodating unit 1160 serving as a concave portion that accommodate the arm 1200 and the camera housing 1300 is formed on a left sidewall surface 1140 side of the housing 1100. The right sidewall surface 1130 of the housing 1100 is provided with a plurality of connection ports 1132a to 1132c used to electrically connect a cable with a display I/F 117 which will be described later. Meanwhile, the left sidewall surface 1140 of the housing 1100 is provided with a connection port (not illustrated) used to eclectically connect a cable 120c for the display 120 to an external device connection I/F 118 which will be described later.
In the following, an arbitrary one of the operation buttons 108a to 108e is referred to as an “operation button 108”, and an arbitrary one of the connection ports 1132a to 1132c is referred to as a “connection port 1132”.
Next, the arm 1200 is attached to the housing 1100 through a torque hinge 1210, and the arm 1200 is configured to be vertically rotatable with a range of a tilt angle θ1 of 135° with respect to the housing 1100.
Each of the relay device 30, the call management system 50, the conversion system 80, the program providing system 90, and the maintenance system 100 has the same external appearance as a general server computer, and thus a description thereof will not be made.
Further, the terminal 10 includes the built-in camera 112 that images a subject according to control of the CPU 101 and obtains image data, an imaging element I/F 113 that controls driving of the camera 112, the built-in microphone 114 that receives a sound, the built-in speaker 115 that outputs a sound, an audio input output I/F 116 that processes an input and an output of an audio signal between the microphone 114 and the speaker 115 according to control of the CPU 101, the display I/F 117 that transmits image data to the external display 120 according to control of the CPU 101, the external device connection I/F 118 used to connect various kinds of external devices, the alarm lamp 119 that notifies of abnormality of various kinds of functions of the terminal 10, and a bus line 110 such as an address bus or a data bus used to electrically connect the above-mentioned components as illustrated in
The display 120 is a display unit configured with a liquid crystal display (LCD) device or an organic EL device that displays a subject image, an operation icon, or the like. The display 120 is connected to the display I/F 117 through the cable 120c. The cable 120c may be a cable for an analog RGB (VGA) signal, a cable for a component video, or a cable for high-definition multimedia interface (HDMI) or digital video interface (DVI).
The camera 112 includes a lens and a solid-state imaging element that converts light into electric charges and digitizes a subject image (video), and a complementary metal oxide semiconductor (CMOS), a charge coupled device (CCD), or the like is used as the solid-state imaging element.
An external device such as an external camera, an external microphone, and an external speaker may be electrically connected to the external device connection I/F 118 through a universal serial bus (USB) cable inserted into the connection port 1132 of the housing 1100 illustrated in
The recording medium 106 is configured to be removably attached to the terminal 10. As long as non-volatile memory that performs reading or writing of data according to control of the CPU 101, the recording medium 106 is not limited to the flash memory 104 and may include electrically erasable and programmable ROM (EEPROM) or the like.
Meanwhile, the relay device 30, the conversion system 80, the program providing system 90, and the maintenance system 100 have the same hardware configuration as the call management system 50, and thus a description thereof will not be made. However, each HD 204 stores various kinds of data such as a program that controls each of the relay device 30, the conversion system 80, the program providing system 90, and the maintenance system 100.
The programs for the terminal 10, the relay device 30, the conversion system 80, the program providing system 90, and the maintenance system 100 may be recorded in a computer readable recording medium (the recording medium 106 or the like) as a file of an installable format or an executable form, and distributed. As another example of the recording medium, there are a compact disc recordable (CD-R), a digital versatile disk (DVD), a Blu-ray disc, and the like.
Functional Configuration of Embodiment
Next, a functional configuration of the present embodiment will be described.
Functional Configuration of Terminal
The terminal 10 includes a transceiving unit 11, an operation input receiving unit 12, a login requesting unit 13, an imaging unit 14, an audio input unit 15a, an audio output unit 15b, a display control unit 16, a delay detecting unit 17, and a storing/reading processing unit 19. Each unit is any one of the components illustrated in
Each Functional Configuration of Terminal
Next, each functional configuration of the terminal 10 will be described in detail with reference to
The transceiving unit 11 of the terminal 10 illustrated in
The operation input receiving unit 12 is implemented by the operation button 108 and the power supply switch 109 illustrated in
The login requesting unit 13 is implemented according to an instruction from the CPU 101 illustrated in
The imaging unit 14 is implemented by the camera 112 and the imaging element I/F 113 illustrated in
The audio input unit 15a is implemented by the audio input output I/F 116 illustrated in
The display control unit 16 is implemented by the display I/F 117 illustrated in
The delay detecting unit 17 is implemented according to an instruction from the CPU 101 illustrated in
The storing/reading processing unit 19 is implemented by the SSD 105 illustrated in
The terminal ID and a relay device ID (which will be described later) of the present embodiment represent identification information, such as a language, a text, a symbol, or a sign, which is used to uniquely identify the terminal 10 and the relay device 30, respectively. The terminal ID and the relay device ID may be identification information in which at least two of a language, a text, a symbol, and a sign are combined.
<Functional Configuration of Relay Device>
The relay device 30 includes a transceiving unit 31, a status detecting unit 32, a data quality verifying unit 33, a changed quality managing unit 34, a data quality changing unit 35, and a storing/reading processing unit 39. Each unit is any one of the components illustrated in
Changed Quality Management Table
Each Functional Configuration of Relay Device
Next, each functional configuration of the relay device 30 will be described in detail. In the following, when each functional configuration of the relay device 30 is described, a relation with a main component for implementing each functional configuration of the relay device 30 among the components illustrated in
The transceiving unit 31 of the relay device 30 illustrated in
Further, the transceiving unit 31 transmits session start instruction information to instruct a start of a communication session (a first communication session) to a destination represented by an IP address of the request source terminal among IP addresses received by the transceiving unit 31. Further, the transceiving unit 31 transmits session start instruction information to instruct a start of a communication session (a second communication session) and an IP address of the destination terminal to a destination represented by an IP address of the conversion system 80 among IP addresses received by the transceiving unit 31.
The status detecting unit 32 is implemented according to an instruction from the CPU 201 illustrated in
The data quality verifying unit 33 is implemented according to an instruction from the CPU 201 illustrated in
The changed quality managing unit 34 is implemented according to an instruction from the CPU 201 illustrated in
The data quality changing unit 35 is implemented according to an instruction from the CPU 201 illustrated in
The storing/reading processing unit 39 is implemented by the HDD 205 illustrated in
Functional Configuration of Management System
The call management system 50 includes a transceiving unit 51, a terminal authenticating unit 52, a status managing unit 53, an extracting unit 54, a determining unit 55, a session managing unit 56, a quality deciding unit 57, a delay time managing unit 58, and a storing/reading processing unit 59. Each unit is any one of the components illustrated in
Relay Device Management Table
Terminal Information Management Table
A communication scheme represented as “dedicated” is a communication scheme used by the dedicated terminal A illustrated in
Terminal Status Management Table
However, in the terminal status management table, the IP address of the terminal 10 other than the dedicated terminal A, that is, the IP address of the non-dedicated terminal D or the like is not a management target and thus not managed.
Destination List Management Table
Session Management Table
Conversion Management Table
Quality Management Table
Each Functional Configuration of Management System
Next, each functional configuration of the call management system 50 will be described in detail. In the following, when each functional configuration of the call management system 50 is described, a relation with a main component for implementing each functional configuration of the call management system 50 among the components illustrated in
The transceiving unit 51 is implemented by the network I/F 209 illustrated in
The terminal authenticating unit 52 is implemented according to an instruction from the CPU 201 illustrated in
The status managing unit 53 is implemented according to an instruction from the CPU 201 illustrated in
The extracting unit 54 is implemented according to an instruction from the CPU 201 illustrated in
For example, the extracting unit 54 searches the destination list management table (see
Further, the extracting unit 54 searches the destination list management table (see
Further, the extracting unit 54 searches the terminal status management table (see
Further, the extracting unit 54 searches the quality management table (see
Further, the extracting unit 54 searches the terminal status management table (see
Next, the determining unit 55 is implemented according to an instruction from the CPU 201 illustrated in
The session managing unit 56 is implemented according to an instruction from the CPU 201 illustrated in
The quality deciding unit 57 decides an image quality of image data to be relayed by the relay device 30 based on the image quality information of image data extracted by the extracting unit 54.
The delay time managing unit 58 is implemented according to an instruction from the CPU 201 illustrated in
The storing/reading processing unit 59 is implemented by the HDD 205 illustrated in
Functional Configuration of Conversion System
The conversion system 80 includes a transceiving unit 81, a communication scheme converting unit 82, and a storing/reading processing unit 89. Each unit is any one of the components illustrated in
Functional Configuration of Conversion System
Next, each functional configuration of the conversion system 80 will be described with reference to
The transceiving unit 81 of the conversion system 80 illustrated in
The communication scheme converting unit 82 mutually converts a communication scheme of call data transmitted from the request source terminal and communication scheme of call data transmitted from the destination terminal based on communication scheme conversion rule data stored in the storage unit 8000.
The storing/reading processing unit 89 is implemented by the HDD 205 illustrated in
Process and Operation of Embodiment
Next, the first communication pattern in which a call is performed between the two dedicated terminals A will be described with reference to
First, when the user turns on the power supply switch 109 illustrated in
Next, the terminal authenticating unit 52 of the call management system 50 searches the terminal information management table (see
Then, the transceiving unit 51 of the call management system 50 transmits authentication result information representing the authentication result obtained by the terminal authenticating unit 52 to the request source terminal (the terminal 10aa) that has made the login request via the communication network 2 (step S25). In the present embodiment, the description will proceed with an example in which the terminal authenticating unit 52 determines that the terminal 10 has an appropriate right of usage.
The extracting unit 54 of the call management system 50 searches the destination list management table (see
Next, the extracting unit 54 searches the terminal status management table (see
Next, the transceiving unit 51 transmits destination status information including the terminal IDs (“01ab”, “01ba”, . . . ) used in step S27 as the search key and the operation status (“offline”, “online”, . . . ) of the corresponding destination terminals (the terminals 10ab, 10ba, . . . ) to the request source terminal (the terminal 10aa) via the communication network 2 (step S28). Thus, the request source terminal (the terminal 10aa) can detect the current operation statuses (“offline”, “online”, . . . ) of the terminals (10ab, 10ba, . . . ) serving as the destination terminal candidate that can perform communication with the request source terminal (the terminal 10aa).
Further, the extracting unit 54 searches the destination list management table (see
Next, the extracting unit 54 searches the terminal status management table (see
The operation status of the terminal 10da serving as the non-dedicated terminal D is not managed in the terminal status management table (see
Meanwhile, even in another terminal 10, when the user turns on the power supply switch 109 illustrated in
Next, the description will proceed with an example in which a call is performed between the two dedicated terminals A with reference to
Referring to
Then, the status managing unit 53 of the call management system 50 illustrated in
Next, the session managing unit 56 of the call management system 50 generates a session ID used to establish a communication session (step S44). Then, the call management system 50 determines a communication scheme that can be used by the destination terminal (the terminal 10ca) (step S45).
Here, step S45 will be described in detail with reference to
Referring to
Next, the determining unit 55 determines whether or not a communication scheme represented by the extracted communication scheme information is a communication scheme that can be used by the request source terminal (the terminal 10aa) serving as the dedicated terminal A (step S45-2). Specifically, the determining unit 55 determines whether or not a communication scheme represented by the communication scheme information extracted by the extracting unit 54 is the same as a communication scheme that can be used by the request source terminal (the terminal 10aa). The two communication schemes are determined to be the same as each other when the two communication schemes are the same in both of the call control scheme and the coding scheme, but the two communication schemes are determined to be not the same as each other when the two communication schemes are different in at least one of the call control scheme and the coding scheme.
Then, when the determining unit 55 determines that the two communication schemes are the same as each other (YES in step S45-2), the process proceeds to step S61 illustrated in
Referring to
Next, the transceiving unit 31 of the relay device 30a initializes the communication session (step S62). Then, the transceiving unit 31 transmits the session start instruction information to instruct a start of the communication session to the request source terminal (the terminal 10aa) (step S63). The session start instruction information includes the session ID transmitted from the call management system 50. Further, the relay device 30a also transmits the IP address of the relay device 30a to the request source terminal (the terminal 10aa) when transmitting the session start instruction information. Thus, the transceiving unit 11 of the request source terminal (the terminal 10aa) receives the session start instruction information and the IP address of the relay device 30a.
Similarly, the transceiving unit 31 transmits the session start instruction information to instruct a start of the communication session to the destination terminal (the terminal 10ca) (step S64). The session start instruction information includes the session ID transmitted from the call management system 50. Further, the relay device 30a also transmits the IP address of the relay device 30a to the destination terminal (the terminal 10ca) when transmitting the session start instruction information. Thus, the transceiving unit 11 of the destination terminal (the terminal 10ca) receives the session start instruction information and the IP address of the relay device 30a.
As a result, the communication session (the first communication session sed1 illustrated in
Next, a process of transmitting and receiving call data in order to perform a call such as a video conference between the request source terminal and the destination terminal will be described with reference to
First, the request source terminal (the terminal 10aa) transmits subject image data imaged by the imaging unit 14 and audio data of a sound input through the audio input unit 15a to the relay device 30a via the communication network 2 through the transceiving unit 11 using the communication session sed1 (step S81). In the present embodiment, high-quality image data having the three resolutions, that is, the low resolution, the moderate resolution, and the high resolution illustrated in
Next, the delay detecting unit 17 of the destination terminal (the terminal 10ca) detects the reception delay time of the image data received through the transceiving unit 11 at predetermined time intervals (for example, each second (step S84). In the present embodiment, the following description will proceed with an example in which the delay time is 200 (ms).
The transceiving unit 11 of the destination terminal (the terminal 10ca) transmits the delay time information representing the delay time “200 (ms)” to the call management system 50 via the communication network 2 through the management communication session sei illustrated in
Next, the delay time managing unit 58 of the call management system 50 searches the terminal status management table (see
Next, the quality deciding unit 57 decides the image quality as the “moderate image quality” by searching the quality management table (see
Next, the transceiving unit 51 searches the relay device management table (see
Next, similarly to step S81, the request source terminal (the terminal 10aa) transmits the high-quality image data having the three resolutions, that is, the low resolution, the moderate resolution, the high resolution and the audio data to the relay device 30a through the first communication session sed1 (step S91). Thus, in the relay device 30a, similarly to step S82, the data quality verifying unit 33 verifies a quality of an image of image data to be relayed by searching the changed quality management table (see
Then, the transceiving unit 31 transmits the image data in which an image quality of image data has been changed to the “moderate image quality” and the audio data in which a sound quality of a sound has not been changed to the destination terminal (the terminal 10ca) via the communication network 2 through the second communication session sed2 (step S94). Thus, the destination terminal (the terminal 10ca) receives image data of a moderate image quality having two resolutions, that is, the low resolution, the moderate resolution and the audio data through the transceiving unit 11. Then, the display control unit 16 can cause an image to be displayed on a display 120ca based on a combination of the image data having the two resolutions, and the audio output unit 15b can output a sound based on the audio data.
As described above, when a reception delay occurs in the destination terminal (the terminal 10ca) that receives image data, the relay device 30a changes a quality of an image, and thus that the user who attends a call such as a video conference does not feel uncomfortable. In other words, a service to cope with a reception delay of image data can be provided between the two dedicated terminals A.
Next, the second communication pattern in which a call is performed between the dedicated terminal A (an example of a first communication terminal) and the non-dedicated terminal D (and example of a second communication terminal) will be described with reference to
Further, in
In the case of the second communication pattern, the extracting unit 54 searches the conversion management table (see
The call management system 50 also transmits the IP address of the call management system 50 when transmitting the session initialization request information to the relay device 30a. Thus, the transceiving unit 31 of the relay device 30a receives the session initialization request information and the IP address of the call management system 50.
Next, the transceiving unit 31 of the relay device 30a initializes the communication session (step S102). Then, the transceiving unit 31 transmits the session start instruction information to instruct a start of the communication session to the request source terminal (the terminal 10aa) (step S103). The session start instruction information includes the session ID transmitted from the call management system 50. Further, the relay device 30a also transmits the IP address of the relay device 30a to the request source terminal (the terminal 10aa) when transmitting the session start instruction information. Thus, the transceiving unit 11 of the request source terminal (the terminal 10aa) receives the session start instruction information and the IP address of the relay device 30a.
Similarly, the transceiving unit 31 transmits the session start instruction information to instruct a start of the communication session to the conversion system 80 (step S104). The session start instruction information includes the session ID transmitted from the call management system 50 and the IP address of the destination terminal (the terminal 10da). In other words, the transceiving unit 31 transmits the session start instruction information and transmits the IP address of the destination terminal (the terminal 10da). Further, the relay device 30a also transmits the IP address of the relay device 30a to the conversion system 80 when transmitting the session start instruction information. Thus, the transceiving unit 81 of the conversion system 80 receives the session start instruction information and the IP address of the relay device 30a.
Further, in the second communication pattern, the transceiving unit 81 of the conversion system 80 transmits the session start instruction information to instruct a start of the communication session to the destination terminal (the terminal 10da) (step S105). The session start instruction information includes the session ID transmitted from the call management system 50. Further, the conversion system 80 also transmits the IP address of the conversion system 80 to the destination terminal (the terminal 10da) when transmitting the session start instruction information. Thus, the transceiving unit 11 of the destination terminal (the terminal 10da) receives the session start instruction information and the IP address of the conversion system 80.
As a result, the communication session (the first communication session sed11 illustrated in
Next, a process of transmitting and receiving call data in order to perform a call such as a video conference between the request source terminal and the destination terminal will be described with reference to
First, the request source terminal (the terminal 10aa) transmits subject image data imaged by the imaging unit 14 and audio data of a sound input through the audio input unit 15a to the relay device 30a via the communication network 2 through the transceiving unit 11 using the communication session sed11 (step S121). In the second communication pattern, similarly to the first communication pattern, high-quality image data having the three resolutions, that is, the low resolution, the moderate resolution, and the high resolution illustrated in
Next, the relay device 30a transmits the high-quality image data having the three resolutions and the audio data to the conversion system 80 via the communication network 2 through the transceiving unit 31 using the communication session sed12 (step S122). Thus, the conversion system 80 receives the image data having the three resolutions and the audio data through the transceiving unit 81.
Next, the communication scheme converting unit 82 of the conversion system 80 converts the communication scheme of the image data having the three resolutions from the communication scheme used by the request source terminal (the terminal 10aa) to the communication scheme used by the destination terminal (the terminal 10da) based on the conversion rule data stored in the storage unit 8000 in advance (step S123). Here, as the conversion of the communication scheme is performed, the image data having the three resolutions (the high resolution, the moderate resolution, and the low resolution) illustrated
Next, the conversion system 80 transmits the audio data and the moderate-resolution image data to the terminal 10da via the communication network 2 through the transceiving unit 81 using the communication session sed13 (step S124). Thus, the destination terminal (the terminal 10da) receives the audio data and the moderate-resolution image data through the transceiving unit 11.
Meanwhile, when image data and audio data are transmitted from the destination terminal (the terminal 10da) to the request source terminal (the terminal 10aa), the destination terminal (the terminal 10da) transmits the audio data and the moderate-resolution image data to the conversion system 80 via the communication network 2 through the transceiving unit 11 using the communication session sed13 as illustrated in
Next, the communication scheme converting unit 82 of the conversion system 80 converts the communication scheme of the audio data and the moderate-resolution image data from the communication scheme used by the destination terminal (the terminal 10da) to the communication scheme used by the request source terminal (the terminal 10aa) based on the conversion rule data stored in the storage unit 8000 in advance (step S126).
Next, the conversion system 80 transmits the audio data and the image data having the three resolutions to the relay device 30a via the communication network 2 through the transceiving unit 81 using the communication session sed12 (step S127). Thus, the relay device 30a receives the audio data and the image data having the three resolutions through the transceiving unit 31. Then, the relay device 30a transmits the audio data and the image data having the three resolutions to the request source terminal (the terminal 10aa) via the communication network 2 through the transceiving unit 31 using the communication session sed11 (step S128). Thus, the request source terminal (the terminal 10aa) receives the audio data and the image data having the three resolutions through the transceiving unit 11.
Main Effects of Present Embodiment
As described above, according to the present embodiment, the session initialization request information to be transmitted from the call management system 50 to the relay device 30a includes the IP addresses of the request source terminal, the conversion system 80, and the destination terminal. Thus, the relay device 30a can transmit the session start instruction information to the IP address of the request source terminal and transmit the session start instruction information including the IP address of the destination terminal to the IP address of the conversion system 80. As a result, the conversion system 80 can transmit the session start instruction information to the IP address of the destination terminal.
As the session initialization request information is transmitted by the call management system 50 as described above, the first communication session sed11 can be established between the relay device 30 and the request source terminal, the second communication session sed12 can be established between the relay device 30 and the conversion system 80, and the third communication session sed13 can be established between the conversion system 80 and the destination terminal. Thus, even when the request source terminal and the destination terminal use different call schemes from each other, the communication schemes of call data are mutually converted by the conversion system 80, and there is an effect by which a call can be implemented.
Supplement of Embodiment
The above description has been made in connection with the example in which the request source terminal or the dedicated terminal A is used as an example of the first communication terminal, and the destination terminal or the non-dedicated terminal D is used as an example of the second communication terminal. However, the present invention is not limited to this example, and the destination terminal or the non-dedicated terminal D may be used as an example of the first communication terminal, and the request source terminal or the dedicated terminal A may be used as an example of the second communication terminal.
The call data is an example of communication data. The communication data includes a text or image file data. The terminal 10 is an example of the communication terminal. For example, an information processing terminal that transmits and receives the file data as well as a terminal that performs a call may be used as the communication terminal. Further, the call management system 50 is an example of the communication management system. For example, a file management system that manages processing of the file data as well as a system that manages a call may be used as the communication management system. In addition, the call system 1 is an example of the communication system. The communication system is constructed by the communication terminal and the communication management system.
In the above embodiment, the call management system 50 manages communication scheme information through the terminal information management table (see
As a result, in step S42 illustrated in
Then, when the destination is selected on the selection screen, in step S42 of
In addition, the user needs not necessarily make a selection on the selection screen. For example, when the user already knows the destination information of the destination terminal, the operation input receiving unit 12 may receive an input of the destination information (the IP address or the like) of the destination terminal from the user. In this case, in step S42, the request source terminal transmits the start request information including the destination information of the destination terminal and the information (the communication scheme information) representing that the destination terminal is “non-dedicated” rather than the terminal ID of the destination terminal to the call management system 50. Then, at the call management system 50 side, in step S45-2, the determining unit 55 determines that the destination terminal represented by the destination information is not “dedicated”, and then causes the process to proceed to step S45-3. Further, in step S45-3, the extracting unit 54 extracts the destination information of the conversion system 80 based on the destination information of the non-dedicated terminal, and causes the process to proceed to step S101.
Further, the terminal ID may be stored in the terminal 10 in advance at the time of factory shipment or may be input by the user.
In the above-described embodiment, the relay device 30, the call management system 50, the conversion system 80, the program providing system 90, and the maintenance system 100 may be constructed by a single computer or may be constructed by a plurality of computers in which respective portions (functions or devices) are divided and arbitrarily allocated. When the program providing system 90 is constructed by a single computer, a program transmitted by the program providing system 90 may be divided into a plurality of modules and then transmitted or may be transmitted without any division. Further, when the program providing system 90 is constructed by a plurality of computers, transmission from each computer may be performed in a state in which the program is divided into a plurality of modules.
In the present embodiment, as an example in which call control schemes of terminals are different from each other, a protocol of an instant messenger (or a protocol extended from a protocol of an instant messenger) and the SIP have been described, but the present invention is not limited to this combination as long as call control schemes of terminals are different from each other. For example, a combination of a protocol of an instant messenger (or a protocol extended from a protocol of an instant messenger) and H.323 may be used. Further, a combination of a protocol of an instant messenger and a protocol extended from a protocol of an instant messenger may be used.
Further, all a recording medium such as a CD-ROM storing each program of the above-described embodiment, the HD 204 storing the program, and the program providing system 90 including the HD 204 may be provided inside or outside the country as a program product.
Further, in the above-described embodiment, a quality of an image is managed by the changed quality management table illustrated in
In
Further, in the above-described embodiment, the IP address of the relay device 30 is managed in
Further, in the above-described embodiment, the video conference system has been described as an example of the call system 1, but the present invention is not limited to this example, and the call system 1 may be a telephone system such as an internet protocol (IP) telephone or an Internet telephone. Further, the call system 1 may be a car navigation system. In this case, for example, one terminal 10 corresponds to a car navigation device mounted in a vehicle, and the other terminal 10 corresponds to a management terminal or a management server of a management center that manages a car navigation device, or a car navigation device mounted in another device. Further, the call system 1 may be a communication system of a mobile telephone. In this case, for example, the terminal 10 corresponds to a mobile phone.
In addition, in the above-described embodiment, image data and audio data have been described as an example of the call data, but the call data is not limited to this example, call data may be haptic (touch) data. In this case, sensory information generated by the user's touch at one terminal side is transmitted to the other terminal side. Further, the call data may be smell data. In this case, smelling (bad smelling) at one terminal is transmitted to the other terminal side. Furthermore, the call data is preferably at least one of image data, audio data, haptic data, and smell data.
In addition, the above-described embodiment has been described in connection with the example in which a video conference is performed by the call system 1, but the present invention is not limited to this example, and the call system 1 may be used for a meeting, an ordinary conversation between family members or friends, or provision of information in one direction.
Although the invention has been described with respect to specific embodiments for a complete and clear disclosure, the appended claims are not to be thus limited but are to be construed as embodying all modifications and alternative constructions that may occur to one skilled in the art that fairly fall within the basic teaching herein set forth.
Patent | Priority | Assignee | Title |
11025603, | Mar 14 2016 | Ricoh Company, Ltd. | Service providing system, service delivery system, service providing method, and non-transitory recording medium |
11076010, | Mar 29 2016 | Ricoh Company, Ltd. | Service providing system, service delivery system, service providing method, and non-transitory recording medium |
11108772, | Mar 29 2016 | Ricoh Company, Ltd. | Service providing system, service delivery system, service providing method, and non-transitory recording medium |
11128623, | Mar 29 2016 | Ricoh Company, Ltd. | Service providing system, service delivery system, service providing method, and non-transitory recording medium |
9600681, | Feb 27 2015 | SAP SE | Method for controlling access to electronic documents using locks |
Patent | Priority | Assignee | Title |
7079495, | Jan 04 2000 | Cisco Technology, Inc. | System and method for enabling multicast telecommunications |
7383341, | Oct 15 1996 | Kabushiki Kaisha Toshiba | Data transfer control device, relay device and control device suitable for home network environment |
20080112337, | |||
20080165864, | |||
20080175325, | |||
20100002069, | |||
20100328459, | |||
20110202757, | |||
20110216699, | |||
20120002003, | |||
20120140021, | |||
20120221702, | |||
20120293692, | |||
20120314019, | |||
20130060926, | |||
20130166718, | |||
CN101507267, | |||
JP2003143323, | |||
JP2004304241, | |||
JP2008035476, | |||
JP2008227577, | |||
JP2009194661, | |||
JP2009544176, | |||
JP2011523330, | |||
JP2013153418, | |||
WO2008060262, | |||
WO2008084424, | |||
WO2011105621, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Mar 13 2015 | Ricoh Company, Limited | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Aug 15 2019 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Aug 16 2023 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Feb 23 2019 | 4 years fee payment window open |
Aug 23 2019 | 6 months grace period start (w surcharge) |
Feb 23 2020 | patent expiry (for year 4) |
Feb 23 2022 | 2 years to revive unintentionally abandoned end. (for year 4) |
Feb 23 2023 | 8 years fee payment window open |
Aug 23 2023 | 6 months grace period start (w surcharge) |
Feb 23 2024 | patent expiry (for year 8) |
Feb 23 2026 | 2 years to revive unintentionally abandoned end. (for year 8) |
Feb 23 2027 | 12 years fee payment window open |
Aug 23 2027 | 6 months grace period start (w surcharge) |
Feb 23 2028 | patent expiry (for year 12) |
Feb 23 2030 | 2 years to revive unintentionally abandoned end. (for year 12) |