There is provided an image display device, including a first obtaining unit for obtaining a first image, a second obtaining unit for obtaining a second image to be superimposed on the first image, a reproducing unit for generating an output image by superimposing the second image on the first image and displaying the generated output image, a detecting unit for detecting a position in the output image of a cursor operated by a user, and a reproduction controller for controlling display of the second image by the reproducing unit according to positional relationship between a display position of the second image in the output image and a cursor position detected by the detecting unit.
|
4. A display controlling method for use with an image display device, said method comprising:
obtaining a first image;
obtaining a second image to be superimposed on the first image;
generating an output image by superimposing the second image on the first image;
displaying the generated output image on a display screen of the image display device;
detecting a first operation event and only upon detection of the first operation event for determining whether a second operation event has occurred after the first operation event and does not correspond to the same operation as the first operation event, said first operation event includes a code indicative of a type of operation and information indicative of a position in the output image of a cursor operated by a user; and
controlling display of the second image in the output image according to positional relationship between a display position of the second image in the output image and a detected cursor position; and
enabling the user to set a desired relationship between transparency of the second image and the distance between the display position of the second image and the cursor position,
in which the controlling (i) changes transparency of the second image according to distance between the display position of the second image and the cursor position based on the set desired relationship when the first operation event is detected and the second operation event is determined not to have occurred, (ii) does not make the second image transparent when the first operation event is detected and the second operation event is determined to have occurred after the first operation event, (iii) enables the user to perform operations on the second image when the first operation event is detected and the second operation event is determined to have occurred after the first operation event, and (v) automatically moves, in a direction across the output image, the second image from an original position to another position in the output image, when the first operation event indicating a movement type of operation is detected and the distance between the display position of the second image and the cursor position is 0 or smaller than a predetermined threshold.
1. An image display device, comprising:
a first obtaining unit to obtain a first image;
a second obtaining unit to obtain a second image to be superimposed on the first image;
a reproducing unit to generate an output image by superimposing the second image on the first image and display the generated output image;
a detecting unit to detect a first operation event and only upon detection of the first operation event to determine whether a second operation event has occurred after the first operation event and does not correspond to the same operation as the first operation event, said first operation event includes a code indicative of a type of operation and information indicative of a position in the output image of a cursor operated by a user; and
a reproduction controller to control display of the second image by the reproducing unit according to positional relationship between a display position of the second image in the output image and a cursor position detected by the detecting unit,
in which the reproduction controller (i) enables the user to set a desired relationship between transparency of the second image and distance between the display position of the second image and the cursor position, (ii) changes transparency of the second image according to the distance between the display position of the second image and the cursor position based on the set desired relationship when the first operation event is detected and the second operation event is determined not to have occurred, (iii) does not make the second image transparent when the first operation event is detected and the second operation event is determined to have occurred after the first operation event, (iv) enables the user to perform operations on the second image when the first operation event is detected and the second operation event is determined to have occurred after the first operation event; and (v) automatically moves, in a direction across the output image, the second image from an original position to another position in the output image, when the first operation event indicating a movement type of operation is detected and the distance between the display position of the second image and the cursor position is 0 or smaller than a predetermined threshold.
5. A non-transitory computer readable memory having stored thereon a program for allowing a computer for controlling an image display device for displaying an output image generated by superimposing a second image on a first image to serve as:
a first obtaining unit to obtain the first image;
a second obtaining unit to obtain the second image;
a detecting unit to detect a first operation event and only upon detection of the first operation event to determine whether a second operation event has occurred after the first operation event and does not correspond to the same operation as the first operation event, said first operation event includes a code indicative of a type of operation and information indicative of a position in the output image of a cursor operated by a user; and
a reproduction controller to control display of the second image in the output image according to positional relationship between a display position of the second image in the output image and a cursor position detected by the detecting unit,
in which the reproduction controller (i) enables the user to set a desired relationship between transparency of the second image and distance between the display position of the second image and the cursor position, (ii) changes transparency of the second image according to the distance between the display position of the second image and the cursor position based on the set desired relationship when the first operation event is detected and the second operation event is determined not to have occurred, (iii) does not make the second image transparent when the first operation event is detected and the second operation event is determined to have occurred after the first operation event, (iv) enables the user to perform operations on the second image when the first operation event is detected and the second operation event is determined to have occurred after the first operation event, and (v) automatically moves, in a direction across the output image, the second image from an original position to another position in the output image, when the first operation event indicating a movement type of operation is detected and the distance between the display position of the second image and the cursor position is 0 or smaller than a predetermined threshold.
2. The image display device according to
wherein the second obtaining unit further obtains an audio signal associated with the second image,
the reproducing unit reproduces the audio signal obtained by the second obtaining unit, and
the reproduction controller further controls reproduction of the audio signal by the reproducing unit according to the positional relationship.
3. The image display device according to
wherein the reproduction controller does not allow the reproducing unit to reproduce the audio signal when a distance between the display position of the second image and the cursor position is larger than a predetermined threshold.
6. The image display device according to
7. The image display device according to
8. The image display device according to
9. The display controlling method according to
10. The display controlling method according to
11. The display controlling method according to
12. The display controlling method according to
13. The display controlling method according to
14. The display controlling method according to
|
The present application claims priority from Japanese Patent Application No. JP 2010-141453 filed in the Japanese Patent Office on Jun. 22, 2010, the entire content of which is incorporated herein by reference.
The present disclosure relates to an image display device, a display controlling method, and a program.
In related art, there is a technique referred to as a picture in picture (hereinafter, abbreviated as “PinP”) for displaying a plurality of images or videos simultaneously on a screen of one display device. In the PinP, one or more sub-picture is superimposed on one main picture, for example, and the pictures are simultaneously displayed on the screen. There are a variety of contents of the main picture and the sub-picture such as a user interface image of a personal computer (PC), a video of a television program, and a video reproduced from a medium such as a Blu-ray Disc (BD™) or a DVD, for example.
In the PinP, a position on which the sub-picture is superimposed is typically specified by a user. For example, the user may decide or change the position of the sub-picture using a direction key of a remote controller of the display device. It is also possible to change setting of the display device using not the display device but a peripheral device of the computer connected to the display device by applying the technique disclosed in Japanese Patent Application Laid-Open No. 2001-175378. Further, as the technique related to the PinP, Japanese Patent Application Laid-Open No. 2009-289180 proposes to improve visibility of the main picture by making the sub-picture transparent when the user operates the position or a size of the sub-picture.
However, especially when the user wants to operate an object (contents, menu or icon) displayed on the main picture, it is hard to say that operability of the user is sufficiently ensured only by using the methods disclosed in the above-described JP-A Nos. 2001-175378 and 2009-289180. For example, when the user wants to operate the object of the main picture behind the sub-picture, the user may correctly operate the object only after changing the position or the size of the sub-picture to display a desired object of the main picture. Such redundant operation itself is troublesome for the user. It is also possible that the user recognizes that there is no desired object of the main picture behind the sub-picture only after the user operates the sub-picture.
In light of the foregoing, it is desirable to provide a novel and improved image display device, display controlling method, and program capable of further improving the operability of the user in a composite screen display such as the PinP by resolving the above-described issue.
According to an embodiment of the present disclosure, there is provided an image display device, including a first obtaining unit for obtaining a first image, a second obtaining unit for obtaining a second image to be superimposed on the first image, a reproducing unit for generating an output image by superimposing the second image on the first image and displaying the generated output image, a detecting unit for detecting a position in the output image of a cursor operated by a user, and a reproduction controller for controlling display of the second image by the reproducing unit according to positional relationship between a display position of the second image in the output image and a cursor position detected by the detecting unit.
The reproduction controller may control the display of the second image according to a distance between the display position of the second image and the cursor position.
The reproduction controller may change transparency of the second image according to the distance between the display position of the second image and the cursor position.
The reproduction controller may make the second image transparent when the distance between the display position of the second image and the cursor position is smaller than a predetermined threshold.
The reproduction controller may increase the transparency of the second image as the distance becomes smaller when the distance between the display position of the second image and the cursor position is smaller than the predetermined threshold.
The detecting unit may be further capable of detecting a user input different from movement of the cursor, and the reproduction controller may not make the second image transparent regardless of the cursor position when the user input is detected.
The detecting unit may be further capable of detecting a user input different from movement of the cursor, and the reproduction controller may not make the second image transparent regardless of the cursor position when the user input is not detected.
The reproduction controller may move the second image to another position in the output image when the distance between the display position of the second image and the cursor position is 0 or smaller than a predetermined threshold.
The second obtaining unit may further obtain an audio signal associated with the second image, the reproducing unit may reproduce the audio signal obtained by the second obtaining unit, and the reproduction controller may further control reproduction of the audio signal by the reproducing unit according to the positional relationship.
The reproduction controller may not allow the reproducing unit to reproduce the audio signal when a distance between the display position of the second image and the cursor position is larger than a predetermined threshold.
According to another embodiment of the present disclosure, there is provided a display controlling method, including obtaining a first image, obtaining a second image to be superimposed on the first image, generating an output image by superimposing the second image on the first image, displaying the generated output image, detecting a position in the output image of a cursor operated by a user, and controlling display of the second image in the output image according to positional relationship between a display position of the second image in the output image and a detected cursor position.
According to another embodiment of the present disclosure, there is provided a program for allowing a computer for controlling an image display device for displaying an output image generated by superimposing a second image on a first image to serve as a first obtaining unit for obtaining the first image, a second obtaining unit for obtaining the second image, a detecting unit for detecting a position in the output image of a cursor operated by a user, and a reproduction controller for controlling display of the second image in the output image according to positional relationship between a display position of the second image in the output image and a cursor position detected by the detecting unit.
As described above, according to the image display device, the display controlling method, and the program according to an embodiment of the present disclosure, the operability of the user in the composite screen display such as the PinP may be further improved.
Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
Also, the “detailed description of the embodiment” is described in a following order.
The connecting line 10 is a communication line, which enables communication between the image display device 100 and the control device 200. The connecting line 10 may be a multimedia output line, which complies with a high-definition multimedia interface (HDMI) standard specification, for example. Alternatively, the connecting line 10 may be the communication line of another type such as a universal serial bus (USB) and an Ethernet™, for example. Further, the connecting line 10 may be realized not by wired communication but by high-speed wireless communication such as an ultra wide band (UWB) wireless, for example.
The image display device 100 is a device that displays an output image obtained by superimposing a plurality of images on the screen 102. Therefore, the output image displayed by the image display device 100 includes at least a first image and a second image. In this specification, the first image (or a display region thereof) and a second image (or a display region thereof) displayed on the screen 102 are sometimes referred to as a main picture and a sub-picture, respectively. The main picture and the sub-picture form a so-called PinP. However, it should be understood that a composite screen referred to by a name different from the PinP may also be included in the scope of the present disclosure. As is to be described in detail later, display of the images by the image display device 100 is controlled by means of the control device 200 according to operation by a user.
The first image and the second image may be obtained from a source inside the image display device 100 or may be obtained from a source outside the image display device 100. The source inside the image display device 100 may include a video output from a recording medium such as a hard disk and a BD incorporated in the image display device 100, for example. Also, the source outside the image display device 100 may include the video output from the control device 200, the video output from an AV recorder (not illustrated), delivery from a streaming server, and a television broadcasting, for example.
Meanwhile, an example in which the image display device 100 is a television receiver is mainly described in this specification. However, alternatively, the image display device 100 may be a monitor for a personal computer (PC), a contents player having a screen, and a display device of another type, for example.
The control device 200 is a device for controlling the display of the composite image by the image display device 100 according to the operation by the user. The control device 200 detects an operation event generated in the pointing device 202 or the keyboard 204, for example. Then, the control device 200 transmits the detected operation event to the image display device 100 through the connecting line 10. The operation event transmitted from the control device 200 to the image display device 100 may include movement of a cursor, drag and click by the pointing device 202, and press of buttons (or keys) of various types in the keyboard 204, for example.
Also, the control device 200 may output the video to the image display device 100. For example, when the control device 200 is the PC, the video, which shows a desktop screen of the PC or a screen of an application operating on the PC, may be output from the control device 200 to the image display device 100. In this case, the output video from the control device 200 also includes an image of the cursor operated by the pointing device 202. On the other hand, when the video is not output from the control device 200 to the image display device 100, the image of the cursor operated by the pointing device 202 may be generated by the image display device 100.
Meanwhile, in this specification, an example in which the control device 200 is the PC connected to the pointing device 202 and the keyboard 204 is mainly described. However, as the pointing device 202, a touch pad, a pointing stick, a track ball and the like may be used in place of a mouse illustrated in
The network device 250 is a device with which the image display device 100 and the control device 200 access to an external network. The network device 250 may be a modem, a digital service unit (DSU), a broadband router, a wireless access point and the like, for example. The image display device 100 may receive video contents from a contents server through the network device 250, for example.
Next, an example of specific configurations of the image display device 100 and the control device 200 of the display control system 1 is illustrated with reference to
The CPU 110 controls entire operation of the image display device 100. A program and data for controlling the operation of the image display device 100 are stored in the ROM 112. The RAM 114 temporarily stores the program and the data at the time of execution of a process by the CPU 110. The bus 116 connects the CPU 110, the ROM 112, and the RAM 114 to one another. The multimedia I/F 120, the tuner 124, the multimedia processor 126, the screen 102, the speaker 128, and the communication I/F 130 are further connected to the bus 116.
The multimedia I/F 120 receives a video signal Vin1 output from the control device 200 through the connecting line 10. The multimedia I/F 120 may be an interface, which complies with the HDMI standard specification, an USB interface and the like, for example. Also, the multimedia I/F 120 may receive an audio signal Ain1 associated with the video signal Vin1 in addition to the video signal Vin1 output from the control device 200. Then, the multimedia I/F 120 outputs the received video signal Vin1 and audio signal Ain1 to the multimedia processor 126.
The tuner 124 is connected to the antenna 122 to receive a video signal Vin2 through the antenna 122. Also, the tuner 124 may receive an audio signal Ain2 associated with the video signal Vin2 in addition to the video signal Vin2 through the antenna 122. Then, the tuner 124 outputs the received video signal Vin2 and audio signal Ain2 to the multimedia processor 126.
The multimedia processor 126 decodes the video signal input from the multimedia I/F 120, the tuner 124 or the communication I/F 130 to reproduce a series of images included in the video signal. Also, the multimedia processor 126 has a so-called PinP function for generating the output image by superimposing a plurality of reproduced images to display the generated output image on the screen 102. The multimedia processor 126 may change transparency and a display position of the image to be superimposed under control by the CPU 110. Further, the multimedia processor 126 decodes the audio signal input from the multimedia I/F 120, the tuner 124 or the communication I/F 130 to reproduce audio and outputs the reproduced audio to the speaker 128. The multimedia processor 126 may change a volume of the reproduced audio or switch an audio input under the control by the CPU 110.
The communication I/F 130 mediates communication between the image display device 100 and another device. The communication I/F 130 may be a wired local area network (LAN) or a wireless LAN interface, for example.
The multimedia I/F 120 or the communication I/F 130 receives an operation event Ev transmitted from the control device 200 to the image display device 100. Then, the operation event Ev received by the multimedia I/F 120 or the communication I/F 130 is processed by the CPU 110 as is to be further described later.
The operation event Ev may be transmitted from the control device 200 to the image display device 100 by any of following methods, for example. Meanwhile, the methods of transmitting the event herein described are illustrative only and another method may also be used.
Method 1: Event information (typically including a code indicating a type of operation and a positional coordinate of the cursor) is described in a partition for expansion included in an “AVIINFO frame” field of a HDMI signal format.
Method 2: The event information is described in a partition for expansion of consumer electronics control (CEC) being a control channel supported by a HDMI version 1.2a or newer.
Method 3: An IP packed including the event information as data is transferred through an Ethernet channel supported by a HDMI version 1.4 or a general LAN line.
The CPU 210 controls entire operation of the control device 200. A program and data for controlling the operation of the control device 200 are stored in the ROM 212. The RAM 214 temporarily stores the program and the data at the time of execution of a process by the CPU 210. The bus 216 connects the CPU 210, the ROM 212, and the RAM 214 to one another. The storage device 218, the communication I/F 230, the multimedia I/F 232, and the input I/F 234 are further connected to the bus 216.
The storage device 218 is realized using a storage medium such as the hard disk and a semiconductor memory. The storage device 218 stores an operating system (OS), which operates on the control device 200, and a program for an application. Further, the storage device 218 may store the contents data including the video and the audio.
The communication I/F 230 mediates the communication between the control device 200 and another device. The communication I/F 230 may be the wired LAN or the wireless LAN interface, for example.
The multimedia I/F 232 transmits the video signal Vin1 generated by the CPU 210 to the image display device 100 through the connecting line 10. The video signal Vin1 generated by the CPU 210 may be a series of image signals, which represent the desktop screen or the application screen, or may be the video signal decoded from the contents data stored in the storage device 218, for example. Also, the multimedia I/F 232 may transmit the audio signal Ain1 associated with the video signal Vin1 in addition to the video signal Vin1.
The input I/F 234 includes one or more connecting terminal connected to the pointing device 202 and the keyboard 204. The operation event generated in the pointing device 202 or the keyboard 204 is detected through the input I/F 234 by an event listener, which operates on the CPU 210. Then, the CPU 210 transmits the detected operation event Ev to the image display device 100 through the communication I/F 230 or the multimedia I/F 232. Also, the operation event, which should be processed by the control device 200, is processed by an event handler, which operates on the CPU 210.
The first obtaining unit 140 obtains the first image for forming the main picture in the output image, which should be output on the screen 102 of the image display device 100. In a scenario to be described later, the first image is an image included in the video signal Vin1 received from the control device 200 by the multimedia I/F 120. Therefore, the first image also includes the image of the cursor operated by the pointing device 202. Then, the first obtaining unit 140 outputs the obtained first image to the reproducing unit 160. Also, when the audio signal associated with the first image is input, the first obtaining unit 140 further obtains the audio signal (for example, the audio signal Ain1) to output to the reproducing unit 160.
The second obtaining unit 150 obtains the second image for forming the sub-picture in the output image, which should be output on the screen 102 of the image display device 100. The second image is the image superimposed on the first image in the output image. In the scenario to be described later, the second image is an image included in the video signal Vin2 received by the tuner 124 through the antenna 122. Then, the second obtaining unit 150 outputs the obtained second image to the reproducing unit 160. Also, the second obtaining unit 150 further obtains the audio signal associated with the second image (for example, the audio signal Ain2) to output to the reproducing unit 160.
The reproducing unit 160 generates the output image by superimposing the second image on the first image and displays the generated output image on the screen 102. The reproducing unit 160 makes the second image transparent with the transparency set by the reproduction controller 180 to superimpose the second image on the first image when generating the output image. Also, the reproducing unit 160 displays the second image on the display position in the output image decided by the reproduction controller 180. Also, the reproducing unit 160 may reproduce the audio signal obtained by the first obtaining unit 140 or the audio signal obtained by the second obtaining unit 150 or both of them using the speaker 128.
The detecting unit 170 detects a position in the output image of the cursor operated by the user. More specifically, the detecting unit 170 monitors the operation event Ev received from the control device 200 through the communication I/F 230 or the multimedia I/F 232. Then, the detecting unit 170 detects the operation event Ev received after generation of the event. The operation event Ev includes the code indicating the type of the operation and the positional coordinate of the cursor, for example, as the event information. In this embodiment, the code, which indicates the type of the operation, includes at least the code, which indicates the movement of the cursor (for example, “MouseMoved” and the like). That is to say, the detecting unit 170 detects the operation event Ev including the code, which indicates the movement of the cursor, and according to this, the image display device 100 may recognize the operation by the user who intends to move the cursor. The detecting unit 170 is also capable of detecting the operation event including the code different from the code, which indicates the movement of the cursor. Such operation event includes the press, and release of the button provided on the pointing device 202 or the keyboard 204, for example.
The reproduction controller 180 controls display of the second image by the reproducing unit 160 according to positional relationship between the display position of the second image in the output image and the cursor position detected by the detecting unit 170. More specifically, in this embodiment, the reproduction controller 180 controls the display of the second image by the reproducing unit 160 according to a distance between the display position of the second image and the cursor position. A display parameter of the second image controlled by the reproduction controller 180 includes the transparency and the display position of the second image, for example. Also, the reproduction controller 180 may further control the reproduce of the audio signal by the reproducing unit 160 according to the positional relationship between the display position of the second image and the cursor position.
In the output image Im0 in
As described above, the reproduction controller 180 controls the display of the second image by the reproducing unit 160 according to the positional relationship between the display position of the second image in the output image and the cursor position detected by the detecting unit 170. In the scenario described in this section, the positional relationship between the display position of the second image and the cursor position detected by the detecting unit 170 is represented by the distance between the display position of the second image and the cursor position. The distance between the display position of the second image and the cursor position may be a direct distance between a reference point in the second image and the cursor position, for example.
More specifically, for example, a cursor position Pcur in a coordinate system (X,Y) of the output image is defined as follows.
Pcur=(Xcur,Ycur) (1)
Also, a coordinate Ppic
Ppic
Ppic
For example, when a reference point Ppic in the second image is a point located the closest to the cursor position in the second image, the reference point Ppic is given as follows. Meanwhile, suppose that an original point of the coordinate system (X,Y) of the output image is located on the upper left corner of the output image.
Alternatively, the reference point Ppic may be a center point of the second image or the corner the closest to the cursor position out of four corners of the second image.
A distance D between the display position of the second image and the cursor position is calculated by a following equation.
D=√{square root over ((Xcur−Xpic)2+(Ycur−Ypic)2)}{square root over ((Xcur−Xpic)2+(Ycur−Ypic)2)} (7)
The reproduction controller 180 calculates the distance D between the display position of the second image and the cursor position according to the above-described equation, for example, and controls the display of the second image by the reproducing unit 160 according to the calculated distance D.
Meanwhile, the positional relationship between the display position of the second image and the cursor position may be represented by a parameter different from the above-described distance D. For example, on the assumption that the screen 102 is divided into a plurality of partial regions, the display of the second image may be controlled according to a type of combination of the partial region to which the display position of the second image belongs and the partial region to which the cursor position belongs (for example, whether they are the same partial region or the different partial regions).
In a first scenario, the reproduction controller 180 changes the transparency of the second image according to the distance D between the display position of the second image and the cursor position. More specifically, the reproduction controller 180 makes the second image transparent when the distance D is smaller than a predetermined threshold, for example. Also, the reproduction controller 180 increases the transparency of the second image as the distance D becomes smaller when the distance D is smaller than the predetermined threshold.
According to a graph G1, when the distance D=0, the transparency α=20, and when the distance D=50, the transparency α=0. While the distance D changes from 0 to 50, the transparency α linearly decreases from 20 to 0. When the distance D is larger than 50, the transparency α is typically 0. Such transparency decision graph G1 means that the second image is transparent when the cursor is located in the vicinity of the second image and the transparency thereof increases as the cursor moves closer to the second image. On the other hand, according to a graph G2, when the distance D satisfies 0≦D<30, the transparency α=20, and when the distance D=80, the transparency α=0. While the distance D changes from 30 to 80, the transparency α linearly decreases from 20 to 0. When the distance D is larger than 80, the transparency α is typically 0. Meanwhile, the transparency decision graphs are illustrative only. That is to say, the reproduction controller 180 may set the transparency α according to the distance D in accordance with another threshold, another inclination of transparency, or another transparency decision graph. Also, the image display device 100 may allow the user to set the transparency decision graph in advance.
With reference to
The user may activate an application associated with the icon It6, for example, by further moving the cursor 172 on the icon It6 to click the icon It6. Also, when the user moves the cursor 172 away from the second image Im2, the second image Im2 is not transparent as in the example in
With reference to
In the above-described first scenario, the user does not operate the second image using the cursor. That is to say, even when the cursor is present in the region in which the second image is displayed, it is the object on the first image behind the second image, which is a target of the operation using the cursor by the user. On the other hand, one method for enabling the operation of the second image using the cursor is to provide the menu to switch on/off display control such as the first scenario. That is to say, when the display control such as the first scenario is turned on, the object on the first image behind the second image may be operated. Also, when the display control is turned off, the second image may be operated. However, for the user, it is preferable that both of the desired two types of operation may be performed simply without such setting in advance. Therefore, a variation of the first scenario for solving such an issue is hereinafter described.
In this variation, the detecting unit 170 is further capable of detecting the user input different from the movement of the cursor. The user input different from the movement of the cursor may be the press, the release and the like of any button (such as a Ctrl key or a Shift key of the keyboard 204) provided on the pointing device 202 or the keyboard 204, for example. Such user input also is detected by the control device 200 to be transmitted from the control device 200 to the image display device 100 as the operation event Ev. The detecting unit 170 monitors the operation event Ev transmitted in this manner and may detect that a predetermined button is pressed or released by the code included in the event information of the operation event Ev.
The reproduction controller 180 switches on/off the display control such as the first scenario according to whether the above-described user input is detected. That is to say, for example, the reproduction controller 180 makes the second image transparent according to the cursor position (“on” state) when the operation event Ev indicating the movement of the cursor is detected in a state in which the predetermined button is not pressed. Also, the reproduction controller 180 does not make the second image transparent regardless of the cursor position (“off” state) when the operation event Ev indicating the movement of the cursor is detected in a state in which the predetermined button is pressed.
On the other hand,
According to the configuration according to this variation, it becomes possible that the user easily and selectively operates any of the objects on the second image or on the first image behind the second image without setting on/off of the display control in advance.
With reference to
At the step S106, the reproduction controller 180 calculates the distance D between the cursor position and the display position of the second image (step S106). Next, the reproduction controller 180 refers to the transparency decision graph G1 or G2 illustrated in
On the other hand, at the step S110, the reproduction controller 180 sets the transparency α of the second image to 0 (step S110). Next, the reproduction controller 180 performs event processing according to the operation event (step S112). The event processing here corresponds to change of the volume or the change of the size or the position of the second image, for example.
Next, the reproducing unit 160 generates the output image by superimposing the second image obtained by the second obtaining unit 150 on the first image obtained by the first obtaining unit 140 using the transparency α (step S114). Meanwhile, when it is judged that the predetermined button is pressed at the step S104, the transparency α is set to 0 at the step S110, so that the second image is not substantially transparent. Then, the reproducing unit 160 displays the generated output image on the screen 102 (step S116).
With reference to
Meanwhile, although the example in which the display control such as the first scenario is turned on when the predetermined button is not pressed is mainly described herein, of course, the display control may be turned on when the predetermined button is pressed.
In a second scenario, the reproduction controller 180 moves the second image to another position in the output image when the distance D between the display position of the second image and the cursor position is 0 or smaller than the predetermined threshold. More specifically, the reproduction controller 180 moves the display position of the second image from the position so far to another position when the distance D between the display position of the second image and the cursor position becomes smaller than the predetermined threshold (for example, 20 pixels), for example. A destination of the second image may be an optional position distant from a newest cursor position such as an opposite position across a horizontal line on a center in a vertical direction of the output image, for example.
With reference to
The user may activate the application associated with the icon It6, for example, by further moving the cursor 172 on the icon It6 to click the icon It6.
With reference to
Meanwhile, although not illustrated in
Also, the reproduction controller 180 may calculate a time change amount of the distance D and judge whether to move the display position of the second image further based on the calculated time change amount, for example. For example, when the distance D is smaller than the first threshold (for example, 20 pixels) and when the time change amount of the distance D is larger than a second threshold (for example, −5 pixels per frame), the reproduction controller 180 moves the display position of the second image. In such a configuration, the user may move the display position of the second image to another position by simple operation to quickly move the cursor closer to the second image, and may move the cursor closer to the second image (by moving the second image slowly) also when the second image is not wanted to be moved, for example.
In a third scenario, the reproduction controller 180 controls the reproduction of the audio signal by the reproducing unit 160 according to the positional relationship between the display position of the second image and the cursor position. More specifically, the reproduction controller 180 does not allow the reproducing unit 160 to reproduce the audio signal associated with the second image when the distance D between the display position of the second image and the cursor position is larger than the predetermined threshold, for example. Also, the reproduction controller 180 increases the volume of the audio signal associated with the second image reproduced by the reproducing unit 160 as the distance D is smaller when the distance D between the display position of the second image and the cursor position is smaller than the predetermined threshold, for example.
According to the graph G3, when the distance D=0, the volume Vol=v1 and when the distance D=200, the volume Vol=0. While the distance D changes from 0 to 200, the volume Vol linearly decreases from v1 to 0. When the distance D is larger than 200, the volume Vol is typically 0. Meanwhile, the volume decision graph G3 illustrated in
Also, a graph G4 indicated by a broken line in
By such control of the volume, the user may recognize the positional relationship between the display position of the second image and the cursor position by means of not only vision but also audition. According to this, the user may control the display by operating the cursor more easily. Also, the user may switch the audio input or change balance of the volume by the simple operation to only move the cursor.
With reference to
Heretofore, the display control system 1, the image display device 100, and the control device 200 according to one embodiment of the present disclosure are described with reference to
Also, according to this embodiment, the positional relationship between the display position of the second image and the cursor position is indicated by the distance between the display position of the second image and the cursor position. Therefore, the image display device 100 controls the transparency or the display position of the second image according to the distance between the display position of the second image and the cursor position. According to this, the control in which the first image behind the second image may be visually recognized when the user moves the cursor closer to the second image becomes possible. Also, as the distance becomes smaller, the transparency of the second image is increased or the volume of the audio reproduced in association with the second image is increased, so that the positional relationship between the display position of the second image and the cursor position may be recognized by the user more easily and the operation by the user is supported more successfully.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
The present disclosure contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2010-141453 filed in the Japan Patent Office on Jun. 22, 2010, the entire content of which is hereby incorporated by reference.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5892511, | Sep 30 1996 | Intel Corporation | Method for assisting window selection in a graphical user interface |
6246407, | Jun 16 1997 | ATI Technologies, Inc. | Method and apparatus for overlaying a window with a multi-state window |
6333753, | Sep 14 1998 | Microsoft Technology Licensing, LLC | Technique for implementing an on-demand display widget through controlled fading initiated by user contact with a touch sensitive input device |
6407761, | May 10 1999 | SAP SE | System and method for the visual customization of business object interfaces |
6670970, | Dec 20 1999 | Apple Inc | Graduated visual and manipulative translucency for windows |
6954905, | Jan 28 2002 | INTELLECTUAL DISCOVERY, INC | Displaying transparency characteristic aids |
6981227, | Feb 04 2002 | Microsoft Technology Licensing, LLC | Systems and methods for a dimmable user interface |
7509593, | May 12 2005 | Microsoft Technology Licensing, LLC | Mouse sound volume control |
7853891, | Jul 10 2002 | Apple Inc. | Method and apparatus for displaying a window for a user interface |
7956869, | Jul 13 2007 | Adobe Inc | Proximity based transparency of windows aiding in obscured window selection |
20020070957, | |||
20030120678, | |||
20030208751, | |||
20040179017, | |||
20060259877, | |||
20070226642, | |||
20070245256, | |||
20090295998, | |||
20100164989, | |||
CN101278555, | |||
EP1404130, | |||
JP2001175378, | |||
JP2006109281, | |||
JP2006244078, | |||
JP2009289180, | |||
JP2010055627, | |||
WO193008, | |||
WO249351, | |||
WO2007069824, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
May 13 2011 | MATSUBARA, YOSHIAKI | Sony Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 026438 | /0491 | |
Jun 13 2011 | Sony Corporation | (assignment on the face of the patent) | / | |||
Jun 13 2017 | Sony Corporation | Saturn Licensing LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 043177 | /0794 |
Date | Maintenance Fee Events |
Feb 01 2016 | ASPN: Payor Number Assigned. |
Feb 22 2019 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Feb 28 2023 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Sep 08 2018 | 4 years fee payment window open |
Mar 08 2019 | 6 months grace period start (w surcharge) |
Sep 08 2019 | patent expiry (for year 4) |
Sep 08 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 08 2022 | 8 years fee payment window open |
Mar 08 2023 | 6 months grace period start (w surcharge) |
Sep 08 2023 | patent expiry (for year 8) |
Sep 08 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 08 2026 | 12 years fee payment window open |
Mar 08 2027 | 6 months grace period start (w surcharge) |
Sep 08 2027 | patent expiry (for year 12) |
Sep 08 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |