An image display device includes an acquisition unit that, when an operation of enclosing an arbitrary region on a display screen is performed in response to sequential instruction inputs by a user, acquires position information indicating positions indicated by those instruction inputs, a recognition unit that specifies an enclosed region by a trajectory of the acquired position information and recognizes the enclosed region as a selected region, a determination unit that determines to zoom in an image displayed in an image display area with a zoom-in ratio determined based on the range of the selected region and the range of the image display area, and a display control unit that displays a zoomed-in transformed image with the determined zoom-in ratio in the display area with the center of the transformed image and the center of the image display area aligned.
|
9. An image display device including a display unit configured to display an image in an image display area on a display screen and an input unit configured to receive an instruction input indicating a position on the display screen, comprising:
at least one processor operable to read and operate according to instructions within a computer program; and
at least one memory operable to store at least portions of said computer program for access by said processor;
wherein said program includes algorithms to cause said processor to implement:
an acquisition unit configured to acquire position information indicating a position of an instruction input received by the input unit;
a region recognition unit configured to specify an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received by the acquisition unit based on sequential instruction inputs through the input unit and recognize the enclosed region as a selected region;
a direction specifying unit configured to specify a direction of the trajectory enclosing the enclosed region based on the trajectory of the position information received by the acquisition unit;
a determination unit configured to determine a zoom-in ratio of an image displayed in the image display area when the direction specified by the direction specifying unit is a first direction, and determine a zoom-out ratio of an image displayed in the image display area when the direction specified by the direction specifying unit is a second direction opposite to the first direction, based on a range of the image display area and a range of the selected region recognized by the region recognition unit; and
a display control unit configured to cause a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio or the zoom-out ratio determined by the determination unit to be displayed in the image display area, wherein
when position information based on sequential instruction inputs following the sequential instruction inputs related to specifying the enclosed region is additionally acquired by the acquisition unit after specifying the enclosed region by the trajectory of the position information, the region recognition unit acquires a trajectory of the position information received after specifying the enclosed region,
when the trajectory of the position information received after specifying the enclosed region extends inside the enclosed region in the same direction in which the enclosed region is specified, the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being one of an increase and a decrease to the ratio, the change being based on a position and a length of the trajectory extended inside the enclosed region, and
when the trajectory of the position information received after specifying the enclosed region extends outside the enclosed region in the same direction in which the enclosed region is specified, the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being another one of an increase and a decrease to the ratio, the change being based on a position and a length of the trajectory extended outside the enclosed region.
8. An image display method in an image display device including a display unit configured to display an image in an image display area on a display screen and an input unit configured to receive an instruction input indicating a position on the display screen, the method comprising:
an acquisition step of acquiring position information indicating a position of an instruction input received by the input unit;
a region recognition step of specifying an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received in the acquisition step based on sequential instruction inputs through the input unit and recognizing the enclosed region as a selected region;
a direction specifying step of specifying a direction of the trajectory enclosing the enclosed region based on the trajectory of the position information received in the acquisition step;
a determination step of determining a zoom-in ratio of an image displayed in the image display area when the direction specified in the direction specifying step is a first direction, and determining a zoom-out ratio of an image displayed in the image display area when the direction specified in the direction specifying step is a second direction opposite to the first direction, based on a range of the image display area and a range of the selected region recognized in the region recognition step; and
a display control step of causing a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio determined in the determination step to be displayed in the image display area with a center of the zoomed-in image and a center of the image display area coinciding with each other when the direction specified in the direction specifying step is the first direction, and causing a zoomed-out image obtained by zooming out an image at least partly including the image displayed in the image display area with the zoom-out ratio determined in the determination step to be displayed in the image display area with a center of the zoomed-out image and a center of the image display area coinciding with each other when the direction specified in the direction specifying step is the second direction, wherein
when position information based on sequential instruction inputs following the sequential instruction inputs related to specifying the enclosed region is additionally acquired in the acquisition step after specifying the enclosed region by the trajectory of the position information, the region recognition step acquires a trajectory of the position information received after specifying the enclosed region,
the determination step adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area based on a position and an amount of displacement of the trajectory of the position information received after specifying the enclosed region acquired in the region recognition step, the amount of displacement being measured from a point at which the enclosed region is specified, the point being included in the trajectory, and
a degree of the adjustment of the zoom-in ratio or the zoom-out ratio varies according to a difference in the amount of displacement of the trajectory of the position information received after specifying the enclosed region acquired in the region recognition step,
when the trajectory of the position information received after specifying the enclosed region extends inside the enclosed region in the same direction in which the enclosed region is specified, the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being one of an increase and a decrease to the ratio, the change being based on a position and a length of the trajectory extended inside the enclosed region, and
when the trajectory of the position information received after specifying the enclosed region extends outside the enclosed region in the same direction in which the enclosed region is specified, the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being another one of an increase and a decrease to the ratio, the change being based on a position and a length of the trajectory extended outside the enclosed region.
1. An image display device including a display unit configured to display an image in an image display area on a display screen and an input unit configured to receive an instruction input indicating a position on the display screen, comprising:
at least one processor operable to read and operate according to instructions within a computer program; and
at least one memory operable to store at least portions of said computer program for access by said processor;
wherein said program includes algorithms to cause said processor to implement:
an acquisition unit configured to acquire position information indicating a position of an instruction input received by the input unit;
a region recognition unit configured to specify an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received by the acquisition unit based on sequential instruction inputs through the input unit and recognize the enclosed region as a selected region;
a direction specifying unit configured to specify a direction of the trajectory enclosing the enclosed region based on the trajectory of the position information received by the acquisition unit;
a determination unit configured to determine a zoom-in ratio of an image displayed in the image display area when the direction specified by the direction specifying unit is a first direction, and determine a zoom-out ratio of an image displayed in the image display area when the direction specified by the direction specifying unit is a second direction opposite to the first direction, based on a range of the image display area and a range of the selected region recognized by the region recognition unit; and
a display control unit configured to cause a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio determined by the determination unit to be displayed in the image display area with a center of the zoomed-in image and a center of the image display area coinciding with each other when the direction specified by the direction specifying unit is the first direction, and causes a zoomed-out image obtained by zooming out an image at least partly including the image displayed in the image display area with the zoom-out ratio determined by the determination unit to be displayed in the image display area with a center of the zoomed-out image and a center of the image display area coinciding with each other when the direction specified by the direction specifying unit is the second direction, wherein
when position information based on sequential instruction inputs following the sequential instruction inputs related to specifying the enclosed region is additionally acquired by the acquisition unit after specifying the enclosed region by the trajectory of the position information, the region recognition unit acquires a trajectory of the position information received after specifying the enclosed region,
the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area based on a position and an amount of displacement of the trajectory of the position information received after specifying the enclosed region acquired by the region recognition unit, the amount of displacement being measured from a point at which the enclosed region is specified, the point being included in the trajectory, and
a degree of the adjustment of the zoom-in ratio or the zoom-out ratio varies according to the amount of displacement of the trajectory of the position information received after specifying the enclosed region acquired by the region recognition unit,
when the trajectory of the position information received after specifying the enclosed region extends inside the enclosed region in the same direction in which the enclosed region is specified, the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being one of an increase and a decrease to the ratio, the change being based on a position and a length of the trajectory extended inside the enclosed region, and
when the trajectory of the position information received after specifying the enclosed region extends outside the enclosed region in the same direction in which the enclosed region is specified, the determination unit adjusts the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being another one of an increase and a decrease to the ratio, the change being based on a position and a length of the trajectory extended outside the enclosed region.
2. The image display device according to
the determination unit determines a largest zoom-in ratio allowing display of a whole image within a rectangular region circumscribing the selected region in the image display area as the zoom-in ratio of the image displayed in the image display area, and
the display control unit causes the image included in the rectangular region to be zoomed in with the zoom-in ratio determined by the determination unit and displayed in the image display area.
3. The image display device according to
the position information is represented by first and second coordinate values in a two-dimensional coordinate system having first and second coordinate axes orthogonal to each other in the image display area, and
the determination unit calculates a difference value between the maximum first coordinate value and the minimum first coordinate value among a plurality of first coordinate values respectively included in a plurality of position information forming an outer edge of the selected region as a size of the selected region in a direction of the first coordinate axis, calculates a difference value between the maximum second coordinate value and the minimum second coordinate value among a plurality of second coordinate values as a size of the selected region in a direction of the second coordinate axis, and determines the zoom-in ratio based on a ratio of a size of the image display area in the direction of the first coordinate axis to the size of the selected region in the direction of the first coordinate axis or a ratio of a size of the image display area in the direction of the second coordinate axis to the size of the selected region in the direction of the second coordinate axis.
4. The image display device according to
the determination unit determines a zoom-out ratio allowing display of the image displayed in the image display area within a rectangular region circumscribing the selected region as the zoom-out ratio of the image displayed in the image display area, and
the display control unit causes an image at least partly including the image displayed in the image display area to be zoomed out with the zoom-out ratio determined by the determination unit and displayed within the rectangular region in the image display area.
5. The image display device according to
the position information is represented by first and second coordinate values in a two-dimensional coordinate system having first and second coordinate axes orthogonal to each other in the image display area, and
the determination unit calculates a difference value between the maximum first coordinate value and the minimum first coordinate value among a plurality of first coordinate values respectively included in a plurality of position information forming an outer edge of the selected region as a size of the selected region in a direction of the first coordinate axis, calculates a difference value between the maximum second coordinate value and the minimum second coordinate value among a plurality of second coordinate values as a size of the selected region in a direction of the second coordinate axis, and determines the zoom-out ratio based on a ratio of the size of the selected region in the direction of the first coordinate axis to a size of the image display area in the direction of the first coordinate axis or a ratio of the size of the selected region in the direction of the second coordinate axis to a size of the image display area in the direction of the second coordinate axis.
6. The image display device according to
when the one or more enclosed regions are additionally specified by the trajectory of the position information received after specifying the enclosed region, the determination unit changes the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area in accordance with the number of additionally specified enclosed regions.
7. The image display device according to
when a moving speed of the position of the instruction input received by the input unit is a specified speed or higher, the determination unit determines to zoom in or out the image displayed in the image display area.
|
This application is a National Stage International Application No. PCT/JP2012/059402 filed Apr. 5, 2015, claiming priority based on Japanese Patent Application No. 2011-180831 filed Aug. 22, 2011, the contents of all of witch are incorporated herein by reference in their entirety.
The present invention relates to an image display device, an image display method, an image display program, and a computer-readable recording medium whereon the program is recorded.
There has been a device for displaying images where, when a rectangular area is input on an image through an input device, the selected area is zoomed in. For example, in Non Patent Literature 1 below, the “drag and zoom” feature is provided at the display of a map. According to this feature, when a user drags a mouse on a map, the area enclosed in a rectangle with a diagonal line along the pointer drag path is displayed zoomed in.
NPL: “Google map” [Online] [Searched on Jul. 20, 2011] Internet <URL: http://maps.google.com/maps?showlabs=1>
In the above-described related art, a rectangle that is specified by a drag operation is displayed during the drag operation in order to allow a user to intuitively recognize a selected range while the user is selecting an area to be zoomed in. However, because a rectangle based on the path of the drag is calculated and displayed each time the coordinates of the pointer are moved in order to display the rectangle during the drag operation, a heavy processing load has been imposed on a device.
In view of the foregoing, an object of the present invention is to provide an image display device, an image display method, an image display program, and a computer-readable recording medium whereon the program is recorded that can provide a user interface capable of intuitively selecting an area to be zoomed with a light processing load.
To solve the above problem, an image display device according to one aspect of the present invention is an image display device including a display means configured to display an image in an image display area on a display screen and an input means configured to receive an instruction input indicating a position on the display screen, device including an acquisition means configured to acquire position information indicating a position of an instruction input received by the input means, a region recognition means configured to specify an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received by the acquisition means based on sequential instruction inputs through the input means and recognize the enclosed region as a selected region, a determination means configured to determine a zoom-in ratio of an image displayed in the image display area based on a range of the image display area and a range of the selected region recognized by the region recognition means, and a display control means configured to cause a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio determined by the determination means to be displayed in the image display area with a center of the zoomed-in image and a center of the image display area coinciding with each other.
An image display method according to one aspect of the present invention is an image display method in an image display device including a display means configured to display an image in an image display area on a display screen and an input means configured to receive an instruction input indicating a position on the display screen, the method including an acquisition step of acquiring position information indicating a position of an instruction input received by the input means, a region recognition step of specifying an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received in the acquisition step based on sequential instruction inputs through the input means and recognizing the enclosed region as a selected region, a determination step of determining a zoom-in ratio of an image displayed in the image display area based on a range of the image display area and a range of the selected region recognized in the region recognition step, and a display control step of causing a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio determined in the determination step to be displayed in the image display area with a center of the zoomed-in image and a center of the image display area coinciding with each other.
An image display program according to one aspect of the present invention is an image display program causing a computer to function as an image display device including a display means configured to display an image in an image display area on a display screen and an input means configured to receive an instruction input indicating a position on the display screen, the program causing the computer to implement an acquisition function to acquire position information indicating a position of an instruction input received by the input means, a region recognition function to specify an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received by the acquisition function based on sequential instruction inputs through the input means and recognize the enclosed region as a selected region, a determination function to determine a zoom-in ratio of an image displayed in the image display area based on a range of the image display area and a range of the selected region recognized by the region recognition function, and a display control function to cause a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio determined by the determination function to be displayed in the image display area with a center of the zoomed-in image and a center of the image display area coinciding with each other.
A computer-readable recording medium according to one aspect of the present invention is a computer-readable recording medium storing an image display program causing a computer to function as an image display device including a display means configured to display an image in an image display area on a display screen and an input means configured to receive an instruction input indicating a position on the display screen, the image display program causing the computer to implement an acquisition function to acquire position information indicating a position of an instruction input received by the input means, a region recognition function to specify an enclosed region in the image display area enclosed by a trajectory indicated by a set of position information received by the acquisition function based on sequential instruction inputs through the input means and recognize the enclosed region as a selected region, a determination function to determine a zoom-in ratio of an image displayed in the image display area based on a range of the image display area and a range of the selected region recognized by the region recognition function, and a display control function to cause a zoomed-in image obtained by zooming in the image displayed in the image display area with the zoom-in ratio determined by the determination function to be displayed in the image display area with a center of the zoomed-in image and a center of the image display area coinciding with each other.
According to the above aspect, when, in response to sequential instruction inputs by a user, an operation of enclosing an arbitrary region on a display screen with the trajectory of positions indicated by those instruction inputs is performed, a set of position information representing the positions indicated by those instruction inputs are obtained. Then, an enclosed region that is specified by the trajectory of the acquired set of position information is recognized as a selected region, and an image displayed in an image display area is zoomed in with the zoom-in ratio that is determined based on the range of the selected region and the range of the image display area. Further, the zoomed-in image is displayed with the center of the zoomed-in image and the center of the image display area aligned with each other. Thus, because the image is zoomed in based on a user's operation of enclosing an arbitrary region on the display screen, the area to be zoomed in within the image can be selected in an intuitive manner. Further, because processing that is performed during receiving instruction inputs is only the processing of acquiring position information and thus sequential heavy-load computation is not required, a zoom-in display process can be achieved with a light processing load.
The image display device according to another aspect may further include a direction specifying means configured to specify a direction of the trajectory enclosing the enclosed region based on the trajectory of the position information received by the acquisition means, and the determination means may determine the zoom-in ratio when the direction specified by the direction specifying means is a first direction.
According to the above aspect, an instruction input for zooming in an image is easily distinguishable. Therefore, a user can easily zoom in the image.
In the image display device according to another aspect, the determination means may determine a zoom-out ratio of an image displayed in the image display area based on a range of the image display area and a range of the selected region recognized by the region recognition means when the direction specified by the direction specifying means is a second direction opposite to the first direction, and the display control means may cause a zoomed-out image obtained by zooming out an image at least partly including the image displayed in the image display area with the zoom-out ratio determined by the determination means to be displayed in the image display area with a center of the zoomed-out image and a center of the image display area coinciding with each other.
According to the above aspect, the zoom-out ratio and the display position of the zoomed-out image are determined based on a user's operation of enclosing an arbitrary region on the display screen, the user can perform input for zooming out by an intuitive operation.
In the image display device according to another aspect, the determination means may determine a largest zoom-in ratio allowing display of a whole image within a rectangular region circumscribing the selected region in the image display area as the zoom-in ratio of the image displayed in the image display area, and the display control means may cause the image included in the rectangular region to be zoomed in with the zoom-in ratio determined by the determination means and displayed in the image display area.
According to the above aspect, the range of an image which a user desires to zoom in is appropriately set by a rectangular region, and the image can be zoomed in to the largest scale in the image display area and provided to the user.
In the image display device according to another aspect, the position information may be represented by first and second coordinate values in a two-dimensional coordinate system having first and second coordinate axes orthogonal to each other in the image display area, and the determination means may calculate a difference value between the maximum first coordinate value and the minimum first coordinate value among a plurality of first coordinate values respectively included in a plurality of position information forming an outer edge of the selected region as a size of the selected region in a direction of the first coordinate axis, calculate a difference value between the maximum second coordinate value and the minimum second coordinate value among a plurality of second coordinate values as a size of the selected region in a direction of the second coordinate axis, and determine the zoom-in ratio based on a ratio of a size of the image display area in the direction of the first coordinate axis to the size of the selected region in the direction of the first coordinate axis or a ratio of a size of the image display area in the direction of the second coordinate axis to the size of the selected region in the direction of the second coordinate axis.
According to the above aspect, the zoom-in ratio is set based on the ratio of the size of the image display area to the size of the selected region in the direction of either one of the first or second coordinate axis, and therefore the image included in the selected region can be zoomed in with the more appropriate zoom-in ratio.
In the image display device according to another aspect, the determination means may determine a zoom-out ratio allowing display of the image displayed in the image display area within a rectangular region circumscribing the selected region as the zoom-out ratio of the image displayed in the image display area, and the display control means may cause an image at least partly including the image displayed in the image display area to be zoomed out with the zoom-out ratio determined by the determination means and displayed within the rectangular region in the image display area.
According to the above aspect, the zoom-out ratio is determined so that the image displayed in the image display area falls within the rectangular region circumscribing the selected region. Therefore, the image displayed in the image display area can be appropriately zoomed out.
In the image display device according to another aspect, the position information may be represented by first and second coordinate values in a two-dimensional coordinate system having first and second coordinate axes orthogonal to each other in the image display area, and the determination means may calculate a difference value between the maximum first coordinate value and the minimum first coordinate value among a plurality of first coordinate values respectively included in a plurality of position information forming an outer edge of the selected region as a size of the selected region in a direction of the first coordinate axis, calculate a difference value between the maximum second coordinate value and the minimum second coordinate value among a plurality of second coordinate values as a size of the selected region in a direction of the second coordinate axis, and determine the zoom-out ratio based on a ratio of the size of the selected region in the direction of the first coordinate axis to a size of the image display area in the direction of the first coordinate axis or a ratio of the size of the selected region in the direction of the second coordinate axis to a size of the image display area in the direction of the second coordinate axis.
According to the above aspect, the zoom-out ratio is set based on the ratio of the size of the selected region to the size of the image display area in the direction of either one of the first or second coordinate axis, and therefore the image displayed in the image display area can be zoomed out with the more appropriate zoom-out ratio.
In the image display device according to another aspect, when position information based on sequential instruction inputs is additionally acquired by the acquisition means after specifying the enclosed region by the trajectory of the position information, the region recognition means may acquire a trajectory of the position information received after specifying the enclosed region, and the determination means may adjust the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area based on a position and a length of the trajectory of the position information received after specifying the enclosed region acquired by the region recognition means.
According to the above aspect, the zoom-in ratio or the zoom-out ratio of the image is adjusted when a user performs an operation of enclosing an arbitrary region in the image display area with the trajectory of positions indicated by instruction inputs and then further performs an operation of sequential instruction inputs, and therefore the user can easily adjust the zoom-in ratio or the zoom-out ratio of the image by a series of operations following the operation of enclosing an arbitrary region.
In the image display device according to another aspect, when the trajectory of the position information received after specifying the enclosed region extends inside the enclosed region, the determination means may adjust the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being one of an increase and a decrease to the ratio, and when the trajectory of the position information received after specifying the enclosed region extends outside the enclosed region, the determination means may adjust the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area by making a change being another one of an increase and a decrease to the ratio.
According to the above aspect, the adjustment for further increasing or decreasing the zoom-in ratio or the zoom-out ratio of the image can be easily made.
In the image display device according to another aspect, when one or more enclosed regions are additionally specified by the trajectory of the position information received after specifying the enclosed region, the determination means may change the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area in accordance with the number of additionally specified enclosed regions.
According to the above aspect, the zoom-in ratio or the zoom-out ratio of the image displayed in the image display area can be changed in more detail.
In the image display device according to another aspect, when a moving speed of the position of the instruction input received by the input means is a specified speed or higher, the determination means may determine to zoom in or out the image displayed in the image display area.
According to the above aspect, sequential instruction inputs for zooming in or out an image and sequential instruction inputs for performing the other processing are easily distinguishable, and therefore a user can easily make instruction inputs for zooming in or out an image.
According to the present invention, it is possible to display an image zoomed in and out, allowing a user to intuitively recognize the detail of zoom in and out of the image with a light processing load.
An embodiment of the present invention is described hereinafter in detail with reference to the appended drawings. Note that, in the description of the drawings, the same or equivalent elements are denoted by the same reference symbols, and the redundant explanation thereof is omitted.
Further, the image display device 1 may be a personal computer that includes a display and a pointing device, for example. The display displays an image on a display screen, and the pointing device can receive an instruction input indicating a position on the display screen.
A user uses the pointing device to make an instruction input indicating an arbitrary position of an image that is displayed on the display screen.
The image display device 1 according to this embodiment is described hereinafter using the example of the terminal having the touch panel. As shown in
The functions shown in
The touch panel 10 includes a display area 10a (image display area) and an input unit 10b (input means). The display area 10a is an area that constitutes a display screen that displays an image, and it displays an image under control of the display control unit 14. The input unit 10b is a part that receives an instruction input indicating a position in the display area 10a.
The acquisition unit 11 is a part that acquires position information indicating a position of the instruction input received by the input unit 10b.
Further, when sequential instruction inputs are received through the input unit 10b, the acquisition unit 11 acquires a plurality of position information P1 to P7 in time-series fashion as shown in
The recognition unit 12 is a part that specifies an enclosed region on the basis of the trajectory of a set of time-series position information received by the acquisition unit 11 based on the sequential instruction inputs through the input unit 10 and recognizes the enclosed region as a selected region. To be specific, when a closed region is formed by the trajectory of position information, the recognition unit 12 can recognize the closed region as the enclosed region. Alternatively, even if a closed region is not formed by the trajectory of position information, the recognition unit 12 can specify the enclosed region when the trajectory of position information satisfies specified conditions, as described later with reference to
When the enclosed region is specified by the trajectory of the position information, the recognition unit 12 recognizes the enclosed region as a selected region. An example of recognition of a selected region by the recognition unit 12 is described with reference to
Note that the determination as to whether the closed region or the enclosed region is formed based on the trajectory of the sequential position information can be made by applying a known character recognition technique or the like, for example. In the known character recognition technique, the open source library which is known to those skilled in the art or the like is used, for example. Further, this technique can determine by which of the clockwise and counterclockwise trajectories the closed region or the enclosed region is formed.
The determination unit 13 is a part that determines to zoom in or out the image displayed in the display area 10a of the touch panel 10 and the details of zooming in or out based on the range of the selected region A that is recognized by the recognition unit 12. Further, the display control unit 14 is a part that zooms in or out the image displayed in the display area 10a based on the details determined by the determination unit 13 and displays it in the display area 10a of the touch panel 10.
It should be noted that the zoom in and out of an image in this embodiment is performed based on sequential instruction inputs on the touch panel 10 by a user, and such an instruction input is used also for an instruction for performing scrolling of the image displayed in the display area 10a, for example. Thus, in order to make a distinction between the instruction inputs for those processing, the determination unit 13 may determine to zoom in or out the image displayed in the display area 10a when the moving speed of the position of an instruction input received by the input unit 10b is a specified speed or higher. To be specific, when the acquisition unit 11 acquires the position information P, it further acquires the input time when an instruction input is made in addition to the coordinate value. Then, the determination unit 13 calculates the moving speed of the position of the instruction input from a user based on the coordinate value and the input time contained in the position information P, and performs scrolling of the image when the moving speed is lower than a specified value and performs zooming in or out the image when the moving speed is a specified value or higher.
First, an example of zooming in the image displayed in the display area 10a is specifically described with reference to
The determination unit 13 can set the largest zoom-in ratio that allows the image included in the rectangular region B to be displayed in the display area 10a so that the image included in the rectangular region B does not extend off the display area 10a, for example, as the zoom-in ratio of the image displayed in the display area 10a. In this case, the image included in the rectangular region B is displayed zoomed in to the size indicated by the region C1. Then, the display control unit 14 zooms in the image included in the rectangular region B with the zoom-in ratio determined by the determination unit 13 and displays the zoomed-in image in the display area 10a so that the center of the zoomed-in image and the center of the display area 10a coincide with each other.
Note that, although the rectangular region B circumscribes the selected region A in the example of
Further, the determination unit 13 may set a rectangular region that mostly includes the area of the selected region A. In this case, the determination unit 13 may set a rectangular region that includes 80% or more of the area of the selected region A, for example.
An example of determining the zoom-in ratio by the determination unit 13 is specifically described with reference to
As shown in
Then, the determination unit 13 determines the zoom-in ratio based on the ratio (XD/XP) of the size XD of the display area 10a in the x-axis direction to the size XP of the selected region A in the x-axis direction or the ratio (YD/YP) of the size YD of the display area 10a in the y-axis direction to the size YP of the selected region A in the y-axis direction.
For example, the determination unit 13 may use the smaller one of the ratio (XD/XP) and the ratio (YD/YP) as the zoom-in ratio. In this case, the largest zoom-in ratio that allows displaying the whole image in the selected region A without lack is used. Note that, in the example of determining the zoom-in ratio described with reference to
Further, in the case where the enclosed region that is specified based on the trajectory of a set of time-series position information is recognized as the selected region by the recognition unit 12, the determination unit 13 may determine to zoom in the image displayed on the display screen with a predetermined specified zoom-in ratio. In this case, the determination unit 13 determines the details of zooming in based on the position of the selected region. To be specific, the determination unit 13 determines a reference position in the image displayed on the display screen based on the position of the selected region, and determines to put the reference position at the specified position on the display screen at the time of zooming in. For example, the determination unit 13 sets the center-of-gravity position of the selected position or the center position of the rectangular region that is set based on the selected region by the above-described method as the reference position. Then, the determination unit 13 can determine to zoom in the image displayed on the display screen, putting the reference position at the center position on the display screen. Note that the specified zoom-in ratio may be set arbitrarily, such as a value of 110%, for example.
Next, an example of zooming out the image displayed in the display area 10a is specifically described with reference to
The determination unit 13 can set the zoom-out ratio that allows the image displayed in the display area 10a to be displayed within the rectangular region B circumscribing the selected region A, for example, as the zoom-out ratio of the image displayed in the display area 10a. In this case, the image displayed in the display area 10a is displayed zoomed out to the size indicated by the region C2. Then, the display control unit 14 zooms out an image that at least includes the image displayed in the display area 10a with the zoom-out ratio determined by the determination unit 13 and displays the zoomed-out image in the display area 10a so that the center of the zoomed-out image and the center of the selected region A or the rectangular region B coincide with each other. Accordingly, the image displayed in the display area 10a before zoom out is displayed zoomed out into the rectangular region B, and therefore the image that is displayed in the display area 10a after zoom out is an image that partly includes the image displayed in the display area 10a before zoom out. For example, when the image displayed in the display area 10a before zoom out is an image obtained by cutting out a part of the image to be displayed, an image that extends outside a part of the area in the image to be displayed may be displayed zoomed out in an area outside the rectangular region B in the display area 10a after zoom out.
Note that, although the rectangular region B circumscribes the selected region A in the example of
Further, the determination unit 13 may determine the zoom-out ratio by setting a rectangular region that mostly includes the area of the selected region A. In this case, the determination unit 13 may set a rectangular region that includes 80% or more of the area of the selected region A, for example.
An example of determining the zoom-out ratio by the determination unit 13 is specifically described with reference back to
As shown in
Then, the determination unit 13 determines the zoom-out ratio based on the ratio (XP/XD) of the size XP of the selected region A in the x-axis direction to the size XD of the display area 10a in the x-axis direction or the ratio (YP/YD) of the size YP of the selected region A in the y-axis direction to the size YD of the display area 10a in the y-axis direction.
For example, the determination unit 13 may use the smaller one of the ratio (XP/XD) and the ratio (YP/YD) as the zoom-out ratio. In this case, the whole image in the selected region A can be displayed within the rectangular region B. Note that, in the example of determining the zoom-out ratio described with reference to
Further, in the case where the enclosed region that is specified based on the trajectory of a set of time-series position information is recognized as the selected region by the recognition unit 12, the determination unit 13 may determine to zoom out the image displayed on the display screen with a predetermined specified zoom-out ratio. In this case, the determination unit 13 determines the details of zooming out based on the position of the selected region. To be specific, the determination unit 13 determines a reference position in the image displayed on the display screen based on the position of the selected region, and determines to put the reference position at the specified position on the display screen at the time of zooming out. For example, the determination unit 13 sets the center-of-gravity position of the selected position or the center position of the rectangular region that is set based on the selected region by the above-described method as the reference position. Then, the determination unit 13 can determine to zoom out the image displayed on the display screen, putting the reference position at the center position on the display screen. Note that the specified zoom-out ratio may be set arbitrarily, such as a value of 90%, for example.
An example of recognition of the selected region by the recognition unit 12 is described hereinafter with reference to
In the example of
Further, when the center-of-gravity point of a region enclosed by a line connecting the trajectory T1 and the points TE1 and TS1 is calculated, and an angle between a line connecting the point TE1 and the center-of-gravity point and a line connecting the point TS1 and the center-of-gravity point is a specified angle or less, the recognition unit 12 may specify the selected region A1 by assuming that the trajectory of position information exists between the starting point TS1 and the end point TE1 of the trajectory T1.
Adjustment of the zoom-in ratio and the zoom-out ratio of the image displayed in the display area 10a is described hereinafter with reference to
To be specific, as shown in
For example, when the trajectory of the position information P from the point TC2 to the end point TE2 extends outside the closed region A2 as shown in
Further, as shown in
Note that, although the zoom-in ratio or the zoom-out ratio is increased when the trajectory of the position information P from the point TC2 to the end point TE2 extends outside the closed region A2 as shown in
An example of changing the zoom-in ratio or the zoom-out ratio by the determination unit 13 is described hereinafter with reference to
To be specific, when the trajectory T of the position information P extends from the starting point TS4 to the end point TC41 and thereby the closed region A41 is formed and, after that, the trajectory T of the position information P further extends to the end point TC42 and thereby the closed region A42 is formed, the determination unit 13 can change the zoom-in ratio or the zoom-out ratio in accordance with the number of closed regions formed after the formation of the closed region A41 is recognized. For example, the determination unit 13 may increase or decrease the previously set zoom-in ratio or zoom-out ratio by 10% each time a closed region is formed.
Control for determining which of zoom in and zoom out is to be performed on the image displayed in the display area 10a is described hereinafter with reference to
Note that, as described above, the determination as to whether the enclosed region is formed based on the trajectory of position information may be made by applying a known character recognition technique or the like, for example. In the known character recognition technique, the open source library which is known to those skilled in the art or the like is used, for example. Further, in such a technique, it can be determined by which of the clockwise and counterclockwise trajectories the closed region or the enclosed region is formed. Furthermore, when the closed region or the enclosed region is formed by the character recognition technique using the open source library or the like, the recognition unit 12 can determine by which of the clockwise and counterclockwise trajectories the enclosed region is formed based on a change in the slope of the vector connecting the two position information acquired sequentially in a time series, for example.
The operation of the image display device 1 according to this embodiment is described hereinafter with reference to
First, the acquisition unit 11 receives position information indicating the position of an instruction input received by the input unit 10b of the touch panel 10 (S1). Next, the recognition unit 12 determines whether an enclosed region is specified by the trajectory of the position information received by the acquisition unit 11 based on sequential instruction inputs through the input unit 10b (S2). When it is determined that an enclosed region is specified, the process proceeds to Step S3. On the other hand, when it is not determined that an enclosed region is specified, the process ends.
In Step S3, the recognition unit 12 recognizes the enclosed region specified in Step S2 as a selected region (S3). Then, the determination unit 13 determines to zoom in or out the image displayed in the display area 10a of the touch panel 10 and the details of zooming in including the zoom-in ratio or the details of zooming out including the zoom-out ratio based on the range of the selected region A that is recognized by the recognition unit 12 (S4). After that, the display control unit 14 zooms in or out the image displayed in the display area 10a based on the details of zooming in or out determined by the determination unit 13 and displays it in the display area 10a of the touch panel 10 (S5).
Another example of a process of an image display method that is performed in the in the image display device 1 is described hereinafter with reference to
In Step S15, the determination unit 13 determines the details of zooming in the image displayed in the display area 10a of the touch panel 10, including the zoom-in ratio, based on the range of the selected region A that is recognized by the recognition unit 12 (S15). After that, the display control unit 14 zooms in the image displayed in the display area 10a based on the zoom-in ratio and the details of zooming in determined by the determination unit 13 and displays it in the display area 10a of the touch panel 10 (S16).
On the other hand, in Step S17, the determination unit 13 determines the details of zooming out the image displayed in the display area 10a of the touch panel 10, including the zoom-out ratio, based on the range of the selected region A that is recognized by the recognition unit 12 (S17). After that, the display control unit 14 zooms out the image displayed in the display area 10a based on the zoom-out ratio and the details of zooming out determined by the determination unit 13 and displays it in the display area 10a of the touch panel 10 (S18).
An image display program that causes a computer to function as the image display device 1 is described hereinafter with reference to
The main module P10 is a part that exercises control over the image display process. The functions implemented by the acquisition module P11, the recognition module P12, the determination module P13 and the display control unit P14 are equal to the functions of the acquisition unit 11, the recognition unit 12, the determination unit 13 and the display control unit 14 of the image display device 1 shown in
The image display program P1 is provided through a storage medium D1 such as CD-ROM or DVD-ROM or semiconductor memory, for example. Further, the image display program P1 may be provided as a computer data signal superimposed onto a carrier wave over a communication network.
According to the image display device 1, the image display method and the image display program P1 described above, when, in response to sequential instruction inputs by a user, an operation of enclosing an arbitrary region on a display screen with the trajectory of positions indicated by those instruction inputs is performed, position information indicating the positions indicated by those instruction inputs is acquired. Then, an enclosed region that is specified by the trajectory of the acquired position information is recognized as a selected region, and an image displayed in an image display area is zoomed in with the zoom-in ratio that is determined based on the range of the selected region and the range of the image display area. Further, the transformed image that is zoomed in is displayed with the center of the transformed image and the center of the image display area aligned with each other. Thus, because the image is zoomed in based on a user's operation of enclosing an arbitrary region on the display screen, the area to be zoomed in within the image can be selected in an intuitive manner.
Further, because processing that is performed during receiving instruction inputs is only the processing of acquiring position information and thus sequential heavy-load computation is not required, a zoom-in display process can be achieved with a light processing load.
Hereinbefore, the present invention has been described in detail with respect to the embodiment thereof. However, the present invention is not limited to the above-described embodiment. Various changes and modifications may be made therein without departing from the scope of the invention.
As described above, according to this embodiment, there is provided an image display device that can display an image zoomed in and out, allowing a user to intuitively recognize the zoom in and out of the image with a light processing load.
1 . . . image display device, 10 . . . touch panel, 10a . . . display area, 10b . . . input unit, 11 . . . acquisition unit, 12 . . . recognition unit, 13 . . . determination unit, 14 . . . display control unit, D1 . . . storage medium, P1 . . . image display program, P10 . . . main module, P11 . . . acquisition module, P12 . . . recognition module, P13 . . . determination module, P14 . . . display control module
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
6054990, | Jul 05 1996 | Qualcomm Incorporated | Computer system with handwriting annotation |
20090135275, | |||
20090219290, | |||
20100315438, | |||
20110080430, | |||
20110109581, | |||
20120311489, | |||
JP200166985, | |||
JP2004028678, | |||
JP2010271774, | |||
JP201181440, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Apr 05 2012 | Rakuten, Inc. | (assignment on the face of the patent) | / | |||
Nov 28 2013 | TAKEDA, SEIICHI | RAKUTEN INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 031932 | /0160 | |
Sep 07 2015 | RAKUTEN, INC | RAKUTEN, INC | CHANGE OF ADDRESS | 037690 | /0315 | |
Sep 01 2021 | RAKUTEN, INC | RAKUTEN GROUP, INC | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 058314 | /0657 | |
Sep 01 2021 | RAKUTEN, INC | RAKUTEN GROUP, INC | CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENT NUMBERS 10342096 10671117 10716375 10716376 10795407 10795408 AND 10827591 PREVIOUSLY RECORDED AT REEL: 58314 FRAME: 657 ASSIGNOR S HEREBY CONFIRMS THE ASSIGNMENT | 068066 | /0103 |
Date | Maintenance Fee Events |
Apr 04 2017 | ASPN: Payor Number Assigned. |
Jan 02 2020 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Dec 19 2023 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Jul 12 2019 | 4 years fee payment window open |
Jan 12 2020 | 6 months grace period start (w surcharge) |
Jul 12 2020 | patent expiry (for year 4) |
Jul 12 2022 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jul 12 2023 | 8 years fee payment window open |
Jan 12 2024 | 6 months grace period start (w surcharge) |
Jul 12 2024 | patent expiry (for year 8) |
Jul 12 2026 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jul 12 2027 | 12 years fee payment window open |
Jan 12 2028 | 6 months grace period start (w surcharge) |
Jul 12 2028 | patent expiry (for year 12) |
Jul 12 2030 | 2 years to revive unintentionally abandoned end. (for year 12) |