Systems are presented including: a first electronic device operative to receive a first input, the first electronic device including: a first data communication unit operative to connect the first electronic device to a second electronic device; and a first processing unit operative to process the first input to generate information representing at least a portion of a first intended display, and operative to establish at least one communication channel between the first and second electronic devices using the first data communication unit operative and to call at least one application programming interface to forward the information representing the at least the portion of the first intended display to the second electronic device for display, and further operative to receive and process a representation of a second input from the second electronic device.
|
1. A system comprising:
a first electronic device memory with instructions encoded thereon, an operating system framework, and one or more processors that, when executing the instructions, are caused to perform operations comprising:
a first processing unit operative to generate generating a first intended image to be drawn on a first screen that is a full screen image at the first electronic device native window at a native display for navigation by executing at least one of a plurality of corresponding applications of the first processing unit an application in communication with the operating system framework, wherein native user inputs received from native sources are processed to update the native window;
and operative to generate information representing at least a portion of generating a second intended image to be drawn on a non-native window area on a second screen at a second electronic device from non-native display based on at least a portion of content accessible shown in the first image by at least one of the plurality of corresponding applications the application responding to an event at the first electronic device, wherein the second intended image is distinct from the first intended image and is optimized has a layout on the non-native display based on resolution information of the a non-native window area of the second screen non-native display,
and operative to forward the information representing at least the portion of forwarding the second intended image to the second screen non-native window for display by calling at least one application programming interface (API) by executing at least one of the plural of corresponding applications the application in communication with the operating system framework, wherein the application migrates from the native window of the native display to the non-native window of the non-native display and enables the corresponding non-native inputs to continue the navigation at the non-native display; and
and further operative to receive and process receiving and processing a representation of a second non-native input initiated by a user at the second electronic device a non-native user input interface in response to the second intended image by executing at least one of the plurality of corresponding applications the application in communication with the operating system framework, and operative to forward information representing at least a portion of forwarding a third intended image to update the second screen non-native window that is generated as a result of processing the second non-native input at the first electronic device by executing at least one of the plurality of corresponding applications, wherein the second device and the second screen could be configured within the first electronic device the application in communication with the operating system framework, wherein non-native user inputs received from non-native sources are different from the native sources.
2. The system of
3. The system of
4. The system of
5. The system of
6. The system of
7. The system of
8. The system of
9. The system of
10. The system of
11. The system of
12. The system of
|
This application The present application is a Reissue of application Ser. No. 14/569,759, filed Dec. 14, 2014 and issued as U.S. Pat. No. 9,836,264 on Dec. 5, 2017. Application Ser. No. 14/569,759 is a continuation of U.S. patent application Ser. No. 14/043,495 filed on Oct. 1, 2013, now U.S. Pat. No. 8,959,535, which is a continuation of U.S. patent application Ser. No. 13/741,935 filed on Jan. 15, 2013, now U.S. Pat. No. 8,566,848, which is a continuation of U.S. patent application Ser. No. 13/073,846 filed on Mar. 28, 2011, now U.S. Pat. No. 8,370,860, which is a continuation of U.S. patent application Ser. No. 12/033,608, filed on Feb. 19, 2008, now U.S. Pat. No. 7,926,072, which claims the benefit of U.S. Provisional Application No. 60/997,255 filed on Oct. 1, 2007, each of which is hereby incorporated by reference in its entirety.
LCD-based electronic devices such as Ultra Mobile PC (UMPC), laptops/PCs, personal digital assistants (PDAs), cellular phones, portable digital media players, and the like are becoming ubiquitous in modern technological societies. These devices offer specialized functionality in form factors small enough to carry in a pocket or some other small carrying bag. At least one reason why these types of devices are so popular is because display technology, which provides a convenient user interface, has advanced to a point where relatively small form factors are efficient and inexpensive. Indeed, even the most inexpensive portable electronic devices now include high frame rate color displays. However, conventional displays are not without some disadvantages.
Typically, a PDA may include a refresh-based, high frequency (REHF) display for displaying user selected information. One example of an REHF display is a liquid crystal display (LCD). LCDs have many desirable characteristics including high frame rates which provide for a satisfying visual experience when rapidly switching between screens or when scrolling across a screen. However, typical displays having high screen refresh rates may suffer from poor readability because backlights, which are required in those displays, may be adversely affected by ambient lighting conditions. Eye strain is commonly reported by users and has been documented in some medical literature. Users of UMPCs or PDAs are familiar with the poor readability of LCDs under bright light or direct sunlight. In some examples, shading the screen or moving to a darker environment may be necessary to read an LCD. In other examples, LCD cannot offer high quality image such as EPD which has close to 300 dpi today.
In order to overcome the shortcomings of an LCD, bistable, low frequency (BILF) displays may be utilized instead of an LCD. One example of a BILF display is an electronic paper display (EPD). EPDs utilize a material called electronic ink and are commercially available under the trade name E INK®. EPDs are ideally suited for flexible display applications due to their thin form factor and inherent flexibility. EPDs provide an image stable reflective display technology that uses ultra-low power but is easily read under any lighting condition including direct sunlight. In addition, EPDs provide a bistable display and unlike LCDs, an image on an EPD looks the same from all viewing angles. Further, EPDs will not distort when touched or flexed, making EPDs the ideal display medium for flexible displays and portable devices. EPDs however, cannot, in many examples, completely replace LCDs. At least one reason is because EPDs typically have a low frame rate. As noted above, conventional LCDs are typically configured with high frame rates, which may serve to enhance a user's viewing experience especially when rapidly scrolling through multiple displays. In addition, using a mouse requires high frame rates so that the mouse pointer appears to have smooth movement across a screen. Furthermore, a majority of reading content is currently created for viewing with an REHF display application such as an LCD application while few applications are written for BILF displays such as an EPD. This trend is likely to continue. It may, therefore, be advantageous to easily display the output of existing REHF display applications on BILF displays such as an EPD.
Unfortunately, Conventional operating system windows managers are typically configure to manage only multiple LCD task windows across multiple LCD displays. Thus, conventional solutions for REHF-based (LCD) applications on conventional platforms can not generally benefit from the use of multiple BILF and REHF displays. As such, application programming interfaces for providing native and non-native display utility are presented herein.
The following presents a simplified summary of some embodiments of the invention in order to provide a basic understanding of the invention. This summary is not an extensive overview of the invention. It is not intended to identify key/critical elements of the invention or to delineate the scope of the invention. Its sole purpose is to present some embodiments of the invention in a simplified form as a prelude to the more detailed description that is presented below.
As such, systems are presented including: a first electronic device operative to receive a first input, the first electronic device including: a first data communication unit operative to connect the first electronic device to a second electronic device; and a first processing unit operative to process the first input to generate information representing at least a portion of a first intended display, and operative to establish at least one communication channel between the first and second electronic devices using the first data communication unit operative and to call at least one application programming interface to forward the information representing the at least the portion of the first intended display to the second electronic device for display, and further operative to receive and process a representation of a second input from the second electronic device, where the second input is a representation of a second device input entered by a user at the second electronic device, through the at least one communication channel established between the first and second electronic devices, and to call the at least one application programming interface to forward the information representing at least a portion of a second intended display to the second electronic device for displaying at least the second intended display, where the second input is received from the second electronic device in response to the information representing the at least the portion of the first intended display through the at least one communication channel established between the first and second electronic devices, and where the second intended display is at least an update to the first intended display to be displayed at the second electronic device in response to the second device input by the user. In some embodiments, the first electronic device generates information representing synchronized intended displays to be viewed by the user at the first electronic device and the second electronic device. In some embodiments, the first input is an event selected from the group consisting of: a graphical user interface input, a physical user input and a programmatic input. In some embodiments, the at least one communication channel between the first and the second electronic devices is selected from the group consisting of: a command, an application program interface (API) call, a callback function call, a pipe, a signal, a message, a shared memory, a semaphore, a mutex, a critical section, an event, a socket, a clipboard, a message, and a message queue. In some embodiments, the forwarding of the information representing the at least the portion of the first intended display to the second electronic device is through communication channels between the first and second electronic devices. In some embodiments, the second input from the second electronic device includes a navigation command to navigate content generated from the first electronic device and displayed on the second electronic device. In some embodiments, the two electronic devices are used to navigate content selected from any of the group consisting of: browser page content, web content, video content, electronic book content, and document content. In some embodiments, the first electronic device is a mobile phone with a touch screen display with a graphical user interface. In some embodiments, the information representing the at least the portion of the first intended display to the second electronic device is selected from the group consisting of: display images, data, data pointers, and commands. In some embodiments, the first processing unit is further operative to generate information representing a third intended display for displaying at the first device in response to the second input. In some embodiments, the third intended display for displaying at the first device by the further first processing unit is synchronized with the second intended display at the second device. In some embodiments, the first processing unit is further operative to receive a third input at the first electronic device and to generate information representing a third intended display for the first electronic device and a fourth intended display for the second electronic device. In some embodiments, the first intended display is displayed as a portion of a display at the second electronic device.
In other embodiments, a first electronic device operative to receive a first input and to receive a second input from a second electronic device, where the second input is a representation of a second device input entered by a user at the second electronic device is presented, the first electronic device including: a first processing unit operative to process the first input to generate information representing a first intended display and information representing at least a portion of a second intended display, and further operative to process the second input to generate information representing at least a portion of a third intended display; a first communication interface operative to establish at least one communication channel between the first and second electronic devices over which to call at least one application programming interface to forward the information representing at least the portion of the second intended display to the second electronic device for displaying at least the second intended display, to receive the second input through the at least one communication channel established between the first and second electronic devices, and to call the at least one application programming interface to forward the information representing at least the portion of the third intended display to the second electronic device for displaying at least the third intended display, where the second input is received from the second electronic device in response to the information representing at least portion of the second intended display through the at least one communication channel established between the first and second electronic devices, and where the third intended display is at least an update to the second intended display to be displayed at the second electronic device in response to the second device input by the user; and a first display controller operative to generate first video signals for display on the first electronic device based on the information representing the first intended display. In some embodiments, the first electronic device generates information representing synchronized intended displays to be viewed by the user at the first electronic device and the second electronic device. In some embodiments, the first input is an event selected from the group consisting of: a graphical user interface input, a physical user input and a programmatic input. In some embodiments, the at least one communication channel between the first and the second electronic devices is selected from the group consisting of: a command, an application program interface (API) call, a callback function call, a pipe, a signal, a message, a shared memory, a semaphore, a mutex, a critical section, an event, a socket, a clipboard, a message, and a message queue. In some embodiments, the forwarding of the information representing the at least the portion of the second intended display to the second electronic device is through communication channels between the first and second devices. In some embodiments, the forwarding of the information representing the at least the portion of the third intended display to the second electronic device is through communication channels between the first and second devices. In some embodiments, the second input from the second electronic device includes a navigation command to navigate content generated from the first electronic device and displayed on the second electronic device. In some embodiments, the two electronic devices are used to navigate content selected from any of the group consisting of: browser page content, web content, video content, electronic book content, and document content. In some embodiments, the first electronic device is a mobile phone with a touch screen display with a graphical user interface. In some embodiments, the information representing the second intended display to the second electronic device is selected from the group consisting of: display images, data, data pointers, and commands. In some embodiments, the at least one application programming interface (API) at the first electronic device associated with interacting with the second electronic device is enabled with a multi-tasking operating system of the first electronic device selected from the group consisting of: WINDOWS, WINDOWS CE, WINDOWS mobile, APPLE iPhone system, APPLE OS X, Linux, UNIX, and a UNIX derivative OS. In some embodiments, the second intended display is intended to be displayed as a portion of a screen at the second electronic device. In some embodiments, the third intended display has a resolution optimized for a display of the second electronic device.
In other embodiments, systems are presented including: a first electronic device operative to receive a first input, the first electronic device including: a first data communication unit operative to connect the first electronic device with a second electronic device; a first processing unit operative to process the first input to generate information representing at least a portion of a first intended display, operative to call at least one application programming interface to establish at least one communication channel between the first and second electronic devices using the first data communication unit and to forward the information representing at least the portion of the first intended display to the second electronic device for display, operative to receive and process the information representing the at least a second input provided by the second electronic device through the at least one communication channel established between the first and second electronic devices, and operative to generate information representing at least a portion of a second intended display and information representing a third intended display, and to call the at least one application programming interface to forward the information representing the at least the portion of the second intended display to the second electronic device for display; a first display controller operative to generate a first video signal for display on the first electronic device based on the information representing the third intended display, and where the second electronic device operative to receive the second input, including: a second data communication unit operative to connect the second electronic device with the first electronic device, a second display controller operative to generate a second video signal for display based on the received information representing the at least the portion of the first intended display from the first electronic device and to generate a third video signal for display based on the received information representing the at least the portion of the second intended display, where the second input is provided by the first processing unit operative in response to receiving the information representing the at least the portion of the first intended display; where the second video signal and the third video signal represent related information generated by the first processing unit operative, and a second processing unit operative to forward the information representing the at least the second input to the first electronic device, using the at least one communication channel established between the first and second electronic devices using the second data communication unit. In some embodiments, the first processing unit is further operative to process a command associated with the information representing the at least the second input and operative to generate the at least the portion of the second intended display, where the at least the portion of the second intended display has a resolution optimized for the display of the second electronic device. In some embodiments, the first processing unit is further operative to receive a third input, the third input including an indication to process a toggle operation on a first screen that is displayed at the second electronic device back to a second screen that is displayed at the first electronic device while changing the resolution to be optimized for the first electronic device. In some embodiments, the toggle operation maintains an original output content graphical user interface after toggling an intended display by the first processing unit operative from the first electronic device to the second electronic device; or maintains the original output content graphical user interface after toggling another intended display by the first processing unit operative from the second electronic device to the first electronic device, and where the intermediate position of the digital content represented in the user interface is maintained from the second electronic device back to the first electronic device by the first processing unit operative.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
The present invention will now be described in detail with reference to a few embodiments thereof as illustrated in the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without some or all of these specific details. In other instances, well known process steps and/or structures have not been described in detail in order to not unnecessarily obscure the present invention.
Various embodiments are described herein below, including methods and techniques. It should be kept in mind that the invention might also cover articles of manufacture that includes a computer readable medium on which computer-readable instructions for carrying out embodiments of the inventive technique are stored. The computer readable medium may include, for example, semiconductor, magnetic, opto-magnetic, optical, or other forms of computer readable medium for storing computer readable code. Further, the invention may also cover apparatuses for practicing embodiments of the invention. Such apparatus may include circuits, dedicated and/or programmable, to carry out tasks pertaining to embodiments of the invention. Examples of such apparatus include a general-purpose computer and/or a dedicated computing device when appropriately programmed and may include a combination of a computer/computing device and dedicated/programmable circuits adapted for the various tasks pertaining to embodiments of the invention.
Operating system framework 206 processes data communications and communicates the results of the processing to native display driver 208, which may drive any number of native displays(m) 210. In some embodiments, a native display driver may include: a WINDOWS™ driver, a WINDOWS™ CE driver, a WINDOWS™ mobile driver, an APPLE™ iphone driver, An APPLE™ OS X driver, a Linux driver, a UNIX driver, and a UNIX derivative driver. Operating system framework 206 may be configured to provide any number of system resources without departing from the present invention. In some embodiments, a framework may include: a WINDOWS™ framework, a WINDOWS™ CE framework, a WINDOWS™ mobile framework, an APPLE™ iphone framework, An APPLE™ OS X framework, a Linux framework, a UNIX framework, and a UNIX derivative framework. Native display driver 208 may then send a native display signal to native display(m) 210. A resulting graphical user interface may then be displayed on native display(m) 210. In some embodiments, a native display may be a refresh based high frequency (REHF) display such as: an LCD display, a CRT display, and LED display, a PLED display, an OLED display, and a plasma display.
Heterogeneous display hardware design can deliver many new classes of non-native (i.e., EPD) usage models, including: (1) the capability to extend (or migrate) an native display-based applications to a non-native display for better reading experience where a user may also browse the pages on a non-native display without changing the application; and (2) the ability to create dual-display aware applications that can take advantages of the unique benefits of both native and non-native displays at the same time. As illustrated here, non-native API 220 may be configured to be responsive to programmatic instructions between application(1) 202 and operating system framework 206. In turn, operating system framework 206 processes programmatic instructions and communicates the results of the instructions to non-native display driver 222, which may drive any number of non-native displays(n) 226 by sending a non-native display signal. In some embodiments, non-native display driver 222 may also be configured as part of a non-native display sub-system that contains a non-native windows management system along with a non-native UI input system in addition to the non-native display driver. In some embodiments, a non-native display may be a bistable, low frequency (BILF) display such as an electronic paper display (EPD). In addition, non-native user interface(o) 230 may be utilized to provide navigation control corresponding with applications being displayed on non-native display(n) 226.
As may be appreciated, BILF displays may not be particularly well suited to navigation through a graphical user interface (GUI). One reason for this is because the refresh rate may be too slow to provide an efficient and effective user experience. However, continually transferring GUIs between a BILF and REHF to accomplish all navigation tasks may also detract from a user experience. Thus, at least some navigation capabilities may be desirable. Non-native user interface(o) 230 may include non-native user interface driver 228, which may communicate with application(i) 202 via non-native API 220 through a communication mechanism such as: a command, an API call, a callback function call, a pipe, a signal, a message, a shared memory, a semaphore, a mutex, a critical section, an event, a socket, a clipboard, a message, a message queue or any other communication mechanism known in the art without departing from the present invention. Thus when application initiates contact with non-native driver 222 via non-native API 220, a communication mechanism is configured for non-native driver 222 and application 202. Once a communication mechanism is configured, non-native driver 222 and application 202 may communicate with one another. For the purpose of description, API call and callback is used to explain the communication mechanism between the application and non-native driver.
At a next step 310, a corresponding application processes the native UI input. The corresponding application may process the native UI input in any manner known in the art without departing from the present invention. Returning to a step 304, if the method determines, at a step 304, that a UI input is a non-native UI input, the method proceeds to a step 308 to send the non-native UI input to a non-native UI driver. Typically, the non-native UI input is handled by the OS. In some embodiments, a non-native UI input may be utilized to provide some navigation capability of a corresponding application. For example, a button or toggle switch may be located on a non-native display to provide user input. As may be appreciated, bistable displays as contemplated herein, are not generally suitable for dynamic GUI input. At least one reason for this characteristic is because refresh rates are typically low (i.e., 1 to 15 frames per second (fps)). Thus, unacceptable latency, when utilizing a GUI, may be introduced and may not provide a satisfactory user experience. Non-native UI inputs may be utilized to overcome this deficiency. At a next step 312, a corresponding application is invoked by a callback function. Typically, a callback function is handled by the OS. As noted above, a callback is executable code that is passed as an argument to other code or application. Callback allows a lower-level software layer to call a subroutine (or function) defined in a higher-level layer. At a next step 316, a corresponding application executes a callback function.
At a next step 314, the method calls a non-native API embodiment. An API is defined at source code level and provides a level of abstraction between the application and the kernel (or other privileged utilities) to ensure the portability of the code. A non-native API, in accordance with embodiments described herein, may be utilized to provide application compatibility with non-native displays. In some embodiments, a non-native display may include a bistable, low frame rate display. In some embodiments, non-native displays may include an electronic paper display (EPD). In some embodiments, an EPD may be configured to refresh at a rate up to approximately 15 fps. At a next step 318, the method forwards the result of the processing of the non-native input to a non-native display driver. In embodiments, the result may be data, a data pointer, or a command. At a next step 320, a non-native signal is sent to a non-native display in accordance with all non-native display requirements, whereupon the non-native signal is displayed on a non-native display at a step 322. The method then ends.
It may be appreciated that any number of corresponding applications may be utilized with embodiments described herein. In some embodiments, inputs may be received from one or more applications. Furthermore, embodiments provided herein may be utilized for enabling complementary dual display utility. For example, a non-native display and a native display may be utilized in concert without restriction. In some embodiments, a native display is a refreshed based high frame rate display. In some embodiments, native displays may include an LCD display, a CRT display, and LED display, a PLED display, an OLED display, and a plasma display. In some embodiments, a native display may be configured to refresh at a rate of approximately 15 to 120 fps. Some embodiments disclosed native displays are intended to function simultaneously with non-native displays without limitation. Native UI inputs may be handled conventionally by a native API to function in concert with non-native UI inputs.
Non-Native API Functions
The following is a list of non-native API functions for providing dual display capability for embodiments described herein. The list is not intended to be exhaustive or self-limiting in any fashion. Additionally, the nomenclature utilized for the functions described is arbitrary and not intended to be limiting in any fashion. Functionality for each term is also included, but the manner in which that functionality is accomplished is not limited in any manner in embodiments described herein.
Initialize( ): This function operates to initialize a non-native display driver. A non-native display driver includes window management capability.
GetDisplayConfig( ): This function operates to GET a current system's complementary display configuration parameters including: number of complementary display parameters, resolution parameters, screen-size/DPI parameters, greyscale/color parameters, and bit-depth parameters.
AllocateEPDWindow( ): This function operates to allocate the following: a non-native display window from a non-native display driver, a display number, a non-native window size/fullscreen, a support/unsupport dynamic non-native window size change, a support/unsupport content synchronization with other applications, a minimal non-native window size, a non-native window name, and a use auto-update or a use manual-update.
ChangeWindow( ); This function operates to change a window size, or move a window to another display (i.e., between native and non-native displays, or any combination thereof).
CloseWindow( ): This function operates to close a non-native display window on a non-native display.
SetSyncContent( ): This function operates to synchronize content from different application windows on a non-native display.
UpdateWindow( ): This function operates to call a non-native display driver to update a non-native display window.
RefreshEPD( ): This function operates to refresh a non-native display.
PrintScreen( ): This function operates to print a screen displayed on a native display to a non-native display.
Non-Native API Callbacks
In addition to the above API functions, a non-native API may include callbacks. As noted above, a callback is executable code that is passed as an argument to other code or application. Callback allows a lower-level software layer to call a subroutine (or function) defined in a higher-level layer. As above, the following is a list of non-native API callbacks for providing dual display capability for embodiments described herein. The list is not intended to be exhaustive or self-limiting in any fashion. Additionally, the nomenclature utilized for the functions described is arbitrary and not intended to be limiting in any fashion. Functionality for each term is also included, but the manner in which that functionality is accomplished is not limited in any manner in embodiments described herein.
OnEPDKeyDown( ): This callback operates to handle non-native UI key events. In some embodiments, key events include: Page Up, Page Down, Switch Window, Size Up, Size Down, Full-screen/Partial-screen.
OnEPDWindowChange( ): This function operates to handle window allocation on non-native displays. For example, an application may allocate a new window on a non-native display when a user engages a Full/Partial screen key thus changing the non-native display window.
OnEPDSyncChange( ): This function operates to handle window updates. For example, if an application's window supports content synchronization, then the application may need to update window content after a synchronization event occurs.
OnEPDOrientChange( ): This function operates to update a non-native window when a non-native display changes orientation.
A number of use examples are provided for further understanding and clarifying of embodiments of the present invention and are not intended to be limiting in any manner.
A second program, program B 452, may then connect with the non-native display driver and call function Initialize( ) to initialize the non-native display driver at a step 414. At a next step 416, program B 452 calls GetDisplay Config( ) to gather all current non-native display configurations. Window allocation is handled at a next step 418 by calling AllocateEPDWindow( ). In this example, program B 452 requests a partial window. At this point program B's 452 window request triggers OnEPDWindowChange( ), which is a callback function. This allows program A's 450 window to change. Thus, at a next step 422, program A 450 calls UpdateWindow( ) to refresh its non-native display window. Subsequently, at a next step 424, program B 452 calls UpdateWindow( ) to refresh its non-native display window. The method then ends. In this manner,
Furthermore, a program may toggle a window of the program or a “frame” of a window of the program from a native display to a non-native display. A “frame” in the case of a HTML browser program allows an author to divide a browser window into multiple (rectangular) regions. Multiple documents may be displayed in a single window, each within its own frame. Graphical browsers allow these frames to be scrolled independently of each other, and links may update a document displayed in one frame without affecting the others. Therefore, a frame is like a rectangular region inside a window for a browser program or any other program. The following two examples illustrate “toggle window” and “toggle frame”.
Application A originally utilizes multiple windows on one or more native displays. In order to utilize a non-native display, application A changes its implement of creating and updating one of the windows previously displayed on a native display. Application A connects with a non-native display driver, acquires a new non-native display window by a call such as AllocateEPDWindows( ), draws the original window's content to the new non-native window, and then calls UpdateWindow( ) to update the non-native window's content to the non-native display. All remaining original windows may still be displayed on native display, and may receive user input. This method of migrating an application is referred to as, “toggle window.” The method described here is typically used by a dual-display aware program that is written to access both the native and non-native displays at the same time.
Application B originally utilizes multiple frames (regions inside a window) in a window on a native display. In this example, one frame may contain an independently scrollable text content that can be easily displayed on a single display thus requiring scrolling or some other method (such as Page Down button) for access. In order to utilize a non-native display, application B connects with a non-native display driver, acquires a new non-native display window by calling AllocateEPDWindows( ), draws its frame's content to a non-native window, and calls UpdateWindow( ) to update non-native window content to a non-native display. A non-native page down input command may be invoked by a non-native UI, and sent to application B through a non-native API. Application B then processes the non-native page down input command, updates its non-native window content. Application B's frame content may continue to show or hide on native display. That is, the application may continue to receive user input. This method of migrating applications is referred to as, “toggle frame.”
The above “toggle window” and “toggle frame” examples describe applications that are dual-display aware when they are written. For legacy LCD-only applications that have not been migrated to non-native displays, a method for migrating applications referred to as “toggle screen” may be useful to provide non-native display without a need for utilizing any additional programmatic code above the OS framework.
As noted above, non-native displays may not be well-suited for navigating an application due to latency issues. Toggling allows a user to easily migrate an application between a non-native display and a native display so that navigation may proceed on the most appropriate platform. Returning to
It may be noted that printing an application to a non-native display as described for
Additional Features
It may be appreciated that additional features may be incorporated into use models described herein. Any combination of these features may be utilized without departing from the present invention.
Native Display On/Off
In embodiments, in order to conserve battery power while utilizing a non-native display, a user may use an additional UI (which may, in some embodiments, be a non-native UI) to turn the native display on and off. Turning a native display off during non-native display use may reduce power consumption due to the backlight of a native display. When the native display is turned off, the system may be further configured to enter a standby power-saving mode much like a phone device. In standby mode a system would typically “wake-up” in order to update the non-native display when content has been changed (e.g., by a page change when reading a book). When a user turns the native display on the systems may be configured to enter dual display mode operation again.
Video Out of Native or Non-Native Display Screens
In embodiments, to facilitate public viewing of native and non-native display content through a projector, a user may use an additional UI to select whether to project content from either native or non-native displays to a video out port of the device. Traditionally, video output was limited to native display content.
Non-Native Windows Manager
In embodiments, a system utilizing a non-native display windows manger with a non-native display driver as described herein may support multiple windows (of the same program or different programs) on one or more non-native display screens. An additional UI may provide functionality which allows a user to select an active window (from a list of non-native display windows working under the operating system) and display the updated content on the non-native display. Furthermore, the additional UI may provide functionality which allows a user to change the size of window from a partial screen size to a full screen size (and vice versa). Thus, resizing functionality may be provided. These features may be beneficial for users viewing content across multiple windows on a non-native display without requiring them to turn on the native display to navigate content.
While this invention has been described in terms of several embodiments, there are alterations, permutations, and equivalents, which fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing the methods and apparatuses of the present invention. Furthermore, unless explicitly stated, any method embodiments described herein are not constrained to a particular order or sequence. Further, the Abstract is provided herein for convenience and should not be employed to construe or limit the overall invention, which is expressed in the claims. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.
Teng, Albert, Yuan, Jack, Bin, Xiao
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5488572, | May 04 1994 | HEWLETT-PACKARD DEVELOPMENT COMPANY, L P | Portable computer system for docking to an expansion base unit |
5493335, | Jun 30 1993 | Apple Inc | Single sensor color camera with user selectable image record size |
5847698, | Sep 17 1996 | DataVentures, Inc. | Electronic book device |
6336161, | Dec 15 1995 | Texas Instruments Incorporated | Computer configuration system and method with state and restoration from non-volatile semiconductor memory |
6353700, | Apr 07 1998 | Womble Multimedia, Inc. | Method and apparatus for playing an MPEG data file backward |
6628244, | Feb 25 1999 | Sharp Kabushiki Kaisha | Display device arbitrarily attachable to and detachable from other display devices |
6630943, | Sep 21 1999 | Ostendo Technologies, Inc | Method and system for controlling a complementary user interface on a display surface |
6717596, | Feb 18 2000 | Ostendo Technologies, Inc | Method and system for controlling a complementary user interface on a display surface |
6727918, | Feb 18 2000 | Ostendo Technologies, Inc | Method and system for controlling a complementary user interface on a display surface |
6892359, | Feb 18 2000 | Ostendo Technologies, Inc | Method and system for controlling a complementary user interface on a display surface |
6931265, | May 24 2002 | Microsite Technologies, LLC | Wireless mobile device |
7581034, | Nov 23 2004 | Microsoft Technology Licensing, LLC | Sending notifications to auxiliary displays |
7631267, | Feb 17 2006 | Microsoft Technology Licensing, LLC | Auxiliary display sidebar integration |
7634780, | Nov 23 2004 | Microsoft Technology Licensing, LLC | Method and system for exchanging data between computer systems and auxiliary displays |
7711868, | Nov 23 2004 | Microsoft Technology Licensing, LLC | Waking a main computer system to pre-fetch data for an auxiliary computing device |
7748634, | Mar 29 2006 | Amazon Technologies, Inc | Handheld electronic book reader device having dual displays |
7784065, | Feb 07 2005 | Microsoft Technology Licensing, LLC | Interface for consistent program interaction with auxiliary computing devices |
7973738, | Sep 14 2006 | SPRING DESIGN, INC | Electronic devices having complementary dual displays |
20010043234, | |||
20020067319, | |||
20020126133, | |||
20020149541, | |||
20020158812, | |||
20030011534, | |||
20030160771, | |||
20040019621, | |||
20040190080, | |||
20040196210, | |||
20040225613, | |||
20040257367, | |||
20050091302, | |||
20050225556, | |||
20050243020, | |||
20060017659, | |||
20060050090, | |||
20060077127, | |||
20060083194, | |||
20060129855, | |||
20060146056, | |||
20060161977, | |||
20060164324, | |||
20060176271, | |||
20060187142, | |||
20060197724, | |||
20060242590, | |||
20070046562, | |||
20070052615, | |||
20070118671, | |||
20070174918, | |||
20070182663, | |||
20070242061, | |||
20080008001, | |||
20080033996, | |||
20080080010, | |||
20080256468, | |||
EP1205824, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Nov 26 2014 | BIN, XIAO | Quickbiz Holdings Limited, Apia | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0440 | |
Dec 14 2014 | TENG, ALBERT | Quickbiz Holdings Limited, Apia | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0440 | |
Dec 14 2014 | YUAN, JACK | Quickbiz Holdings Limited, Apia | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0440 | |
Nov 16 2016 | SPRING DESIGN CO LTD | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Nov 16 2016 | SPRING DESIGN, INC US | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Nov 16 2016 | LI, RICHARD | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Nov 16 2016 | YUAN, JACK | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Nov 16 2016 | TENG, ALBERT | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Nov 17 2016 | SPRING DESIGN, INC CAYMAN | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Nov 21 2016 | BIN, XIAO | Quickbiz Holdings Limited | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057677 | /0390 | |
Dec 06 2016 | Quickbiz Holdings Limited | SPRING DESIGN, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 057656 | /0903 | |
Oct 01 2018 | Spring Design, Inc. | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Oct 01 2018 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Feb 11 2019 | SMAL: Entity status set to Small. |
Oct 01 2021 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Date | Maintenance Schedule |
Feb 01 2025 | 4 years fee payment window open |
Aug 01 2025 | 6 months grace period start (w surcharge) |
Feb 01 2026 | patent expiry (for year 4) |
Feb 01 2028 | 2 years to revive unintentionally abandoned end. (for year 4) |
Feb 01 2029 | 8 years fee payment window open |
Aug 01 2029 | 6 months grace period start (w surcharge) |
Feb 01 2030 | patent expiry (for year 8) |
Feb 01 2032 | 2 years to revive unintentionally abandoned end. (for year 8) |
Feb 01 2033 | 12 years fee payment window open |
Aug 01 2033 | 6 months grace period start (w surcharge) |
Feb 01 2034 | patent expiry (for year 12) |
Feb 01 2036 | 2 years to revive unintentionally abandoned end. (for year 12) |