Embodiments relate to enabling software to interface with a power consumption telemetry system. A process may have tagging instructions that interface with an energy estimation engine. While the energy estimation engine is logging energy consumption by the process, the process may also mark, tag, or otherwise delineate periods of processing during the execution time of the process. The logic of the process may determine how such periods should be labeled and when they being and end. The tagged periods are correlated with energy consumed by the process so that details of what the process was doing during different periods of energy consumption may be understood.
|
8. A computing device comprising:
processing hardware;
storage hardware storing an operating system, executable images executable by the processing hardware and when loaded by the operating system executed as processes managed by the operating system;
the storage hardware further storing information configured to cause the processing hardware to perform an energy estimating process comprising:
providing an application programming interface (api);
executing the operating system;
beginning, by the operating system, execution of a process managed by the operating system, wherein beginning execution of the process comprises creating the process by loading a corresponding executable image from the storage hardware;
terminating the process by the operating system;
receiving, via the api, tag requests from the process, each tag request comprising a respective tag value;
estimating first amounts of energy consumed by the process for respective periods that begin with the tag requests; and
storing the first amounts in association with an identifier that identifies the process and in association with the tag value.
16. A method performed by a computing device, the method comprising:
executing processes by an operating system, the processes comprising tag request instructions configured to submit tag requests to an application programming interface (api) on the computing device;
automatically computing estimates of energy consumed by the processes based on power and or processing measures received from hardware of the computing device, wherein each estimate is of energy consumed only by a corresponding process, wherein consumed energy is estimated for processes being executed by the operating system;
issuing tag requests by executing the tag instructions when executing the processes, each tag request invoking the api;
for each tag request issued by a process to the api, based thereon, computing a tagged estimate of energy consumed by the process for a period of time determined by the tag request; and
storing the estimates of energy consumed by the processes in association with respective identifiers of the processes, and storing the tagged estimates of energy in association with the identifiers of whichever of the processes submitted the tag requests.
1. A method performed by a computing device, the method comprising:
executing an operating system, the operating system managing the execution of arbitrary processes;
repeatedly obtaining timestamped estimates of energy consumptions of the respective arbitrary processes and storing corresponding energy information, the energy information comprising process identifiers of the respective arbitrary processes stored in association with the respective timestamped estimates of energy consumption of the arbitrary processes, each process having a respective set of timestamped estimates associated therewith by its corresponding process identifier, the timestamped estimates having been computed based on obtained allotments of processor resources of the computing device for execution of the respective arbitrary processes;
providing an application programming interface (api) on the computing device, and while executing the arbitrary processes, receiving tag requests associated with the estimating energy consumption, the tag requests submitted to the api by the arbitrary processes when executing, each tag request comprising a respective tag identifier determined by the corresponding process;
responding to a tag request received by the api by determining a tagged energy consumption estimate, the tagged energy consumption estimate estimated for a period of execution of whichever process submitted the tag request, a start of the period corresponding to receipt or generation of the tag request; and
storing the tag identifier of the tag request and the tagged energy consumption estimate in the energy information, the tag identifier and the tagged energy consumption estimate both stored in association with the process identifier of whichever process submitted the tag request.
2. A method according to
3. A method according to
4. A method according to
5. A method according to
6. A method according to
7. A method according to
9. A computing device according to
10. A computing device according to
11. A computing device according to
12. A computing device according to
13. A computing device according to
14. A computing device according to
15. A computing device according to
17. A method according to
18. A method according to
19. A method according to
20. A method according to
|
This application claims an invention which was disclosed in Provisional Application No. 62/445,212, filed Jan. 11, 2017, entitled “PROCESS-LEVEL ACTIVITY TAGGING”. The benefit under 35 USC § 119(e) of the United States provisional application is hereby claimed, and the aforementioned application is hereby incorporated herein by reference.
Computing devices consume energy to operate. Components of computing devices such as processors, displays, buses, network interfaces, storage, etc., all consume energy. It is usually desirable to minimize the amount of energy needed by a computing device, for instance to extend battery life or to reduce the considerable amount of energy consumed by server farms. The software executing on a computing device largely determines how much energy will be consumed. The many design and engineering choices that are made to build a unit of software can significantly influence the amount of power necessary at any given moment. While efficiency in general is always helpful for reducing energy consumption, it can be difficult to predict how specific design and coding choices may affect power needs. The energy consumption of an application, for instance, can significantly depend on how the application is used, which particular hardware components are used, what other software is concurrently executing, etc. These variables are amplified when extended to a large population of devices executing a same piece of software. Modeling and study of individual devices has limits. Production feedback about power use can be helpful.
There are few tools to help software developers understand how energy is consumed when software is employed by diverse users for production, and there have been few tools that provide information about systemic energy consumption for a large population of devices. Some tools that provide production feedback have only provided per-application energy consumption information. Other tools have provided system-level information about how much energy is consumed by different types of work. Tools that provide code-level information about an application's energy consumption have been devised. However, these tools have relied on code analysis and energy modeling to predict energy consumption traits. Such tools have not been suitable for production settings and have been incapable of providing detailed information about how software consumes energy in production devices. Furthermore, no energy analysis tools have enabled the logic of applications to arbitrarily determine how and when energy consumption is measured. Energy consumption analysis has been modeled and measured in ways that are transparent to software that is being modeled or measured.
Techniques described below relate to enabling a software developer to customize how and when energy consumption is measured when an application is executing.
The following summary is included only to introduce some concepts discussed in the Detailed Description below. This summary is not comprehensive and is not intended to delineate the scope of the claimed subject matter, which is set forth by the claims presented at the end.
Embodiments relate to enabling software to interface with a power consumption telemetry system. A process may have tagging instructions that interface with an energy estimation engine. While the energy estimation engine is logging energy consumption by the process, the process may also mark, tag, or otherwise delineate periods of processing during the execution time of the process. The logic of the process may determine how such periods should be labeled and when they begin and end. The tagged periods are correlated with energy consumed by the process so that details of what the process was doing during different periods of energy consumption may be understood.
Many of the attendant features will be explained below with reference to the following detailed description considered in connection with the accompanying drawings.
The present description will be better understood from the following detailed description read in light of the accompanying drawings, wherein like reference numerals are used to designate like parts in the accompanying description.
The operating system 104 also includes an energy estimation engine 108. The energy estimation engine 108 receives power information from the process manager 106 and optionally from the hardware components 102. The energy estimation engine 108 uses the power information to estimate total energy consumption at regular intervals, estimate breakdowns of energy consumption by hardware device, process, application, or other components. The energy estimates are recorded to a database 110.
A telemetry client 112 periodically transmits the database 110 via a network 114 to an aggregation service 114. The aggregation service 116 is a network service that also receives energy telemetry data from other computing devices 100 that also execute energy estimation engines. The telemetry client 112 and aggregation service 114 may be implemented using known telemetry techniques or systems, but modified as necessary to report energy consumption data. The aggregation service 114 combines the energy telemetry data from the computing devices 100 into a global dataset. The combined energy telemetry data in the global dataset can be queried. Preferably, depending on the level of detail available and whether sensitive information is accessible, an application developer can only access the aggregated energy data relevant to that developer's software.
The energy estimation engine 108 can be implemented in many ways. For instance, the energy estimation engine 108 may run as a background process(es) with kernel-mode and user-mode components. In any case, the energy estimation engine 108 should be able to estimate and record how much energy is consumed by each process over increments of time. That is, power use is estimated and stored on a per-process basis as a function of time. Other power estimates may also be computed, for instance per-hardware component, energy consumed as a function of whether a display is on or off, energy consumed by a process broken down by hardware component, etc.
As noted, how energy consumption is estimated is not significant. In one embodiment, the energy estimation engine implements a mathematical model of energy supply and consumption. The model may take as inputs power data measured by or from one or more of the hardware components. In one embodiment, power measurements are continuously sampled at short intervals of time. The power samples may include power being provided by one or more power supplies (e.g., battery, line-in, solar element, etc.) and power being drawn by each of the hardware components. The model may have default parameters that can be tuned by device profiles from hardware vendors, chip manufacturers, etc. As noted, power measures may be snapshotted or sampled periodically. The power measures can be combined by the mathematical model to estimate energy consumption over different periods of time. In short, the energy estimation engine computes energy consumption as a function of time and at varying levels of detail.
In one embodiment, only (or at the least) CPU-related power data is captured and used to estimate energy consumption. At each sample point/interval, the process manager 104 may identify what proportion of CPU work (e.g., cycles) was divvied out to which processes. This information may be combined later with estimations of CPU energy consumption to estimate how much energy each process has used as a function of time. To estimate total (and/or CPU) energy consumption at a point in time (e.g., a most recent sample time), the mathematical energy model may require a series of recent power samples (CPU and/or other hardware components). Thus, estimation of per-process energy consumption may lag recent power measures. To account for this lag, the mathematical model may work with its own internal units—energy counters—that represent proportional power supplied and consumed. The proportional power can change from one sample period to the next. When samples are taken, these temporary proportional power estimates for respective elements (processes, some hardware components, etc.) are computed in the form of tokens or counters that represent proportional power at a slice of time. Some hardware components may have energy computed directly. When a total energy estimate becomes available for a sample period, the energy of each monitored element (process, hardware component, etc.) may be readily computed per its previously estimated ratio in the form of energy counters. This technique, which also reduces the computation load of energy estimation by allowing energy estimation to be performed intermittently, will be further explained below.
Although shown as a single unit in
As mentioned above, energy consumption can be broken down and associated in numerous ways. Energy may be estimated for each process. Processes may be uniquely identified by their process ID and a timestamp. A hash of this unique ID may be used as in index for the data in the cache 122 and the database 110. If other attributes of a process are tracked, such as image name, package name, etc., then a corresponding rich set of energy statistics at multiple levels of detail can be tracked. However, to track energy consumption at a granularity finer than the process level, additional techniques are used, as described with reference to
When the energy estimation interval ends, the energy estimation process 124 computes the energy consumption values, for instance in millijoules (mJ), for each process at each sample interval (t1, t2, . . . ). For example, if time t4 has a total of 500 mJ, then processes p1, p2, p3, and p4 would be recorded as having consumed 200 mJ, 200 mJ, 0 mJ, and 100 mJ, respectively.
As described above, the energy estimation engine 108 computes a running estimate of energy consumption on a per-process basis in a way that is transparent to processes. The energy use of any arbitrary process may be estimated without requiring any special action by the process; application source code and/or executable code do not need to be modified or specially instrumented to estimate energy consumption. Energy consumption of any arbitrary process can be estimated. However, some processes may run for long periods of time, perform many diverse tasks, and handle diverse types of information. The internal logic and behavior of a process may have a significant correlation with power consumption of the process. Some tasks of a process may require more power than others, and some information may require more energy to process than other information.
For example, if a process is the loaded executable code of a web browser application, how the browser consumes energy may vary significantly from one website to the next. If the process is an audio renderer, for example, which audio effects are applied might vary from one audio stream to the next. Any variable behavior or data of a process might be significant to understanding energy consumption. However, previously, insight into what a process is doing or what information it is handling as it consumes energy has not been possible. That is, it has not been possible to correlate, in a flexible process-controlled way, internal process state and behavior of a process with the process's energy consumption.
To enable application tagging, the energy estimation engine 108 may be provided with an interface 172 through which the processes 170 may submit tag requests 174. The energy estimation engine 108 also has a tagging component 176 for handling the tag requests 174. As will be described, the cache 122, energy database 110, and the aggregation service 114 are all modified to handle tag data. The tagging component receives an incoming tag request and stores it in the cache 122
Returning to
The tag value may be any arbitrary piece of data, perhaps stored in a string. The value of the tag is determined by the process and may depend on runtime data or logic of the process. The location of a tagging/call request in the source code (and in corresponding compiled code) may be determined by the developer who writes the source code for the process. Any arbitrary process may make a tag request at any time using any arbitrary value chosen by the process. In sum, tagging is part of the logic and code of the process.
A tag is considered to continue to be in effect until the tag is submitted again or until a new tag is submitted. As shown in
Regarding the sampling of the process's energy counter when a tag is submitted, the sample functions as an offset from the last sample computed during the last periodic (e.g., every 60 seconds) sampling cycle. This allows the subsequent periodic counter samples for the process to be computed from the offset and the subsequent periodic counter samples of the process. When a tag is closed another energy counter sample is taken. The total energy for the span of the tagged period can be determined from the offsets and the periodic samples between the start and end of the tagged period. This technique helps keep the overhead of tagging low, since only one or two more samples need to be taken.
Consider the following example. Suppose a process is a web browser. In addition, suppose the browser submits a tag for each new page visited by the browser. This will allow a developer of the browser to look at collected energy data and see which pages consume how much energy, for instance.
At time-0 (0 seconds) the browser process starts and its start is logged to the cache.
At time-5 (five seconds after the process starts) the browser opens a page for the domain “msn.com”. The browser samples its energy counter which is 10, and then the browser reports (tag=“msn.com”, counter=10) to the engine, which the engine logs to the cache along with the time of request and any adjunct information.
At time-30 (30 seconds since the process started), the browser starts working on behalf of another domain, e.g., “cnn.com”. The process's energy counter is sampled again and is 100. The browser process reports (tag=“cnn.com”, counter=100) to the engine, which logs the tag and counter to the cache in association with the browser process. Furthermore, for termination of the first tag, the engine logs (“msn.com”, 100−10); 100−10, or 90, which is the total energy count for the process during the time from when “msn.com” was logged to the time when “msn.com” was ended.
At time-60 (60 seconds) the sampling process 120 performs its periodic duty. The counters for all processes are sampled and stored in the cache in association with the hashes/identifiers of the respective processes. The sampled counter for the browser process is 500, and the engine logs (tag=“cnn.com”, counter=500−100) for the browser process; 500−100, or 400, which is the energy count of the process spanning from the start of the “cnn.com” tag to time-60.
At time-90 (90 seconds) the browser starts working on behalf of domain “xyz.com”. The browser process's energy counter is sampled to be 550. The process reports (tag=“xyz.com”, counter=550−500), or 50, which is the energy count of the process from time-60 to the time of the “xyz.com” tagging.
At this point, the cache includes at least the following tag and counter information: msn.com=90, cnn.com=400+50=450. The “xyz.com” tag is still open. The counters will be converted to actual energy estimates when the energy estimation process 124 is invoked.
As mentioned above, for components such as the CPU and perhaps others (e.g., network interface), the energy counters are temporary proxies for energy consumption. Counters associated with a process may represent CPU cycles, for instance, or some other measure of CPU work, for weights of instructions executed. When the energy estimation process 124 begins its duty cycle after an estimation period has passed (e.g., 60 minutes), the energy estimation engine converts the proxy counters to actual energy numbers. A global/total energy counter for a given component (e.g., CPU) dictates how much energy an energy counter represents for that energy estimation cycle. Given energy counters for each process, computing energy per tag is a straightforward process.
Another thing that the engine will do at the end of an estimation period is determine if there are any open tags; such tags will be closed for accounting and then reopened again with a different energy counter.
It should be appreciated that different techniques for logging energy consumption and tagging processes may be used. Many of the details above are designed to minimize overhead. If a different energy estimation technique is used (for instance, dedicated energy sampling hardware), direct energy sampling might be used without the need for proxy counters. If energy usages can be computed immediately, for example if a different or simpler (e.g., CPU-only) model is used, then the details of logging energy will likely differ. Whatever transparent energy logging system is used, the objective is to allow processes to tie into that system and self-annotate their energy usage logs with their own information. The level of detail captured may be altered according to overhead and other requirements or limitations. For example, only totals and durations might be tallied and start and stop times of processes and tags might be disregarded or removed by consolidation.
Description of special cases has been omitted but it will be readily apparent how these may be handled. For example, processes that terminate unexpectedly, processes with same image names but different images, and other potential conditions should be taken into account. Thread tagging may be implemented using the same technique outlined above, with some differences that will likely depend on the particular platform. For instance, threads might not be automatically logged and may instead need to “opt in” to logging by the estimation engine.
The embodiments described herein may be considered to be applicable to any type of execution unit; application packages, processes, threads, or other units of execution managed by the operating system. In one embodiment, the processes comprise executable instructions that include executable code for making tag requests (tag request instructions). The tag request instructions correspond to source code that includes system calls, methods, etc. that specify tag requests, including parameters such as a tag parameter for passing a tag value to the energy estimation engine. That is, the tag request instructions are compiled from source code having source code tag request statements (system calls, API calls, method invocations, etc.). The source code may be production-style code that does not include other code for estimating energy. Similarly, the compiled images stored on persistent media of the computing device need not be instrumented or modified to include additional instructions or overhead for estimating energy. All that is necessary to tag energy estimates is for a developer to include the appropriate tagging calls/statements in their source code. The developer chooses where in the code tagging will occur and possibly parameters such as a tag value/label, informational parameters, etc. The source code is compiled in ordinary fashion without requiring insertion of special instrumentation code/instructions or other overhead. Tagging and energy estimation may be performed in production settings with negligible overhead.
Other techniques might be used to keep logging and tagging overhead low. For example, because the number of processes that have executed can be prolific, the cache could start to become excessively large if data for each process is stored. The entries in the cache and or database might be ordered by total energy and only the N topmost energy consuming processes may be retained. Adjustments may be needed to keep long-running low-energy processes from falling out of view.
The computing device 100 may have one or more displays 350, a network interface 354 (or several), as well as storage hardware 356 and processing hardware 358, which may be a combination of any one or more: central processing units, graphics processing units, analog-to-digital converters, bus chips, FPGAs, ASICs, Application-specific Standard Products (ASSPs), or Complex Programmable Logic Devices (CPLDs), etc. The storage hardware 356 may be any combination of magnetic storage, static memory, volatile memory, non-volatile memory, optically or magnetically readable matter, etc. The meaning of the terms “storage” and “storage hardware”, as used herein does not refer to signals or energy per se, but rather refers to physical apparatuses and states of matter. The hardware elements of the computing device 100 may cooperate in ways well understood in the art of machine computing. In addition, input devices may be integrated with or in communication with the computing device 100. The computing device 100 may have any form-factor or may be used in any type of encompassing device. The computing device 100 may be in the form of a handheld device such as a smartphone, a tablet computer, a gaming device, a server, a rack-mounted or backplaned computer-on-a-board, a system-on-a-chip, or others.
Embodiments and features discussed above can be realized in the form of information stored in volatile or non-volatile computer or device readable storage hardware. This is deemed to include at least hardware such as optical storage (e.g., compact-disk read-only memory (CD-ROM)), magnetic media, flash read-only memory (ROM), or any means of storing digital information in to be readily available for the processing hardware 358. The stored information can be in the form of machine executable instructions (e.g., compiled executable binary code), source code, bytecode, or any other information that can be used to enable or configure computing devices to perform the various embodiments discussed above. This is also considered to include at least volatile memory such as random-access memory (RAM) and/or virtual memory storing information such as central processing unit (CPU) instructions during execution of a program carrying out an embodiment, as well as non-volatile media storing information that allows a program or executable to be loaded and executed. The embodiments and features can be performed on any type of computing device, including portable devices, workstations, servers, mobile wireless devices, and so on.
Ergan, Cenk, Mariani, Rico, Sundaram, Vijay, Prabhakar, Sandeep, Ezaz, Taofiq, Calinov, Iulian Doroftei, Heenan, Brandon Michael, Holmes, Zachary Sandburg, Patterson, Joshua Daniel, Shah, Samarth Harish
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
7272730, | Jul 31 2003 | Hewlett Packard Enterprise Development LP | Application-driven method and apparatus for limiting power consumption in a processor-controlled hardware platform |
9372523, | Jun 30 2010 | Fujitsu Limited | Calculating amount of power consumed by a user's application in multi-user computing environment basing upon counters information |
20060155415, | |||
20100180158, | |||
20110040990, | |||
20110072378, | |||
20110191609, | |||
20110191721, | |||
20120011378, | |||
20120260111, | |||
20130007255, | |||
20130231894, | |||
20150227445, | |||
20150377937, | |||
WO2012146821, | |||
WO2013002871, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 13 2017 | CALINOV, IULIAN DOROFTEI | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 13 2017 | EZAZ, TAOFIQ | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 13 2017 | PATTERSON, JOSHUA DANIEL | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 14 2017 | PRABHAKAR, SANDEEP | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 17 2017 | SHAH, SAMARTH HARISH | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 18 2017 | HEENAN, BRANDON MICHAEL | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 19 2017 | ERGAN, CENK | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 19 2017 | MARIANI, RICO | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 23 2017 | SUNDARAM, VIJAY | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Jan 26 2017 | HOLMES, ZACHARY SANDBURG | Microsoft Technology Licensing, LLC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 041388 | /0347 | |
Feb 27 2017 | Microsoft Technology Licensing, LLC | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Feb 15 2023 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Sep 03 2022 | 4 years fee payment window open |
Mar 03 2023 | 6 months grace period start (w surcharge) |
Sep 03 2023 | patent expiry (for year 4) |
Sep 03 2025 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 03 2026 | 8 years fee payment window open |
Mar 03 2027 | 6 months grace period start (w surcharge) |
Sep 03 2027 | patent expiry (for year 8) |
Sep 03 2029 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 03 2030 | 12 years fee payment window open |
Mar 03 2031 | 6 months grace period start (w surcharge) |
Sep 03 2031 | patent expiry (for year 12) |
Sep 03 2033 | 2 years to revive unintentionally abandoned end. (for year 12) |