Performance Evaluation
Task:
Task:
Task 20: We monitor trends in energy management system (EnMS) performance and evaluate the effectiveness of the EnMS in achieving intended outcomes and planned results. The methods used, the frequency of the monitoring, and when the results are analyzed and evaluated are defined.
Detailed Guidance: Monitoring and Measurement of the EnMS
- Determine what data or information is needed to establish trends in energy management system (EnMS) performance, including trends in nonconformities, corrective actions, and results in monitoring and measurement, internal and external audits, and evaluations of compliance with applicable energy-related legal and other requirements.
- Determine what data or information is needed to monitor, measure, analyze, and evaluate the results of the EnMS and its effectiveness as related to the intended outcomes of your EnMS and the strategic goals and priorities of your organization.
- Determine the methods to be used, when the monitoring and measurement will be done, and when the results will be analyzed and evaluated.
- Implement the monitoring and measurement analysis of EnMS performance and the evaluation of EnMS effectiveness.
Monitoring, measurement, analysis, and evaluation in the energy management system (EnMS) are not limited to energy performance and energy performance improvement (see Task 21 Monitoring and Measurement of Energy Performance Improvement). You also must monitor, measure, and analyze the performance of the EnMS and evaluate its effectiveness. We evaluate the effectiveness of the EnMS to ensure that it continues to promote, support, and sustain not just energy performance improvements, but the achievement of other intended outcomes and planned results. It also is intended to ensure that the resources allocated by top management for the EnMS are used effectively.
First, you determine what needs to be monitored and measured, and then you determine the methods you will use to ensure valid results. These methods are those needed for monitoring, measurement, analysis, and evaluation. Next, you determine when the monitoring and measurement will be done and when the results will be analyzed and evaluated.
This guidance is relevant to Section 9.1.1 of the ISO 50001:2018 standard.
Both ISO 9001:2015 and ISO 14001:2015 requires that the organization determine what is to be monitored and measured, the methods to be used for valid results, when the monitoring and measurement will be done and when the results will be analyzed and evaluated. And, like ISO 50001:2018, both standards require evaluation of the effectiveness of the management system. So, although there will be differences between the standards in the specific data and metrics to be monitored, measured, analyzed, and evaluated, what needs to be defined and the monitoring, measurement, analysis, and evaluation processes used are at least similar, if not the same.
The ENERGY STAR® Guidelines for Energy Management addresses tracking and monitoring activities from an energy program perspective. Step 5.5 addresses a tracking system to monitor energy program activities. Step 6 discusses the value to energy managers of regular evaluation of the effectiveness of energy management initiatives. Step 6.1 identifies key steps in measuring results, including organizing reports and data from tracking and monitoring efforts. Step 6.2 discusses the advantages of reviewing the action plans and their effectiveness.
The energy management system (EnMS) promotes, supports, and sustains not just energy performance improvement but the achievement of other intended outcomes of the EnMS. You need information to enable your organization to know whether the processes of the EnMS are effective in achieving other expected outcomes. These can be outcomes, in addition to energy performance improvement, that are expected by top management and that may have been identified in Task 1 An EnMS and Your Organization. It is in this task that you start to establish the processes needed to determine the results of the management system and to connect them back to top management’s expectations and the strategic direction and priorities of your organization. Examples of expectations and priorities could be related to cost savings, reduction of carbon dioxide emissions, reduced risks to security of energy supply, improved community relations, and other factors.
To evaluate the effectiveness of the EnMS, use the performance evaluation and improvement processes of the EnMS as outlined below:
- Monitoring, measurement, and analysis (discussed in this task)
- Evaluating compliance with the applicable energy-related legal and other requirements (see Task 2 People and Legal Requirements Affecting the EnMS)
- Performing internal audits to provide information on whether the EnMS is effectively implemented and maintained (see Task 22 Internal Audit)
- Management review of the EnMS’s ongoing suitability, adequacy, effectiveness, and alignment with the strategic direction of the organization (see Task 23 Management Review)
- Finding and fixing nonconformities and problems in the management system (see Task 24 Corrective Actions)
It is possible that your organization may not have implemented the activities mentioned above from Tasks 20–24 yet. Building an EnMS requires a lateral approach because many of these processes are interrelated. Consequently, completion of each task or even each step within a given task, will not necessarily be sequential.
To ensure that the processes for performance evaluation and improvement accurately inform the effectiveness of the energy management system, consider what elements will be monitored, measured, analyzed, and evaluated, in addition to how energy performance improvement will be achieved. The effectiveness of the EnMS is based on the extent to which it achieves planned results and outcomes. Management system results indicate whether the resources allocated to the EnMS by top management are being used effectively.
The basic information on EnMS performance that must be developed for review by top management and evaluation of EnMS effectiveness consists of the following trend information on:
- Nonconformities
- Corrective actions
- Monitoring and measuring results
- Results of EnMS internal audits
- Results of EnMS external audits (if applicable)
- Results of evaluations of compliance with applicable energy-related legal and other requirements
In Task 2 People and Legal Requirements Affecting the EnMS, you already determined what information would be developed to monitor trends in the results of compliance evaluations. These trends provide information on the performance of the EnMS. Like the other items listed above, they are required inputs to management review (see Task 23 Management Review).
The optional Worksheet can be used to identify the compliance evaluation trend information, along with other data and metrics related to trends in EnMS performance that will be monitored, measured, and analyzed for management review and the evaluation of the EnMS effectiveness. In the optional Worksheet an example planning worksheet for monitoring, measurement, analysis, and evaluation of EnMS performance illustrates how this worksheet can be used.
A “trend” generally refers to a direction in which something is developing or changing. In order to determine a direction, data or information is typically collected, monitored, measured, analyzed, and evaluated across time. Data that can be useful for monitoring, measuring, analyzing, and evaluating trends in nonconformities, corrective actions, internal and external audit results, and evaluations of compliance include:
- Number or percentage identified by areas, departments, or functions where they occurred
- Number or percentage identified by task of the 50001 Ready Navigator guidance
The types of trend information to be analyzed will be dictated by what aspects of the EnMS your organization decides is important to monitor and measure as related to expected outcomes, strategic goals, and priorities. If necessary, review the outcomes, strategic goals, and issues developed in Task 1 An EnMS and Your Organization. Develop metrics for the EnMS that align with and support those outcomes, goals, and priorities. This task is an important opportunity to further integrate the EnMS with your organization’s strategic direction. Obtain input from top management as appropriate.
Other examples of the types of data often helpful in developing trend information to evaluate EnMS effectiveness include, but are not limited to the following:
- Nonconformities
- number or percentage of nonconformities by source of identification (e.g., internal audit, external audit, management review, corrective action, data analysis, employee observation, compliance evaluation)
- number of nonconformities that recurred
- Corrective actions
- number or percentage of corrective actions categorized by types of causes (preferably, root causes)
- number or percentage of corrective actions requiring capital planning or capital expenditures
- average cost of the solutions to corrective actions
- number or percentage of corrective actions completed on time
- average number of days between assignment and close-out
- number or percentage of corrective actions failing the evaluation of effectiveness
- monitoring and measuring results (depends on the specific intended outcomes of the EnMS and the organization’s strategic goals and priorities)
- energy costs by type
- number of planned actions to address risks
- number of planned actions that have resulted in the elimination of identified risks
- status of planned actions to address risks and opportunities
- number of investigations of significant deviations in energy performance
- number of comments and suggestions received versus implemented
- status of the external communication plan implementation
- percentage of personnel completing annual energy awareness refresher training
- number of design specifications incorporating energy efficiency requirements
- Internal and external audit results
- number or percentage of nonconformities per audit categorized by significance (major/minor)
- total number of concerns written up per audit
- number or percentage of concerns categorized by task of the 50001 Ready Navigator or section of the ISO 50001 standard
- total number of positive findings per audit
- positive findings categorized by area, department, or function
- percentage of internal audits conducted on schedule (i.e., not delayed or rescheduled)
- frequency of changes made to annual internal audit schedule
- Results of compliance evaluations
- findings categorized by applicable energy-related legal requirement
- findings categorized by applicable other (i.e., voluntary, corporate mandated) energy-related requirement
- actions taken categorized by type of action
- actions taken categorized by cost of action
You will want to establish what will be monitored and measured for EnMS performance, the methods to be used, when the monitoring and measuring will be done, and when the results will be analyzed and evaluated. Although there is no explicit requirement to maintain this as documented information, it can be helpful to capture it using the optional Worksheet or some other approach that suits your organization. In determining when monitoring and measurement will be done and when results will be analyzed and evaluated, give consideration to the timing of internal audits, compliance evaluations, strategic planning, and management reviews.
The next step is to actually implement what you determined was needed for monitoring, measurement, analysis, and evaluation.
(see Task 2 People and Legal Requirements Affecting the EnMS). Information that will be used to develop trends in the results of evaluations of compliance with legal and other requirements should have already been collected. If these compliance evaluations have not already been performed, they should be completed now. Once done, you can initiate the collection, monitoring, measurement, and analysis of the information needed to develop trend in the results. This should be implemented as an integral part of the compliance evaluation process.
As part of this task, you also should be able to implement the monitoring and measurement activities needed to analyze the results related to specific strategic goals and priorities and the achievement of specific intended outcomes. The monitoring, measurement, and analysis of data and other information for development and evaluation of trends in internal audit results can be implemented once internal audits are conducted as part of Task 22 Internal Audit. Monitoring, measurement, and analysis of information needed to develop and evaluate trends in nonconformities and corrective actions can be implemented once nonconformities are identified and corrective actions are undertaken and completed as part of Task 24 Corrective Actions. Again, the monitoring, measurement, analysis, and evaluation should be implemented as integral elements of these processes. And, the results of all monitoring and measurement activities must be retained as documented information.
Top management is responsible for ensuring the ongoing effectiveness of the EnMS. This is accomplished through the process of management review as part of Task 23 Management Review. It is very important that the trends in EnMS performance and the analysis of EnMS results related to intended outcomes be presented to management in a format and at a level that facilitates their review and understanding of the information and enables them to make informed decisions on its effectiveness and on the effective use of resources.
In Task 21 Monitoring and Measurement of Energy Performance Improvement, the monitoring and measurement needed to evaluate energy performance is addressed.
Your organization should evaluate the effectiveness of the EnMS to ensure that it continues to promote, support, and sustain energy and energy-related GHG emissions performance improvements, as well as the achievement of any other intended outcomes and planned results.
As you determine how to include the management of energy-related GHG emissions throughout your EnMS, you’ll want to make sure energy-related GHG emissions are captured in the performance evaluation and improvement processes of the EnMS.
If you do not have an existing 50001 Ready-based EnMS and want to build one that also helps your organization manage energy-related GHG emissions, you should follow the guidance in the “Full Description” tab keeping the following in mind:
- Develop a plan to establish trends. Ensure the performance evaluation and improvement processes of the EnMS include the necessary elements to manage energy-related GHG emissions. These processes include:
- Task 2 People and Legal Requirements Affecting the EnMS
- Task 22 Internal Audit
- Task 23 Management Review
- Task 24 Corrective Actions
- Establish data for measuring and monitoring EnMS performance. Ensure the data collected for measuring and monitoring EnMS performance includes the relevant energy-related GHG emissions data.
- Determine methods to evaluate EnMS performance. Ensure the methods used to monitor and measure EnMS performance consider energy-related GHG emissions.
- Implement the monitoring, measurement, analysis, and evaluation methods. Ensure that energy-related GHG emissions monitoring, measurement, analysis and evaluation are included in the appropriate parts of the EnMS, including:
- Task 2 People and Legal Requirements Affecting the EnMS
- Task 21 Monitoring and Measurement of Energy Performance Improvement
- Task 22 Internal Audit
- Task 23 Management Review
- Task 24 Corrective Actions
If you have an existing 50001 Ready-based EnMS and want to adapt it to manage energy-related GHG emissions, you should:
- Review your plan to establish trends. Review the performance evaluation and improvement processes of the EnMS to determine if they need to be updated to include the necessary elements to manage energy-related GHG emissions. These processes include:
- Task 2 People and Legal Requirements Affecting the EnMS
- Task 22 Internal Audit
- Task 23 Management Review
- Task 24 Corrective Actions
Communicate any changes to these processes to the appropriate personnel.
- Review your data for measuring and monitoring EnMS performance. Review the data collected for measuring and monitoring EnMS performance to ensure energy-related GHG emissions data is considered.
- Review methods to evaluate EnMS performance. Review the methods used to monitor and measure EnMS performance to ensure they are still applicable given the inclusion of energy-related GHG emissions in the EnMS.
- Implement the monitoring, measurement, analysis, and evaluation methods. Ensure that energy-related GHG emissions monitoring, measurement, analysis and evaluation are included in the appropriate parts of the EnMS, including:
- Task 2 People and Legal Requirements Affecting the EnMS
- Task 21 Monitoring and Measurement of Energy Performance Improvement
- Task 22 Internal Audit
- Task 23 Management Review
- Task 24 Corrective Actions
Task 20 Decarbonization Guidance Version: v0.9
Use this task to detail necessary protocols for delivering needed communications to both internal and external parties that emphasize the importance of meeting federal energy requirements for your site.
Your organization should evaluate the effectiveness of the water management system to ensure that it continues to promote, support, and sustain water performance improvements, as well as the achievement of any other intended outcomes and planned results.
Based on the guidance from EPA’s WaterSense at Work step 1 (Making a Commitment), you should integrate water management planning and goal tracking into company performance and sustainability reporting to elevate the importance of water efficiency and maintain accountability.
Establish a regular review cycle of your water management program. This review allows you to evaluate progress, set new goals, and continually improve. Specific areas to focus on include ensuring your strategic goals, objectives, and targets are still realistic; measures are implemented and are still appropriate; and no new costs or technologies exist.
Refer to FEMP’s Water Manual section 4.6 (Track and Report Performance) for further guidance for this task.
Tools and Resources:
- GSA Sustainable Facilities Tool. Total Workspace Score Card. (https://sftool.gov/tws)
This task is part of the CHECK function of the plan-do-check-act process of continual improvement. You have planned and put your EnMS into operation. Now it is time to CHECK on how things are going.
Task 20 focuses on the systems that support your EnMS and includes items such as nonconformities, corrective actions, internal audits, management reviews, etc. Pay particular attention to the monitoring of your ventilation systems to ensure conformity with outdoor air requirements.
The bottom line with task 20 is you want to be able to show that you have checked that your EnMS is functioning as expected, is effective in reducing energy consumption, and that your EnMS systems continually improve, over time. The “Learn More: Examples of data useful in evaluating EnMS effectiveness” pull-down menu under “Data for measuring and monitoring EnMS performance” in the “Full Description” tab of task 20 has an extensive list of items that you could possibly use to trend your EnMS.
Both ISO 9001:2015 and ISO 14001:2015 requires that the organization determine what is to be monitored and measured, the methods to be used for valid results, when the monitoring and measurement will be done and when the results will be analyzed and evaluated. And, like ISO 50001:2018, both standards require evaluation of the effectiveness of the management system. So, although there will be differences between the standards in the specific data and metrics to be monitored, measured, analyzed, and evaluated, what needs to be defined and the monitoring, measurement, analysis, and evaluation processes used are at least similar, if not the same.
The ENERGY STAR® Guidelines for Energy Management addresses tracking and monitoring activities from an energy program perspective. Step 5.5 addresses a tracking system to monitor energy program activities. Step 6 discusses the value to energy managers of regular evaluation of the effectiveness of energy management initiatives. Step 6.1 identifies key steps in measuring results, including organizing reports and data from tracking and monitoring efforts. Step 6.2 discusses the advantages of reviewing the action plans and their effectiveness.
Use this Notes section to save information for communication with other members of your project team, they will be able to see these Notes whey they are logged in to the 50001 Ready Navigator. Notes examples include dates of meeting with relevant personnel for completion of a portion of the task, decisions that have been made about task implementation, or perhaps a link to a file in your organization's shared drive that contains a completed worksheet or template. Please note, do not enter any information in here that you would not want shared with any members of the project team or the site's administrative staff.
Activity (0 Comments)
Add a Note
Log in to track notesName | Type | Description | Version |
---|---|---|---|
50001 Ready Playbook Task 20 | Monitoring and Measurement of the EnMS | PB.20.01.01 |