Efcog effectiveness review. . 3/3 Assisted with gaining approval to revise the Contractor Assurance System (CAS)EFCOG/DOE Effectiveness Kickoff Meeting November 16-17, 2016 Patricia R. Promote continuous improvement and professional development by sharing information among contractors through vehicles such as websites, workshops, and subgroups. ” Brief Description of Best Practice: The best practice is to share lessons learned from the EFCOG Safety Working Group community that may help DOE Contractors through the logistics of preparing for and conducting an effectiveness review as part of their issues management process. Find practical guides, tutorials, and documentation to enhance your knowledge. The survey was available in Microsoft Forms or as an 100% - CAS effectiveness reviews are integrated with other process/ system reviews [Section 2. EFCOG and its member companies continued to enable DOE and the National Nuclear Security Administration advance their national security, clean energy An effective Contractor Assurance System (CAS) enables continuous improvement of Contractor performance, integrates and aligns Contractor management systems, and supports corporate parent governance Community The Energy Facility Contractors Group (EFCOG) The Energy Facility Contractors Group (EFCOG) is a contractor collaboration organization that promotes excellence in all aspects of the operation, management, and integration of DOE facilities in a safe, environmentally sound, eficient, and cost-efective manner through the ongoing exchange of information on lessons learned. Implementing these best practice CatXs can increase the efficiency, effectiveness, and timeliness of the USQ process. 1B CONTENTS - CRD Contractor Requirements Document (CRD) Adopt CRD of DOE Effectiveness reviews are integrated with other process/system reviews (ISMS/QA/etc) Independent assessments are planned/scheduled to ensure all areas of risk are periodically reviewed Independent assessments utilize subject matter experts Multiple external reviews formats are employed (3rd party audits, certifications, parent reviews, etc. For reference, Table 2 details usage of CatXs across the DOE Complex prior This activity will also be included as input to the EM QA Corporate Board Focus Area #3, “Optimize Joint Supplier Evaluation Program (JSEP) Effectiveness and Implementation. Worthington, PhD Director, Office of Health and Safety (AU-10) Office of Environment, Health, Safety and Security Leveraging the expertise and experience of DOE Contractors to address challenges and achieve improvements in cybersecurity; Advocating for strong, effective implementation of Integrated Cybersecurity Management across departmental activities; Developing, and promoting best management and operating practices; Improving the effectiveness of The process of leading indicator development and implementation described in this EFCOG guidance document consists of five primary steps: (1) setting the stage, (2) selecting indicators, (3) conducting a qualitative review, (4) conducting a quantitative review, and (5) using and refining the indicators. Staffing, training, and qualification of its personnel Planning and implementation of operational awareness and assessment activities Communication of assessment results 100 % - CAS effectiveness reviews are integrated with other process/ system reviews [Section 2. ” This guidance document (Guide) was undertaken after considering the DNFSB 2011-1 recommendations as well as input from DOE to contractors, because the Energy Facility Contractors Group (EFCOG) realized that all contractor organizations could benefit from improved rigor and consistency of safety culture evaluations. The analysis will give consideration to the contractor's ability to self-identify emerging and legacy issues rather than having those issues identified by DOE-SR or by external organizations as well as the contractor's implementation of timely and effective corrective actions. The overall objective is to ensure the CAS is adequately controlling the work, managing risks, collecting and implementing Task Group Purpose: The EFCOG Procurement Engineering Task Team is comprised of industry experts in engineering and procurement. Purpose of Contractor Assurance Systems To be effective, a CAS must integrate contractor management, contractor governance, and DOE oversight systems into a single comprehensive site performance management system: The review examines the effectiveness of the EVMS and its compliance with the intent and requirements of EIA-748. The OPR is a management assessment to evaluate the effectiveness and maturity of an ORNL division’s implementation of Contractor Assurance and Integrated Safety Management requirements in terms of functionality, effectiveness and efficiency. 003 Site Integrated Assessment Plan (SIAP); Approach to Safety Management Program Reviews; and SD 450. A list of contacts was developed from existing EFCOG CAS Group distribution lists. The survey was available in Microsoft Forms or as an Use of the EFCOG effectiveness evaluation criteria. DOE line management should periodically provide direction for performing ISM effectiveness reviews based on risks, hazards, and safety performance; and site activities and conditions. Third party audits, peer reviews, independent assessments, and external certification may be used and integrated into the contractor’s assurance system to complement, but not replace, internal assurance systems. The purpose of EFCOG is to promote excellence in all aspects of operation and management of DOE facilities in a safe, environmentally sound, secure, efficient, and cost-effective manner through the ongoing exchange of information and corresponding Risk-based assessment planning is defined, for the purpose of this effort, as the approach to selecting and subsequently scheduling assessments to perform based on criteria related to an entity’s risks or potential barriers to achieving its objectives. Department of Energy Facilities. ” The results of the QA Corporate Board Focus Area #3 will also support the closure of action EM-3. The framework also identifies current approaches, which can be used to validate CAS effectiveness. Best Practices in the Unreviewed Safety Question (USQ) Process in Relation Contract Transition Facility: EFCOG Nuclear and Facility Safety Group (NFS), Safety Basis Subgroup • DOE/NNSA will use Energy Facility Contractors Group (EFCOG) tools to develop Contractor Assurance System (CAS) effectiveness evaluation criteria. The Office of Project Management Policy and Systems (PM-30), along with our contract partners via the Energy Facility Contractor’s Group (EFCOG), have made great strides in automating most of the DOE EVMS Interpretation Handbook (EVMSIH) tests so that we can be assured of one consistent and objective standard to determine whether their systems comply with EIA-748 as required. The team made up of IOSC Subject Matter Experts Review of Effectiveness and Efficiency of Defense Environmental Cleanup Activities of the Department of Energy's Office of Environmental Management: First Report (2021) For over 27 years, the Energy Facility Contractors Group (EFCOG) has worked to improve operations across the Department of Energy (DOE) complex. Such an assessment would evaluate whether system and element implementation is being maintained and whether effectiveness is being sustained and continuously improved. Formed by contractor executives with the goal of working together to address common issues and problems within DOE/National Nuclear Security Administration (NNSA), EFCOG strives to improve operations as well as reduce overall costs and protect worker No more frequently than three-year intervals, the Board of Directors will conduct an assessment of the effectiveness, scope and direction of EFCOG, and a comprehensive strategic planning review, at the request of the EFCOG Chair, to consider EFCOG’s past accomplishments and establish future goals and direction. Monthly performance meeting with the executive leadership team. Fluor management is focusing attention on improving the implementation of CAS elements through a number of internal actions. ISM declarations are typically based on ISM effectiveness reviews and, when needed, comprehensive verification reviews. gov 132 Use of a Threat Assessment Team 6/18/2012 Safeguards & Security 131 Institutional Risk Management Committee as a vital part of a maturing the Contractor Assurance Process 6/6/2012 Safety 130 Operational Performance Reviews (OPR) as a vital part of a maturing Contractor Assurance Process 5/25/2012 Safety 129 Ensuring Notification of (2. This is followed by a determination whether pure compliance has led to effective implementation of the intent of the top-level requirements. b(1)] (Integrated Safety Management System, Quality Assurance, etc. Through the recent history at EFCOG, numerous initiatives had developed guidance, tools, etc. This is accomplished via the combined analyses of EVMS data, artifacts, and information; the EVM system description and supporting operating procedures review; and discussions with contractor and government personnel. The purpose of this correspondence is to inform you of EFCOG’s plans for developing a Best Practices document by April 30, 2017 for transparently and objectively determining the effectiveness of a contractor’s CAS. Improvements have included: Develo p ing revised USQ Procedures based upon monitoring of USQ process o P roposed Expert USQD o Revised existing CatXs to facilitate efficiency A pillar of EFCOG’s success has been the close and effective collaboration we share with DOE/NNSA programs and leadership. CAS drives continuous feedback and performance improvement with identification and correction of negative performance/trends before they become significant issues. This approach would create a vehicle for CAS continuous improvement and organizational learning. Working groups & task teams EFCOG working groups offer participants the opportunity to share information related to their experiences and undertake assignments on identified focus topics in the subject area covered by the working group. The experience further shows that more clarity of DOE’s role in effective ISM implementation is needed. A Guide to Safety Culture Evaluation Approval: A Guide to Safety Culture Evaluation is approved by Energy Facility Contractors Group (EFCOG) and recommended for use by all member contractors. ” A review of the results contained in the ten individual peer review reports indicated that objectives of the peer review process were successfully achieved through establishing and documenting a baseline view of CAS processes that are in place at each SC laboratory as well as their effectiveness and maturity. The lack of any prescribed document numbering process or document management strategy such as periodic reviews for relevancy creates a challenge to potential end users of these documents. Sep 26, 2012 · May 16, 2013 Presenter: Matthew Moury, Deputy Assistant Secretary for Safety, Security and Quality Programs, Office of Environmental Management Topics Covered: EM Program Actions September 26, 2012, Annual ISM and QA Effectiveness Review Declaration FY 2013 Metric, FY 2013 Performance Agreement Improvements Contractor programmatic documents improving Work Control Documents are improving Assure the goals of EFCOG and DOE are met through effective planning and execution. Executive Summary The Energy Facility Contractors Group (EFCOG) is a self-directed group of contractors of U. 2 Effectiveness Assessment Effectiveness assessment begins like compliance assessment, looking for implementation of requirements in procedures and compliance with the procedures in the workplace. Join us for this insightful session and learn how strong partnerships between instructional designers and SMEs can lead to the creation of impactful, effective, and memorable learning experiences. The Energy Facility Contractors Group (EFCOG) The Energy Facility Contractors Group (EFCOG) is a contractor collaboration organization that promotes excellence in all aspects of the operation, management, and integration of DOE facilities in a safe, environmentally sound, efficient, and cost-effective manner through the ongoing exchange of information on lessons learned. At the end of 2023, the EFCOG Board conducted a review of our strategic priorities to ensure we stay in alignment with DOE needs. Compiling and analyzing results of assurance processes, Validating the effectiveness of assurance system processes by using third-party audits, peer reviews, independent assessments, etc. In addition, NNSA has discontinued the process included in NAP-21 for headquarters reviews of the effectiveness of field offices’ oversight approaches, the primary internal control activity included in the policy. The topics and best practices within the guide include: o The use of common Peer review teams have three objectives: first, to help improve the effectiveness of the projects Integrated Project Team (IPT) on individual projects; second, to improve the efficiency and effectiveness of DOE project management processes and metrics; and third, to evaluate cost, schedule, technical maturity, and risk management. Example Measures for CAS Efficiency CAS functions are employed both centrally and in line organizations. Consistency and efficiency can be improved across the DOE enterprise by using a common framework which includes key attributes to validate CAS effectiveness. The review of the contractor assurance system (CAS) focuses on the implementation and effectiveness of the contractor in identifying, correcting, and preventing recurrence of issues that adversely impact the environment, safety, health and mission of the selected DOE site. The SWG will achieve this by: • Advocating for strong, effective implementation of Integrated Safety Management across that stored available EFCOG, DOE, or other relevant information relative to engineered procurement effectiveness. The experience also shows that substantial variances exist across the complex regarding familiarity with ISM, commitment to implementation, and implementation effectiveness. As a result of extensive discussion with DOE and industry leaders, the EFCOG Board established a new set of strategic priorities, discussed A method for validating the effectiveness Self-assessment and feedback and improvement activities An issues management system Process for determining causal factors and corrective actions, conduct effectiveness reviews, and communicate issues/trends Contracting Officer communications Lessons learned programs Metrics and targets that stored available EFCOG, DOE, or other relevant information relative to engineered procurement effectiveness. ” You will also see how tools like Articulate Review 360 can transform the review process, making it more efficient and adaptable to busy SMEs. This effort will require ongoing support from EFCOG to be effective Review and rank NNSA and DOE-AU NSR&D projects Established a Reactor Safety Focus Group Continued Updating of SME Lists * FY18 Key Achievements * Assisted with issuance of DOE Chemical Management Handbook (DOE-HDBK-1139), Vol. 113-01, “Shared Supplier Evaluation Program” included in the EM 45 day review strategic initiative to improve ng DOE directives. It is not meant to be all-inclusive, but rather provide a basis that In addition, National Nuclear Security Administration sites (including Y-12) are expected to conduct an effectiveness review of the expert-based USQ process within twelve months of implementation to ensure the integrity and quality of the USQ process and the resulting documentation is being preserved. Task Description: Currently EFCOG primarily produces documents in the form of guides, white papers, reports, etc. S. b(1)) “A method for validating the effectiveness of assurance system processes. It also assists in identifying areas of improvement around proposed policy or regulatory changes, new or changed processes, and providing subject matter expertise for training The Project Plan documents a formal approach for managing the scope of the EM/EFCOG Quality Assurance Improvement Project. that are or have been uploaded to the EFCOG web page. The CAS Task Team was co-chaired by Pat Worthington of DOE and had both DOE and contractor representation from the major DOE programs (NE, NNSA, EM, and SC). The survey also covers CAS management, effectiveness, assessment process, issue management, performance analysis, feedback Contractor Assurance System Effectiveness Attributes: The following CAS effectiveness attributes were developed by the joint EFCOG/DOE Task Team. In its response, DOE agreed that competent annual reviews of ISM systems were essential for effective implementation of ISM and continuous improvement, and concluded that program offices would continue monitoring the effectiveness of site efforts to sustain and maintain their ISM systems and providing aid and direction as necessary (Abraham, 2002). EFCOG and its member companies continued to enable DOE and the National Nuclear Security Administration advance their national security, clean energy The EFCOG Safety Culture Community of Practice and the Contractor Assurance System (CAS) Working Group developed this document to identify best practices, lessons learned, and tools to help prime contractor personnel support external assessments of their organization efficiently and effectively. Figure 2 shows the process flow. The Working Group assures the goals of EFCOG and DOE are met through effective planning and execution and promotes continuous improvement and professional development by sharing information among contractors through vehicles such as websites, worksh The SWG achieves this by 1) advocating strong, effective implementation of Integrated Safety Management, 2) seeking out, developing, and promoting best management and operating practices, 3) facilitating the exchange of operating experiences and information on safety and regulatory programs and their effectiveness, and designing studies and For over 25 years, the Energy Facility Contractors Group (EFCOG) has worked to improve operations across the Department of Energy (DOE) complex. Develop an EFCOG Best Practice Guide that describes a consensus, objective, and transparent approach for determining CAS program effectiveness by April 30, 2017. CAS compiles and analyzes results of individual assurance processes to provide evidence of safe, secure, and compliant work. to help with engineered procurement effectiveness, but their retrieval was difficult or most sites were unaware of the presence of the material. A survey was developed (Reference A) to gather information from across the DOE Complex to understand how performance analysis is performed and what best practices could be gathered to help increase the efficiency and/or effectiveness of contractor assurance. ” The OPR is a management assessment to evaluate the effectiveness and maturity of an ORNL division’s implementation of Contractor Assurance and Integrated Safety Management requirements in terms of functionality, effectiveness and efficiency. Effectiveness reviews are typically performed six months after all the corrective actions are complete which can allow weaknesses to persist unabated if actions taken early in the management of the issue are ineffective. It builds on and leverages the success and operating experience gained from implementation of QA programs already in place at various EM Sites. Department of Energy (DOE) by serving as a forum to improve operations and share lessons learned across the DOE complex. EFCOG’s Mission Promote excellence in all aspects of the operation, management, and integration of DOE and NNSA facilities in a safe, environmentally sound, efficient and cost-effective manner Provide assistance among EFCOG member companies and collaborate with other EFCOG groups to improve cost-effective energy and water efficiency and environmental performance across the DOE contractor community; Share lessons learned and develop best practices to improve the effectiveness of environmental management and efficiency programs; Brief Description of Best Practice: The Plan of the Day (POD) is a document that is used in Maintenance to highlight Safety, Security, & Quality information that leads into the job specific pre-job briefing. The Project Plan will be updated as needed to reflect ongoing progress. The joint EM-EFCOG approach to enhancing QA signifies the inherent commitment to partnership and collaboration that is required between the contractor community and DOE to proactively improve performance of the EM mission and projects. (2. Aug 3, 2023 · Summary of results from the CAS survey conducted among 15 companies, highlighting the maturity of their CAS programs, improvement areas, and adherence to CAS requirements. The survey ran for approximately 2 months and gathered risk management data from practitioners around the DOE Complex. Table 1 is a list of best practice Categorical Exclusions that have emerged recently. The review is tailored to the performance and risks of divisions, management systems, and the Laboratory; and includes assist opportunities on known Leveraging the expertise and experience of DOE Contractors to address challenges and achieve improvements in cybersecurity; Advocating for strong, effective implementation of Integrated Cybersecurity Management across departmental activities; Developing, and promoting best management and operating practices; Improving the effectiveness of Executive Summary The Energy Facility Contractors Group (EFCOG) is a self-directed group of contractors of U. The task teaming identified relative Aug 16, 2011 · (2. The task teaming identified relative SUMMARY This Toolkit was created by the Energy Facilities Contractors Group (EFCOG) to augment the Office of Health, Safety and Security, Safeguards and Security Survey and Self-Assessment Technical Standard. The purpose of EFCOG is to promote excellence in all aspects of operation and management of DOE facilities in a safe, environmentally sound, secure, efficient, and cost-effective manner through the ongoing exchange of information and corresponding improvement initiatives. 1B ROLL OUT ACTIVITIES EFCOG/DOE CAS Effectiveness – November 16, 2016 * BACKGROUND * SD 226. John McDonald described the results of the EFCOG/DOE CAS Effectiveness Task Team. The attributes and additional sub-elements are provided in Attachment 3. 2. This Toolkit provides a variety of samples and tools that may be used to complement the overall assessment process. Objectives and associated risks may be related to safety, security, quality, or other functions. 100% - CAS effectiveness reviews are integrated with other process/ system reviews [Section 2. ) A survey was developed (Reference A) to gather information from across the DOE Complex to understand how performance analysis is performed and what best practices could be gathered to help increase the efficiency and/or effectiveness of contractor assurance. To this end, DOE!NNSA will use the Energy Facility Contractors Group (EFCOG)-generated CAS maturity tool and EFCOG Best Practice Contractor Assurance System Effectiveness Validation Lines of Inquiry (LOI) to develop CAS effectiveness criteria, including possible quantitative effectiv 0 documents available in our comprehensive collection of Efcog Guide Performance Of Effectiveness Reviews resources. Formed by contractor executives with the goal of working together to address common issues and problems within DOE/National Nuclear Security Administration (NNSA), EFCOG strives to improve operations as well as reduce overall costs and protect worker NOTE FROM THE CHAIR The Energy Facility Contractors Group (EFCOG) continued in 2022 to provide a vital service for the U. This will Peer review teams focus on three areas: first, to help improve the effectiveness of the projects Integrated Project Team (IPT) on individual projects; second, to improve the efficiency and effectiveness of DOE project management processes and metrics; and third, to provide an opportunity for PM professional development and knowledge management. Lessons learned/operating experiences for continuous improvement are derived from this review. ). Following development, DOE/NNSA will evaluate how best to capture the new criteria for Departmental use. In general, Fluor has an effective process for scheduling and performing internal independent assessments, including annual reviews of safety management programs that are required by the documented safety analysis. The purpose of EFCOG is to promote excellence in all aspects of operation and management of DOE facilities in a safe, environmentally sound, secure, efficient, and cost-effective manner through the ongoing exchange of information and corresponding Assessment, Contractor Assurance, Integrated Safety Management Acquisition & Contracting Electrical Safety Post-Job Briefing/Post-Work Review: A review and analysis conducted at the completion of work activities aimed at improving the effectiveness of the activity. The Safety Working Group (SWG) is chartered to support member companies in attaining and maintaining the highest levels safety and regulatory performance in the operation of Department of Energy (DOE)/National Nuclear Security Administration (NNSA) facilities/projects. This groups primary focus is to identify opportunities for improvement with regards to the procurement engineering processes, such as commercial grade dedication (CGD), and develop best practices and lessons learned based on those identified opportunities. Dec 26, 2024 · Comprehensive overview of CAS survey results from 15 companies, highlighting mature programs and improvement areas in metrics, analysis, and governance. The TWG takes a leadership role in leveraging collaborative initiatives that support training. 2, Functions, Responsibilities and Authorities SD 226. With increasing value, attention, and scrutiny being placed on effective Contractor Assurance Systems (CAS) by various segments of the DOE, the DNFSB, and contractors, the need 3. • DOE/NNSA leadership will continue to champion effective measures to address safety staffing, retention, training, and qualification Assure the goals of EFCOG and DOE are met through effective planning and execution. Assessment, Contractor Assurance, Integrated Safety Management Acquisition & Contracting Electrical Safety Best Practice CatXs The USQ Subgroup has been monitoring CatXs across the DOE Complex for approximately seven years. NOTE FROM THE CHAIR The Energy Facility Contractors Group (EFCOG) continued in 2022 to provide a vital service for the U. The Project Plan documents a formal The Department of Energy's Energy. Members of the Energy Facility Contractors Group (EFCOG), Safeguards and Security Working Group, Information Security Subgroup Incidents of Security Concern (IOSC) Team prepared this best practice guide. The goal is for the Best Practice to be a consensus of team participants. CAS program implementation and monitoring CAS effectiveness review joint EFCOG/DOE Task Team (Attachment 1) identified multiple approaches used by DOE and NNSA contractors to support validation of CAS effectiveness including: Contractor Peer Review Parent Company Assessment Pre-Performance Evaluation and Measurement Plans (PEMP) Review Self A survey was developed (Reference A) to gather information from across the DOE Complex to understand how performance analysis is performed and what best practices could be gathered to help increase the efficiency and/or effectiveness of contractor assurance. Benefits of membership include working group and workshop participation where information is received about techniques, methods, programs, and lessons learned Look at next steps to improve CAS effectiveness, building on the plan of 2 years ago Work Planning and Control next steps Revisit previous efforts to enhance the WP&C process and determine next steps to improve Regulatory reform Revisit 2018 EFCOG SWG recommendations with DOE and identify next steps of DOE and EFCOG involvement Assessment, Contractor Assurance, Integrated Safety Management Acquisition & Contracting Electrical Safety After a CAS has been determined to be Implemented and Effective, the CAS assessment can be streamlined to focus on sustainability. Brief Description of Best Practice: The best practice is to share lessons learned from the EFCOG Safety Working Group community that may help DOE Contractors through the logistics of preparing for and conducting an effectiveness review as part of their issues management process. For the purposes of this guide, “best practices” are “positive examples of work processes, procedures, good ideas, or effective solutions. , Identifying, performing, and documenting periodic self-assessment and feedback and improvement activities, (2. This mandate is more important today than it has ever been as budgetary restrictions are realized across the complex. Independent parent organization assessments of a contractor’s CAS can be used effectively to For example, BOP 10. Once developed, the survey was activated and routed through EFCOG and the DOE Complex. The Working Group will focus on practical and effective solutions to complex-wide challenges; promote open communication and sharing of lessons learned and best practices and leverage inter-site and inter-contractor solutions to achieve enterprise-wide improvement while supporting cost-effective and efficient solutions. The review is tailored to the performance and risks of divisions, management systems, and the Laboratory; and includes assist opportunities on known A method for validating the effectiveness Self-assessment and feedback and improvement activities An issues management system Process for determining causal factors and corrective actions, conduct effectiveness reviews, and communicate issues/trends Contracting Officer communications Lessons learned programs Metrics and targets How the success of the Best Practice was measured:This best practice paper has helped ensure Compliant USQ processes, while streamlining the review process, increasing its efficiency, effectiveness, and timeliness. The Training Working Group (TWG) was established to drive efficiency and effectiveness in training conducted for the DOE. CAS includes a method to evaluate the effectiveness of assurance system processes by using third-party audits, peer reviews, independent assessments, effectiveness reviews, etc. Jan 23, 2005 · ld be developed. rkui 7wbk doni kn4zx hee pg9tb ncy8am 7tc koraha kz7cdd2