Quality Measurement Proposal
LookingForHelp
Australian Society for Simulation in Healthcare
QUALITY MANAGEMENT PLAN
Australian Society for Simulation in Healthcare
Table of Contents 1 BACKGROUND ........................................................................................................................... 4
1.1 OBLIGATION........................................................................................................................... 4 1.2 DEFINITIONS .......................................................................................................................... 4 1.3 OBJECTIVES ........................................................................................................................... 4
2 PROJECT QUALITY PLANS .................................................................................................... 5 2.1 PLANNING QUALITY............................................................................................................... 5 2.2 WHAT NEEDS TO BE CHECKED? .............................................................................................. 5 2.3 WHAT IS THE MOST APPROPRIATE WAY TO CHECK? ............................................................... 5 2.4 WHEN SHOULD IT BE CARRIED OUT? ...................................................................................... 5 2.5 WHO SHOULD BE INVOLVED? ................................................................................................. 5
3 QUALITY PLANNING FRAMEWORK ................................................................................... 6 3.1 QUALITY MATERIALS ............................................................................................................ 6 3.2 QUALITY EVENTS................................................................................................................... 7 3.3 QUALITY METRICS ................................................................................................................. 8
4 EXAMPLE PROJECT QUALITY PLAN.................................................................................. 9 5 CONTINUOUS IMPROVEMENT ........................................................................................... 10
5.1 STEP-BY-STEP IMPROVEMENT .............................................................................................. 10 5.2 CONTINUOUS IMPROVEMENT FRAMEWORK ......................................................................... 10
Australian Society for Simulation in Healthcare
Document information
Criteria Details
Document title: Quality Management Plan
Document owner: Chair, Australian Society for Simulation in Healthcare
Document author: Anthony Rowley, Lange Consulting & Software
Version: 2 Revision: 2
Issue date: 11 July 2008
Version control
Version Date Description
1 1 May 2008 Draft (based on SIAA template)
2 11 July 2008 Released
3
4
5
6
Document approval
This document requires the following approval:
Name Title Organisation
Dr Leonie Watterson Chair Australian Society for Simulation in Healthcare
Australian Society for Simulation in Healthcare
1 BACKGROUND
1.1 Obligation
1.1.1 Every project should have a Project Quality Plan to ensure whatever is delivered is within the quality expectations of the organisation.
1.1.2 This Quality Management Plan establishes a framework for developing Project Quality Plans.
1.1.3 This Quality Management Plan defines how and when "Quality Events" and "Quality Materials" are applied to a project.
1.2 Definitions
1.2.1 In this Quality Management Plan the following definitions are applied:
Term Definition Quality Materials The artefacts used within an organisation to assist a Project
Manager improve quality in the project e.g. Templates, Standards, Checklists. These materials are used in "Quality Events"
Quality Events How the "Quality Materials" are applied to a project. They are the activities undertaken using "Quality Materials" to validate the quality of the project.
Quality Control The implementation of the "Quality Events" in the "Quality Plan"
Quality Assurance The processes used to verify that deliverables are of acceptable quality and that they meet the completeness and correctness criteria established.
Quality Metrics Statistics captured during the various activities undertaken as part of "Quality Assurance". Metrics are captured to identify areas where quality improvements can be made. They can also be used measure the effectiveness of Continuous Improvement.
Continuous Improvement
Use of captured metrics, and lessons learnt to continually improve quality. They are the main reason for capturing statistics around quality.
Well Engineered Well Engineered means the construction is sound and reliable. It does not necessarily mean it is correct.
Correct Correct means the end results are an accurate reflection of the requirements. It does not necessarily mean it is Well Engineered.
Work Break-down Structure
The defined hierarchy of Milestones, Deliverables and Tasks associated with a project.
1.3 Objectives
1.3.1 The objective of this Quality Management Plan is to ensure Project Quality Plans are developed for projects. Plans should establish a balance between “the quality of the project” and “the quality of deliverables”.
Australian Society for Simulation in Healthcare
2 PROJECT QUALITY PLANS
2.1 Planning Quality
2.1.1 A quality plan needs to cover a number of elements: a) What needs to go through a quality check? b) What is the most appropriate way to check the quality? c) When should it be carried out? d) Who should be involved? e) What "Quality Materials" should be used?
2.2 What needs to be checked?
2.2.1 Typically what needs to be checked are the deliverables. Any significant deliverable from a project should have some form of quality check carried out.
2.2.2 Deliverables need to be prioritised in the context of carrying out quality checks, for instance:
a) a requirements document can be considered significant, whereas b) a memo or weekly report may not be significant.
2.2.3 For the project itself, it may be appropriate to have the project management practices reviewed for quality once the project is initially established. This may be useful to give a Project Board confidence in the team.
2.2.4 When considering what needs to be checked, you also need to differentiate between Correct and Well Engineered.
A Well Engineered bridge may never fall down. If it is doesn't cross the river at the right place, it is not Correct.
2.2.5 Quality checking may be for either Correct or Well Engineered, or it may be for both.
2.3 What is the most appropriate way to check?
2.3.1 To answer this question requires thinking backwards. If the end result is that a particular deliverable should meet a standard, then part of the quality checking should focus on compliance with the standard. This would indicate a Standard Audit could be the best approach.
2.4 When should it be carried out?
2.4.1 Most Quality Events are held just prior to the completion of the delivery. 2.4.2 If there are long development lead times for a deliverable, it might be
sensible to hold earlier Quality Events.
2.5 Who should be involved?
2.5.1 The person(s) who produced the deliverable should be involved. 2.5.2 It is also useful to have some representation from the recipients of the
deliverable in order to ensure you are meeting their needs.
Australian Society for Simulation in Healthcare
3 QUALITY PLANNING FRAMEWORK
3.1 Quality Materials
3.1.1 The following Quality Materials might be used in a quality plan:
Quality Materials Description Standards Standards are instruction documents that detail how a
particular aspect of the project must be undertaken. There can be no deviation from "Standards" unless a formal variation process is undertaken, and approval granted.
Guidelines Guidelines are intended to guide a project rather than dictate how it must be undertaken. Variations do not require formal approval.
Checklists Checklists are lists that can be used as a prompt when undertaking a particular activity. They tend to be accumulated wisdom from many projects.
Templates Templates are blank documents to be used in particular stages of a project. They will usually contain some examples and instructions.
Procedures Procedures outline the steps that should be undertaken in a particular area of a project such as managing risks, or managing time.
Process A Process is a description of how something works. It is different to a Procedure in that a Procedure is a list of steps; i.e. what and when. A Process contains explanations of why and how.
User Guides User Guides provide the theory, principles and detailed instructions as to how to apply the procedures to the project. They contain such information as definitions, reasons for undertaking the steps in the procedure, and roles and responsibilities. They also have example templates.
Example Documents These are examples from prior projects that are good indicators of the type of information, and level of detail that is required in the completed document.
Methodology A Methodology is a collection of processes, procedures, templates and tools to guide a team through the project in a manner suitable for the organisation.
Australian Society for Simulation in Healthcare
3.2 Quality Events
3.2.1 The following Quality Events are typically used to review the quality of deliverables. They tend to have a different mix of reviewing the structure and reviewing the content.
Quality Events Description Expert Review Review of a deliverable by a person who is considered
an expert in the area. The person may not currently hold a position but has expert knowledge in the area. This type of review is good when the focus is on accuracy of content (Correct) rather than of structure (Well Engineered).
Peer Review Review of deliverables by one's peers. Peer reviews are better suited where the emphasis is on structure rather than content. A peer review will focus on ensuring the deliverable is well engineered. Neither an "Expert Review" nor a "Peer Review" is exclusively focused on content or structure. They each however, have a different emphasis.
Multi person Review A review carried out independently by several people is likely to pick up more points however it does bring the difficulty of trying to reconcile different viewpoints. It is best undertaken when the purpose is to gain agreement between different stakeholders. Time should be allowed to reach agreement of conflicting opinions. This may entail a meeting or workshop to resolve differences.
Walk-through A walk-through is a useful technique to validate both the content and structure of a deliverable. Material should be circulated in advance. If particular participants have not done their homework, they should be excluded from the walk-through.
Formal Inspection A formal inspection is a review of a deliverable by an inspector who would typically be external to the Project Team. The inspector captures statistics on suspected defects. It is a useful technique for use with documentation.
Standard Audit A Standard Audit is carried out be a person who is only focused on ensuring the deliverable meets a particular standard(s).
Process Review Where Process is reviewed to ensure all necessary actions are being undertaken, information recorded, and procedures followed. A Process Review is useful to validate the existing processes in an organisation; for example, modification to an existing system may be based on the assumption an existing business process is being followed. If the business process is either not being followed or is different, the modification to the system may have unexpected results.
Australian Society for Simulation in Healthcare
3.3 Quality Metrics
3.3.1 Adding Quality Metrics to a Project Quality Plan removes subjective assessment during Quality Assurance.
3.3.2 A metric is a verifiable measure stated in either quantitative or qualitative terms; for example,
a) “95 percent accuracy” b) “as evaluated by our clients, we are providing above-average service” c) “delivered within 7 days of authorisation”
3.3.3 Metrics must have the following characteristics:
Characteristic Description Clarity of Definition Because the metric is intended to convey a particular
piece of information regarding an aspect of business performance in a summarized manner, it is critical that its underlying definition be stated in a way that clearly explains what is being measured. Each metric should be subject to an assessment process in which the key project stakeholders participate in its definition and agree to the definition's final wording.
Measurability Any metric must be measurable and should be quantifiable within a discrete range.
Controllability Any measurable characteristic of information that is suitable as a metric should reflect some controllable aspect of the project.
Reportability Each metric's definition should provide enough information that can be summarized as a line item in a report.
Australian Society for Simulation in Healthcare
4 EXAMPLE PROJECT QUALITY PLAN 4.1.1 A typical Project Quality Plan may look something like this:
Deliverable Quality Event Quality Materials Quality Metrics Purpose Preliminary Business Case
Expert Review • Business Case template
• All elements of the Template have been completed
Ensure the information is accurate and well constructed prior to submission to Project Board.
Final Business Case
Formal Inspection by Sponsor
• Requirements • Business Case
template
• Approval by the Project Board Ensure the Business Case is in a fit state to be submitted to the Finance Review Committee.
Project Management Plan
Walk-through of early draft
• Project Management Plan template
• All elements of the Template have been completed
Review early draft for completeness.
Peer Review of final draft
• Project Management Plan template
• All elements of the Template have been completed
• Project Schedule achieves contracted timelines
Review final draft for completeness and construction
Programme Design
Expert Review of Programme Design
• Programme Guidelines • Programme Objectives • Previous Programme
Design Examples
• Design is meets all Programme Guidelines
• Design achieves Programme objectives
Compliance with guidelines, requirements and general accuracy.
Formal Inspection by Sponsor
• Programme Guidelines • Programme Objectives
• Design was delivered in accordance with the Project Schedule
• Design meets all Programme Guidelines
• Design achieves Programme objectives
Compliance with contract terms.
4.1.2 Quality should be specified for all project deliverables associated with a project Work Break-down Structure.
Australian Society for Simulation in Healthcare
5 CONTINUOUS IMPROVEMENT
5.1 Step-by-step improvement
5.1.1 What goes wrong in one project is likely to go wrong in other projects unless the cause is identified and fixed.
5.1.2 Continuous improvement is defined as the progressive step-by-step improvement of all aspects of the organisation and its resources. Steps may often be small; however, they can achieve significant impact by the sheer weight of accumulation.
5.1.3 Practical examples of Continuous Improvement include: a) If a template is missing a heading, don't just fix the project document, fix
the template. b) If projects continually fail to meet a standard, either change the standard
or fix the cause. c) If there are no generally accepted availability criteria for business
applications, don't just add some to your requirements. Get them published as corporate criteria.
5.2 Continuous Improvement Framework
5.2.1 The framework for Continuous Improvement is:
Cycle Stage Description Plan Identify an opportunity and plan for change. Do Implement the change on a small scale. Check Use data to analyse the results of the change and
determine whether it made a difference. Act If the change was successful, implement it on a wider
scale and continuously assess your results. If the change did not work, begin the cycle again.