Introduction to Outcome Measurement

Objectives

By the end of the session, participants will be able to:

• Explain the principles and purpose of outcome measurement.

• Distinguish between inputs, processes, outputs and outcomes.

• Understand the concepts of validity, reliability, feasibility, sensitivity and specificity.

• Recognise different approaches to measuring outcomes.

• Assess the strengths and limitations of potential outcome measures.

• Use the PICO framework to help define an appropriate question.

• Identify outcome measures appropriate to a particular service, intervention or research context.

Training Methodology

The course combines tutor-led explanation with practical examples, discussion and group exercises.

Rather than considering outcome measurement simply as a theoretical subject, participants will work through realistic examples in which they need to decide what should be measured and why. Particular emphasis is placed on the questions that should be asked before selecting a measure, rather than simply choosing a measure because it is readily available.

Participants will also work with case studies to develop questions using the PICO approach: Population, Intervention, Comparison and Outcome, before considering which outcomes and measures would provide meaningful evidence.

Organisational Impact

Effective outcome measurement can help organisations move beyond reporting activity towards understanding whether services and interventions are achieving their intended objectives.

Participants will be better equipped to contribute to the design, selection and interpretation of outcome measures used in service evaluation, performance monitoring, research and improvement work. This can help organisations develop measures that are not only measurable, but meaningful, reliable and relevant to the decisions they need to make.

Personal Impact

Participants will gain greater confidence in determining what should be measured and in questioning whether an existing measure genuinely reflects the outcome it claims to represent.

They will develop a practical framework for assessing potential outcome measures and will be better able to recognise problems associated with poorly defined, unreliable or invalid measures.

Who Should Attend?

This introductory course is suitable for anyone involved in measuring, evaluating or demonstrating the impact of services, programmes or interventions, including:

• Analysts

• Researchers

• Service managers

• Commissioners

• Clinicians and other healthcare professionals

• Quality and improvement staff

• Project and programme managers

• Public health professionals

• Staff involved in service evaluation or research

Course Outline

1. What Do We Mean by an Outcome?

• Definitions of outcomes and outcome measurement

• Why outcome measurement matters

• Inputs, activities, processes, outputs and outcomes

• Short-, medium- and longer-term outcomes

• The difference between measuring activity and measuring impact

2. What Makes a Good Outcome Measure?

Introduction to the principal characteristics of useful measures:

• Validity: are we actually measuring what we think we are measuring?

• Reliability: would the measurement produce consistent results?

• Feasibility: can the measure realistically be collected and used?

• Sensitivity: can the measure identify the changes or cases we need it to detect?

• Specificity: does the measure distinguish the outcome of interest from other effects?

Participants will consider why a measure can perform well against one criterion but poorly against another, and why selecting an outcome measure often involves balancing competing requirements.

3. Approaches to Outcome Measurement

• Clinical and service outcomes

• Patient and user-reported outcomes

• Objective and subjective measures

• Direct and proxy measures

• Individual and population-level outcomes

• Existing validated measures versus locally developed measures

• Advantages and limitations of different approaches

4. Asking the Right Question

Participants will be introduced to the PICO framework:

• P: Population

• I: Intervention

• C: Comparison

• O: Outcome

Using practical examples, participants will develop structured questions and explore how defining the question properly influences the choice of outcome measure.

5. Choosing an Appropriate Outcome Measure

Through case studies and group discussion, participants will consider:

• What outcome are we actually interested in?

• Is the proposed measure relevant to that outcome?

• How will the information be collected?

• Is the measure sufficiently valid and reliable?

• Is it sensitive enough to detect meaningful change?

• Is collecting the information proportionate and feasible?

• Could the measure create unintended incentives or misleading conclusions?

• Are there existing validated measures that could be used?

6. Practical Exercise

Participants will apply the concepts covered during the session to a practical example.

Working individually or in groups, they will:

1. Define the problem or intervention.

2. Develop an appropriate question using PICO.

3. Identify the outcome or outcomes of interest.

4. Propose possible outcome measures.

5. Assess those measures against validity, reliability, feasibility, sensitivity and specificity.

6. Select and justify the most appropriate measure or combination of measures.

The exercise will conclude with discussion of the choices made and the practical trade-offs involved.

Duration:

 3.5 hours

Pre-requisites:

 None