Training and Consultancy - Critically Appraising Literature

Introduction

Published research can appear authoritative simply because it has been published, but publication does not necessarily mean that the research is well designed, appropriately analysed or relevant to the decisions we need to make. Critical appraisal provides a structured way of looking beyond the conclusions of a paper and considering whether the evidence presented actually supports them.

This one-day course introduces participants to the principles and practical skills needed to critically appraise research literature. Rather than simply reading what the authors say, participants will consider the research question, study design, methodology, analysis, results and conclusions, and assess the strengths and limitations of the evidence presented.

The course introduces the randomised controlled trial and other concepts commonly encountered within research literature. Statistical principles are explained in the context of critical appraisal, including statistical significance, p values, confidence intervals, commonly encountered statistical tests and measures of risk. The emphasis is not on learning statistical calculations, but on understanding what the statistics mean and recognising whether they have been used and interpreted appropriately.

Participants will then bring these different elements together by undertaking a structured critical appraisal of a scientific paper using an approach based on the Critical Appraisal Skills Programme (CASP).

Objectives

By the end of the course, participants will be able to:

Explain the importance of critically appraising research rather than simply accepting published findings.
Identify the principal elements that should be considered when assessing research evidence.
Understand the principles underlying randomised controlled trials and other research designs.
Recognise important sources of bias and limitations within research.
Understand commonly encountered statistical concepts within research literature.
Interpret p values and confidence intervals in the context of published research.
Recognise common approaches to comparing groups statistically.
Understand measures of risk, including relative measures of risk and hazard.
Consider the difference between statistical significance and practical or clinical importance.
Assess whether the conclusions of a paper are supported by its methodology and results.
Apply a structured approach to the critical appraisal of published research.
Consider the relevance and applicability of research findings to practice.

Training Methodology

The course combines tutor-led explanation with discussion, practical examples and structured critical appraisal.

Statistical concepts are introduced in the context in which participants are likely to encounter them within research papers. The emphasis is therefore on interpretation and critical questioning rather than mathematical calculation. Participants will consider what particular statistics tell them, what they do not tell them and what questions they should ask when they encounter them in published research.

A significant component of the course involves applying these principles to a scientific paper. Participants will work through the paper systematically, considering the question being addressed, the methods used, the analysis undertaken, the results obtained and whether the conclusions are justified.

Organisational Impact

Evidence-based practice depends upon the ability to distinguish between evidence that is merely available and evidence that is sufficiently robust and relevant to inform decisions.

Developing critical appraisal skills can help organisations make more informed use of published research when developing services, policies, guidance and interventions. It can also encourage a more questioning approach to evidence, reducing the risk of decisions being based simply on headline findings or conclusions presented by authors.

The course also helps participants develop a better understanding of the statistical evidence commonly presented in research, supporting more informed discussions between analysts, researchers, clinicians, managers and other professionals involved in evidence-based decision-making.

Personal Impact

Participants will develop greater confidence when reading scientific and research literature. Rather than being deterred by unfamiliar terminology or statistical results, they will develop a structured approach for determining what matters and what questions need to be asked.

They will also become better equipped to recognise weaknesses in research design, interpretation and reporting and to distinguish between findings that appear impressive and those that provide genuinely useful evidence.

For participants who do not have a statistical background, the course provides an accessible introduction to some of the statistical concepts they are most likely to encounter when reading research.

Who Should Attend?

This course is suitable for anyone who needs to read, interpret or use research evidence, including:

Clinicians and healthcare professionals
Public health professionals
Researchers
Analysts
Commissioners
Service managers
Policy and strategy staff
Quality and improvement professionals
Postgraduate and doctoral students
Anyone involved in evidence-based practice or decision-making

Course Outline

The course will explore areas including:

The principles of critical appraisal
Research questions and study design
Finding and assessing research evidence
Randomised controlled trials and related research concepts
Bias, validity and sources of uncertainty
Understanding and interpreting research results
Statistical significance and practical significance
P values and confidence intervals
Common statistical approaches used in research literature
Comparisons between groups
Understanding risk and related measures
Assessing the strengths and limitations of research
Interpreting authors' conclusions
Relevance and applicability of research findings
Structured approaches to critical appraisal
Practical appraisal of published research
Applying research evidence to practice

Duration:

1 day

A shorter half-day course, Introduction to Critical Appraisal, is also available. This provides an introduction to the principles of critical appraisal without covering the statistical elements in the same level of detail.

Pre-requisites:

None

Pre-course preparation

Please Note: Participants will be required to undertake some pre-reading of a scientific paper before attending the course. The paper will be used as part of the critical appraisal activities during the session.

Certification

Upon successful completion of this course, delegates will receive a John Varlow | Training and Consultancy Certificate of Completion. This certification recognizes participants' understanding of how to write a structured research proposal and the key components of the research process.