How do we evaluate research studies?

Checklist

In order to be as fair and objective as possible, we evaluate each research study using the same checklist.

This checklist is a modified and much simplified version of the checklists published by the National Institute for Health and Clinical Excellence www.nice.org.uk

Our checklist enables us to answer key questions such as

What is the purpose of this study?
Did it achieve its purpose?
Were the researchers independent?
Was the study relevant to people with autism?
What kind of study was it? For example, was it a random controlled trial?
Was the research carried out in a rigorous and robust manner?
Did the study include sufficient information about the participants?
Did the study include sufficient information about the intervention?
Were the measures used to evaluate the intervention appropriate?
What was the result of the study?

By asking these questions we are able to identify how valid and reliable the findings are for each study.

Download Checklist (Word document.)

Grading each study

We grade each study as follows:

Grade A

Random control trials.

Grade B

Well conducted clinical trial (involving multiple baseline or ABAB or crossover/reversal/withdrawal design or matched comparison group) (may not necessarily involve blind ratings).

Grade C

Case series study (minimum 3 cases) conducted by researchers independent of intervention. Comparative case-control study but inadequate experimental design (groups poorly matched, inadequate base line data etc). Group study. – AB design only.

Grade D

Single case study/ or case series conducted by researchers involved in developing the therapy

For more information, see Types of Research Study

Evidence table

Once we have evaluated and graded each individual study, we compile the key findings into an evidence table.

This makes it easier to rank the intervention as a whole, since we can see the key elements from each research study at a glance.

The ranking for each intervention is based on the number and the quality of the scientific research studies on that intervention.

The greater the number of high quality research studies which support the intervention, the higher the rating.

Download Evidence Table (Excel spreadsheet.)

Studies

Last Updated : 31/10/2008 Back to Top

Enter a search term

Or, enter a search term