Medicine: Critical appraisal and evaluating sources

You need to evaluate the information that you find before deciding whether not you can rely on it. This is especially when the information has not been through any review process. 

The CRAAP test can help by reminding you what qualities to look for. However, the judgement on whether or not to use the information is yours to make. You might decide to reject it or check the claims further using other sources. The same information may be evaluated differently, depending on how you intend to use it.  

CRAAP stands for Currency, Relevance, Authority, Accuracy and Purpose.

Currency: The timeliness of the information.

• When was the information published or posted?
• Has the information been revised or updated?
• Does your topic require current information, or will older sources work as well?
• Are the links functional?

Relevance: The importance of the information for your needs.

• Does the information relate to your topic or answer your question?
• Who is the intended audience?
• Is the information at an appropriate level (i.e. not too elementary or advanced for your needs)?
• Have you looked at a variety of sources before determining this is the one you will use?
• Would you be comfortable citing this source in your research paper?

Authority: The source of the information.

• Who is the author / publisher / source / sponsor?
• What are the author's credentials or organizational affiliations?
• Is the author qualified to write on the topic?
• Is there contact information, such as a publisher or email address?
• Does the URL reveal anything about the author or source (examples: .com .edu .gov .org .net)?

Accuracy: The reliability, truthfulness and correctness of the content.

• Where does the information come from?
• Is the information supported by evidence?
• Has the information been reviewed or refereed?
• Can you verify any of the information in another source or from personal knowledge?
• Does the language or tone seem unbiased and free of emotion?
• Are there spelling, grammar or typographical errors?

Purpose: The reason the information exists.

• What is the purpose of the information? Is it to inform, teach, sell, entertain or persuade?
• Do the authors / sponsors make their intentions or purpose clear?
• Is the information fact, opinion or propaganda?
• Does the point of view appear objective and impartial?
• Are there political, ideological, cultural, religious, institutional or personal biases?

The CRAAP test was devised by librarians at California State University's Meriam Library.  See original webpage 'Is this source of information good?'.

Critical appraisal is the process of carefully and systematically examining research to judge its trustworthiness, and its value and relevance in a particular context.  

Here are different online courses to choose from. Each includes explanations and checklists to help you appraise the material you have retrieved.

Grey literature has not been through any sort of peer review process.  Therefore it is particularly important that you evaluate material very carefully to decide whether to use it.

The AACODS checklist is designed to enable evaluation and critical appraisal of grey literature. The checklist was designed and made available by Jess Tyndall at Flinders University. 

Authority

Who is responsible for the intellectual content?

Accuracy

Does it state aims, methods, peer-review, supporting work?

Coverage

Are the limits or scope of the material clearly stated?

Objectivity

Can you identify bias, balance or opinion in the material?

Date

Is the date relevant and does it meet your needs?

Significance

Is the item meaningful? What does it add?