Skip to Main Content
Vassar

Today's hours:

See all library hours »

  • Ask a Librarian
  • FAQ

ECON 307: Advanced Topics in Health Economics

Reading & Evaluating Articles

Pain, E. (2016). How to (seriously) read a scientific paper.  Science Magazine. 10.1126/science.caredit.a1600047.

Jump Around
​It's okay to skip around in a scholarly article. Start by skimming the abstract, introduction, conclusion, and look at images or data representations. If the article looks to be useful for your purposes, read it from the beginning to end. 

Keep It Strategic
While you are reading, reflect on how the article relates to what you want to write about or research. ​​ 

Mark It Up
​​Take notes. Interact with the article. How do the ideas or information presented relate to what you want to write about?

Cut through the Jargon
Unfamiliar technical terms? Google or use a specialized dictionary to find definitions. 

Replay​
If the article is relevant after you've read through it, consider reading it again. 

Find the Source 
​References can be a very useful resource. Be sure to skim the titles in the References section. You could find another scholarly article you want to read. 

Adapted from: https://libguides.valdosta.edu/reading-scholarly-articles

Not all articles will use these exact subheadings, however these questions can still be used to focus your reading.

Article Section Key Questions
Abstract
  • What is the objective of the study or article?
  • What results or conclusions are presented in the abstract?
Introduction
  • What issues does the author seem to be concerned about?
  • What is the gap in previous research that the authors are addressing with this study?
  • Does the author(s) introduce theory?
Methods
  • How does the author test their hypothesis or conduct their analysis?
  • What data or evidence was collected? How is it used?
Results
  • What were the major findings or conclusions of the article?
  • Are the main findings expected?
Discussion
  • Does the article meet its objectives?
  • Does the author address the problems or limitations of their research methods?
  • What does the author suggest as future research?

Quick Tips

  1. Read the abstract. How does this align with your questions?
  2. Who is the author or creator? Is their discipline the same or adjacent to yours?
  3. What type of source is this? Does this align with your research needs?
  4. Is the information current for your topic?
  5. Does the information seem accurate and unbiased? 

Evaluation Criteria

Relevancy
  • How well does the source address your information needs? 
  • Does the source provide you with new information or perspectives, or confirm or refute other sources? 
  • Does the source address one or more of the BEAM elements related to your research question? 

Author Expertise & Discipline 

 
  • What is their educational background, training, past writings, lived experiences?
  • Does the topic align with the author's expertise? 
  • Is the source written using a specific disciplinary approach? Does the source align with the disciplinary perspective of your research? 
  • Has this author been discussed in class, or are they on your syllabus? Have you noticed this author's name cited in other sources? 
  • Is the author associated with an organization or institution? What are the basic goals or mission of the organization or institution? 

Source Type
  • What is the goal of the source?
  • Who is the intended audience?
  • What is the editorial or peer-review process? 

Currency & Publication Date
  • Does the source reflect current scholarship and knowledge? 
  • When was the research conducted? When was it published? 
    • Note, some topics will require the use of older materials. What makes sense for your topic and discipline? 

Evidence, Objectivity & Bias
  • Does the author present compelling evidence? How robust is the evidence? Is the research design clear? 
  • Does the author present logically sound conclusions or do they veer into opinion? 
  • Does the author avoid over-simplifying or over-generalizing? 
  • What sources does the author cite? Check the references.
  • Do other researchers trust this source? Are they using this source in their own research? (See Research Impact & Impact Metrics)
Impact Metrics

A number of metrics analyze citation counts, i.e. the number of times a source has been cited by other researchers. 

  • Web of Science Journal Impact Factor, is one of the first impact measurements.   
    • WoS indexes a smaller collection of higher quality journals; WoS will rank the journals included in its indexes. 
    • In WoS search results, click on the journal title to view the JIF and more information.
  • View author profiles and publications in Web of Science, Scopus, GoogleScholar, researcher/institutional websites
  • View article citation metrics; this doesn't equal consensus or quality, however may indicate an impact on subsequent research.

For more information see, Research Impact Metrics: University of Michigan Library.

Below is a modified, abbreviated framework for tracking research outputs to locate indicators that demonstrate evidence of research impact.

Advancement of Knowledge

What was created by the research study?

How has the research output and activities been used? 

 
  • How does the study expand knowledge in a field?
    • Do the study findings represent a paradigm shift?
    • Lead to change in understanding a problem? 
  • Number of citations (cited by)
    • Has the study been referenced by other researchers?
    • What do the cited by sources represent? Countries, institutions, languages, subjects?
  • Is the study data available? 
  • Has the study Included in a subsequent research review (systematic review/ meta analysis?) 
  • Has the study been cited or noted as being an important work?
  • Was there any media buzz about this study? 
  • Was the research or researchers awarded prizes, as having a significant contribution? 

Community Benefit

How has community health been enhanced as a result of this research? 
  • Has the study changed public awareness or offers an intervention?
  • Is the study cited in materials that assist with healthcare decision making or in materials for patients or the public?
  • Can the study findings help to improve the standard of care? 

Clinical Implementation

Has the research been adopted in clinical activities or applications? 
  • Has the research been cited in a clinical decision aid?
  • Is the research being used in consumer health materials? 
  • Has the research resulted in a clinical guideline or point-of-care resource? 

Economic Benefit

What economic benefits were produced from result of research outputs and/or activities?
  • Does the research have an affect on cost savings pertaining to the effectiveness of resources?
  • Does the research aid in prevention or management of health risks?
  • Has the research resulted in an increase in quality of life or quality of healthcare services?
  • Does the research impact on life expectantly, morbidity, or mortality rates?
Legislation and Policy Enactment
 
How has the research influenced legislation or policy enactment? 
  • Has the research been cited or use in the development of policy or legislation, regulation? 
  • Have the researcher(s) been invited to serve on advisory boards or included in policy development?

Bernard Becker Medical Library, Washington University School of Medicine
https://becker.wustl.edu/impact-assessment

As you start your research and throughout your research process, consider:

  • Which groups seem to be at the center of debates and analysis for the topic you are interested in? Are there any groups at the margins or periphery of research? Are there groups that are mentioned but not prioritized?
    • Who are the stakeholders? 
    • What voices could or should be included in your research?
    • If you looking at a particular community or geographic region, do you have sources from that community or region?
    • Are particular groups especially affected by the topic you're discussing? Do you have sources from those groups?
  • Where are the 'community spaces' (physical or digital spaces, or resources) where different groups have a voice and are able to freely express, represent, and self-determine their own identities?  

Using Sources

The BEAM model provides a framework for identifying how you might use a source in your own research. However, BEAM can also be used during the research process, for distilling a body of work, or identifying gaps (i.e. does one of the BEAM components need to be better addressed?)

BEAM model details: Background to present information and establish facts; Exhibit to explicate, interpret, analyze; Argument to affirm, dispute, refine, extend; and Method to provide a critical lens, key terms, theory, style, perspective and discourse