After you’ve done a few reviews, you’ll probably establish a methodology that works best for you. First, you should always check the journal’s formatting guidelines or requirements for the review, if any.
Keep these guidelines in mind throughout the review process. Then, read the paper sequentially, making notes as you go. Once you’ve done the first read-through, go back and scrutinize each section more carefully. Pay particular attention to the methods section. The journal should have statistics experts on staff to check those figures but you’ll be expected to evaluate the study design. As you make notes for your review ask yourself these questions:
- Does the hypothesis make sense?
- Is the methodology flawed in any way?
- Do the claims align with the data, or do they overreach?
- Does the study adequately address the central question?
- How does the central question fit in with the current knowledge in the field?
Before your extensive notes get out of control, find a way to organize them. Some reviewers like to keep notes for major and minor issues separate.