RESEARCH METHODOLOGY

ME3
Lecturer: Ebru Susur
02/12/2019

Detailed criteria for critically reviewing a scientific article

Criteria Evaluation
Read it
− A quick and superficial reading to understand the type of the study.
or
− A detailed reading at the first hand.
Abstract
− can stand alone from the article.
− can be understood without reading the whole article.
− includes the major objectives of the study.
− explains how the study was done.
− describes the findings and the results.
− All the information in the abstract is present in the article.
The introduction
− provides the rationale of the study. Does the article cover an important topic?
− includes a problem statement that conveys the important issues. It justifies that
there exists and important problem and that previous researchers have not
adequately addressed the problem.
− The problem statement is clear and well-articulated.
− explains the research objectives and/or question clearly.
− provides the context of the study.
The literature review section
− is comprehensive, relevant and up-to-date.
− analyses and critically appraises the literature.
− Gaps in the literature are identified.
− Research questions are derived through the review.
Theoretical/conceptual framework section
− is explicit and justified.
− explains why that framework would be useful to operationalise the study to
address the research objectives/question.
− Quantitative: the constructs being investigated are clearly defined and
presented
− Qualitative: the study offers concepts or theories that are generalisable or
transferable to other contexts, people, etc.
The methodology section
− outlines how the study is performed.
− represents a blueprint by which another researcher could reproduce the study.
− provides rationale for specific methodological choices.
− explains research design choices such as criteria for sample selection,
interviewee selection, analysis techniques, empirical location, etc.
− The development and content of data collection instruments (interviews, surveys,
etc) are sufficiently described.
− Data analysis procedures are described in sufficient detail.
− The chosen method is appropriate for the research objective or question.
− The limitations of the study are noted in terms how data was collected and
analysed.
− Quantitative:
• the survey instrument is appropriate given the study’s variables.
• the data set is sufficiently described.
• the population is defined in sufficient detail to permit the study to be
replicated.
• The sampling procedures are described in sufficient detail.
• Statistical tests for data analysis are appropriate.
The results section
− systematically and clearly announces the study findings.
− is well-organised and aligned with the methods and study questions.
− Tables, graphs, or figures are used thoughtfully and agree with the text.
− Quantitative: The statistics are reported correctly and appropriately.
The discussion section
− comments on the results of the study in light of previous studies and explain the
differences.
− discusses the results against the theoretical framework.
− explains unexpected findings rather than ignoring them.
− Alternative interpretations are considered as needed.
− Quantitative: States whether the hypotheses were verified or rejected.
The conclusion
− is justified by the results of the study.
− Key points of the research study are clearly stated.
− The study limitations are discussed if not in methodology section.
− Practical significance and theoretical implications are discussed.
− A guidance for future research is offered.
Presentation and documentation
− The text is well-written and easy to follow.
− The article is well-organised.