Common review criteria for a research paper

1. Significance
How important is the contribution to advancing CS knowledge?
2. Originality
How novel/clever is the idea/approach/solution?
3. Technical Soundness
Is the proposed technique correct? Does it solve the problem?
4. Clarity/presentation
Does it clearly describe the proposed idea/approach/solution that the work can be reproduced/replicated
by others?
5. Related work
Are existing techniques sufficiently discussed and contrasted?
________________________________________
Ingredients/Components of a research paper:
6. "WHY"/motivation
o Why is the problem important?
o Why are existing techniques not sufficient?
o Why is the proposed approach going to solve the problem?
7. "WHAT"/problem statement
o What is the *specific* problem the paper is trying to solve?
8. "HOW"/approach
o How is the problem solved?
o What is the proposed algorithm that solves the problem?
9. Evaluation
o Empirical and/or theoretical
o Empirical: criteria, data, procedures, results, analysis
o Theoretical: criteria, analysis
10. Conclusion
o Summary of findings
o Limitations and possible improvements
________________________________________
Ingredients of "HOW"/approach
11. Motivation of the solution/algorithm: why does it solve the problem?
12. Pseudo-code
13. Explanation of pseudo-code
14. Example
________________________________________
Ingredients of evaluation
15. Empirical
o criteria: what metric is used to measure success, what better means?
o data: description of data used, how they are obtained, ...
o procedures: how the experiments are conducted
o results: measurements obtained from the experiments
o analysis: interpret the results, make comparison, draw conclusion, discuss lessons learned,...
16. Theoretical
o criteria: what metric is used to measure success, what better means?
o proof: when worst/best case occurs, how to generate the first equation, define variables, mathematical
derivation

o analysis: interpret the results, make comparison, draw conclusion, discuss lessons learned,...
________________________________________
Related Work
17. discuss related techniques
18. cite the sources in the sentence when the techniques are first discussed
19. discuss their limitation/weakness
________________________________________
References
20. different types of sources: conference paper, journal paper, book chapter, pages in a book, technical
report.
21. different styles
________________________________________
Introduction
22. motivation: general (why the problem is important), specific (why existing techniques are not
sufficient)
23. problem statement: goal (think about what questions you are trying to answer)
24. overview of proposed approach
25. contributions (key findings) briefly
26. organization of the paper
________________________________________
Conclusion
27. summary of findings
28. limitations and possible improvements
________________________________________
Abstract (one paragraph)
29. motivation
30. problem statement
31. proposed approach
32. contributions