Assignment 5-Use of statistics in engineering education research

Research Paper: Computer science research: the top 100 institutions

in India and in the world

The authors in above paper have used statistical analysis in methods and analysis of experimental
results in the following manner:

1. They have used primarily a two-dimensional approach, comprising of a standard

scientometric analysis and a computational text analysis. First, they have performed a
scientometric characterization along the six main indicators, namely total publication (TP),
total citations (TC), average citation per paper (ACPP), highly cited papers (HiCP),
internationally collaborated papers (ICP) and the cited percentage.

2. Out of these, only TP is a primary indicator, and all other secondary indicators are computed
programmatically from the data. They have computed these indicators for all the institutions
in both the sets.

3. Second major part of the analysis is to characterize the major research themes pursued and
advanced by the institutions in the set. For this task, they have processed the entire data to
classify every research output in one (or more) of the 11 major thematic areas in CS research.

4. They have first presented the computational results of analytical characterization using
scientometric indicators. The results compare and characterize the two sets, I100 and W100,
along different indicators. They first tried to do a detailed indicator-based comparison of
institutions in I100 and W100.

5. They have used authorship and ICP patterns for research and same they have shown with
graph. Even they have ICP statistics for various analysis like Cited Percentage trend (year-
wise) for I100 and W100, Rate of increase of citations (year-wise) for I100 and W100 and
Proportionate Share of I100 to HiCP papers for the combined (I100+W100) data.

6. The second major part of the experimental framework is the text-based computational
analysis. Based on this, they made thematic research map for I100 and W100 institutions
(19892013) and Thematic research map for I100 and W100 institutions (20042013).
Thematic research trend for I100 (year-wise). Thematic research trend for W100 (year-wise)

7. They have measured and shown Indias proportionate contribution to worldwide CS domain
research output, HiCP and research themes pursued by researchers in CS domain. In addition
to multidimensional analysis, they also present a quality-quantity exergy performance
 analysis of institutions in the two sets. The results obtained for both sets are analyzed and
compared thoroughly and presented in an easy to understand graphical format. The analytical
results also show detailed year-wise comparative plots and visualizations of the scientometric
outputs as well as the text-based research theme identification.

8. On the second question of Indias contribution to worldwide CS domain research, they have
shown the Indias total proportionate contribution to the output as well as contribution of the
I100 set in high impact output of the world. The cited percentage of output for I100 set is also
computed and compared with W100. On the third question of identification of major research
themes pursued by I100 and W100 institutions, they have performed a detailed text-based
computational analysis to identify research themes pursued, their trends and the topic density
patterns for I100 and W100 sets.

9. These findings help in identifying the fact that research output of I100 is somewhat
congruent to the research output of the W100 in terms of the major themes pursued, though
with an identifiable time lag from W100 to I100 set, in some areas.

10. Secondly, they present a detailed and well-accounted picture of Indias position and
contribution to the CS research worldwide. The results as such may also be useful for
identifying the steps and policy changes that may be taken to enhance and promote high
quality CS research in Indian institutions, including establishing thematic area-wise centers
for excellence in institutions having research strength in a particular research theme.

11. In another recent work, they have attempted to present a quantity-quality composite rank
for Indian institutions in CS domain research for this broader purpose.