Journal of Science and Technology Metrics

A Bibliometric Analysis of the Dispersion of Research Performance within and between Universities as an Indicator of Competitiveness in Higher Education?

Daisy Jacobs, Pit Pichappan, Hathairat Ketmaneechairat
University of Zululand, South Africa., Digital Information Research Labs., India., Digital Information Research Labs., India

Abstract: This paper examines selected hard sciences research output in South African universities with special reference to the dispersion of research performance within and between universities as a potential indicator of competitiveness in higher education systems. The subject fields surveyed are Physics, Chemistry, Biology, civil engineering and architecture, Earth sciences, Mathematics, Computer Science and Medicine in seven top universities. The study endeavours to see if these top institutions present levels of concentration of performance within universities that are high or very high and greater than that between them. We investigate the level of correlation between performance in research and its dispersion in the universities. The field of observation is made up of all the South African universities active in the hard sciences. Research performance is evaluated using bibliometric analysis, through publication indexed in the Web of science between the years 2005 and 2013. Relevant data for the study was downloaded from web of Science using largely Science Citation Index (SCI) but also Social Sciences Citation Index (SSCI) and Arts and Humanities Citation Index (AHCI). From several bibliometric indicators of research performance evaluation (such as publication output, trend, citation analysis, impact factor and Hirsch Index), we used publication output by the scientists. The citation count and impact were used to indicate the research output and performance of researchers and what differentiates them from others. We observe that the South African education system presents levels of concentration of performance within universities that are high and at times greater than that between them. This situation to a certain extent allows the search for a competitive advantage with the resulting production of outstanding research institutions, which are capable of attracting and retaining the top scientists both nationally and internationally. This in a way brings about dispersion of performance and indicates the intensity of competitiveness in research institutions and universities. We also notice that in the competitive system, the variability of performance within is much less compared to between universities. The results of the research shows that two universities with the same average research performance could have altogether different impacts on national economic development. As far as competitive systems are concerned, dispersion of performance within universities is so high that it is very difficult to perceive strong differences in performances between universities. The results obtained can be used as indicators for policy making and examine the effectiveness of selective funding of universities based on national research assessment exercises.

Keywords: Bibliometric Analysis, Research Assessment, University Research, Research Policy A Bibliometric Analysis of the Dispersion of Research Performance within and between Universities as an Indicator of Competitiveness in Higher Education?

DOI:https://doi.org/10.6025/jstm/2020/1/2/51-61

Full_Text PDF (2.70 MB) Download: 248 times

References:

[1] Björneborn, L., Ingwersen, P. (2004). Towards a basic framework of webometrics. Journal of the American Society for Information Science and Technology, 55 (14) 1216-1227.
[2] Diodato, V. (1994). Dictionary of Bibliometrics. New York: Haworth.
[3] Egghe, L. (2005). Editorial: Expansion of the field of informetrics: origins and consequences. Information Processing and Management, 41, 1311-1316
[4] Jacobs, D. (2012). Demystification of Bibliometrics, Scientometrics, Informetrics and Webometrics. In: Proceedings of the 11th DIS Annual Conference, University of Zululand, 2-3rd September. Available: http://www.lis.uzulu.ac.za/research/ conferences/2010/DIS%20conference%202010%20DJacobs.pdf
[5] Hirsch, J. E. (2005). An index to quantify an individual2 s scientific research output, In: Proceedings of the National Academy of Sciences of the USA, 102 (46) 16569-72.
[6] Hertzel, D. (1987). Bibliometrics, history of the development of ideas in: Statistical bibliography or bibliometrics? In: A Kent and H. Lancour (Eds). Encyclopaedia of Library and Information Science, 42, 144-219.
[7] Hood, W. W., Wilson, C. S. (2001). The literature of bibliometrics, scientometrics and informetrics. Scientometrics, 52 (2) 291-314.
[8] Kostoff, R. N. (2001). Science and Technology Metrics. http://www.dtic.mil/dtic/kostoff/Metweb5_IV.htm (Accessed 25 September 2012).
[9] Kumar, M. J. (2009). Evaluating Scientists: Citations, Impact Factor, h-Index, Online Page Hits and What Else? IETE Technical Review, 26, 165-168.
[10] Mattisosn, P. (2009). Bibliometrics – an important tool in research evaluation. http://www.euroscience.org/bibliometricsanimportant- tool-in-research-evaluation, 28... Retrievedon 06/08/2010.
[11] Mattison, P., Laget, P., Nilsson, A., Sundberg, C. J. (2008). Intra-EU vs. extra-EU scientific copublication patterns in EU. Scientometrics, 75 (3) 555-574.
[12] Onyancha, O. B. (2014). Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub- Saharan Africa (Forth coming Inkanyiso: JHSS)
[13] Priem, J. (2010). Tweet by Jason Priem on September 28, 2010 https://twitter.com/#!/jasonpriem/status/25844968813 (Accessed. Retrieved 21 January 2013).
[14] Priem, J., Taraborelli, D., Groth, P., Nylon, C. (2010). Alt-metrics: a manifesto. http://altmetrics.org/manifesto (Accessed Retrieved 22 January 2013).
[15] Kostoff, R. N. (2001). Science and Technology Metrics. Retrieved April 11, 2002, from Defence Technical Information Center. Information for the Defence Community Website http://www.dtic.mil/dtic/kostoff/Metweb5_IV.htm (Accessed 25 October 2013).
[16] Sengupta, I. N. (1992). Bibliometrics, informetrics, scientometrics and librametrics: An overview. Libri, 42 (2) 75-98.
[17] Stefaniak, B. (1987). Use of bibliographic data bases for scientometric studies. Scientometrics, 12 (3) 3-4.
[18] Wallace, D. P. (1989). Bibliometrics and citation analysis. In: Principles and Applications of Information Science for Library Professionals. Chicago: American Library Association, 10-26.