Overview of Features and Issues in Designing Evaluation Indices for Social Phenomena

Laura Gudelytė, Olga Navickienė, Aistė Valentinaitė


The purpose of this paper is to analyse the design (construction) of composite indices and the evaluation of composite indices for social phenomena based on indicators and their properties. In order to achieve this objective, the following tasks were set: an overview of the basics of the construction of indicators and their possible applications, the classification of advantages and disadvantages of evaluation systems, the composite indices and indicators applied in measuring characteristics of social phenomena; defining the impact of the data structure and quality of data on the coherence of composite indices applied in social technologies. The features and issues in designing the composite indices measuring the social phenomena were discussed. The main problems concerning the construction of composite indices applied evaluating social phenomena were classified. In addition, the dependence of coherence of composite indices on the used data and their structure was discussed in this paper.
This paper is useful for designing evaluation indices for social phenomena and assumptions on weighting of exogenous variables. It sets out the basic guidelines that can be developed in the future based on econometric approaches applied to statistical modelling of social phenomena.


composite indices; data structure; weighting scheme

Full Text:

PDF (Lithuanian)


Andrews, D. W. Andrews K. 1993. Tests for Parameter Instability and Structural Change with Unknown Change Point. Econometrica, 61(4): 821–856.

(HDI). United Nations Development Programme [interactive]. 2014 [accessed 2014-08-10]. .

Bailey, K. 2008. Methods of social research. New York: Simon and Schuster.

van Beuningen, J.; Schmeets, H. 2013. Developing a Social Capital Index for the Netherlands. Social Indicators Research, 113(3): 859–886.

Booysen, F. 2002. An Overview and Evaluation of Composite Indices of Development. Social Indicators Research, 59(2): 115–151.

Bruneckienė, J.; Činčikaitė, R. 2009. Šalies regionų konkurencingumo vertinimas regionų konkurencingumo indeksu: tikslumo didinimo aspektas. Ekonomika ir vadyba, 14: 700–708.

Caselli, M. 2008. Measuring… what? Notes on some globalization indices. Globalizations, 5(3): 383–404.

Chakravarty, S. R. 2003. A Generalized Human Development Index. Review of development economics, 7(1): 99–114.

Chiu, YC.; Shyu, JZ.; Tzeng, GH. 2004. Fuzzy MCDM for Evaluating the E-commerce Strategy. International Journal of Computer Applications in Technology, 19(1): 12–22.

Diamantopoulos, A.; Winklhofer, H. M. 2001. Index Construction with Formative Indicators: An alternative to Scale Development. Journal of Marketing Research, 38(May): 277–290.

Diener, E.; Suh, E. 1997. Measuring quality of life: Economic, social, and subjective indicators. Social indicators research, 40(1-2): 189–216.

Ebert, U.; Welsch, H. 2004. Meaningful Environmental Indices: a Social Choice Approach. Journal of Environmental Economics and Management, 47(2): 270–283.

Elveback, L. R.; Taylor, W. F. 1969. Statistical Methods of Estimating Percentiles. Annals of the New York Academy of Sciences, 161(2): 538–548.

Foa, R.; Tanner, J. C. 2012. Methodology of the Indices of Social Development. International Institute of Social Studies of Erasmus University Rotterdam [interactive]. Hague, 2014 [accessed 2014-08-10]. .

Freudenberg, M. 2003. Composite Indicators of Country Performance: A Critical Assessment. STI Working Paper, 2003(16): 2–34.

Ali, O. G.; Faltin, F. W.; Doganaksoy, N. 1997. Practical Change Point Estimation. Technical Information Series. General Electric Company, Research and Development Center.

Handbook on Constructing Composite Indicators: Methodology and User Guide. 2008. The Organisation for Economic Co-operation and Development [interactive]. [accessed 2014-08-29]. .

Huggins, R. 2003. Creating a UK Competitiveness Index: Regional and Local Benchmarking. Regional Studies, 37(1): 89–96.

Jasinevičius, R.; Petrauskas, V. 2011. Sprendimų pagrindimo kompiuterizavimas. Kauno technologijos universitetas. Kaunas: Technologija.

Kubilius, J. Tikimybių teorija ir matematinė statistika. Vilnius, 1996

Lee, SK.; Yu, JH. 2013. Composite Indicator Development Using Utility Function and Fuzzy Theory. Journal of the Operational Research Society, 64(8): 1279–1290.

McGranahan, D. 1995. Measurement of Development: Research at the UN's Research Institute for Social development. International Social Science Journal, 143: 39–57.

Miller, D. C.; Salkind, N. J. 2002. Handbook of research design and social measurement. Thousand Oaks: Sage.

De Muro, P.; Mazziotta, M.; Pareto, A. 2009. Composite Indices for Multidimensional Development and Poverty: An Application to MDG Indicators. Wye City Group Meeting [interactive]. Rome, 2009 [accessed 2014-10-01]. .

Newey, W. K.; Stoker, T. M. 1993. Efficiency of Weighted Average Derivative Estimators and Index Models. Econometrica: Journal of the Econometric Society, 1199–1223.

Noorbakhsh, F. 1998. A Modified Human Development Index. World Development, 26(3): 517–528.

Ray, A. K. 2008. Measurement of Social Development: An International Comparison. Social Indicators Research, 86(1): 1–46.

Resindex: Regional Social Innovation Index. 2013. SINNERGIAK Social Innovation (UPV/EHU), Innobasque – 2013, Basque Innovation Agency [interactive]. [accessed 2014-08-07]. .

Rubright. J. D.; Nandakumar, R.; Glutting, J. J. 2014. A Simulation Study of Missing Data with Multiple Missing X’s. Practical Assessment, Research and Evaluation, 19(10).

Saisana, M.; Tarantola, S. 2002. State-of-the-art Report on Current Methodologies and Practices for Composite Indicator Development. EUR 20408 EN, European Commission-JRC: Italy.

Saisana, M.; Tarantola, S.; Schulze, N.; Cherchye, L.; Moesen, W.; Van Puyenbroeck, T. 2005. Knowledge Economy Indicators. State-of-the-Art Report on Composite Indicators for the Knowledge-based Economy. Workpackage 5, 54 p. [interactive]. [accessed 2014-08-30]. .

Social Progress Index. 2014. Methodological Report. 2014. The Social Progress Imperative [interactive]. Washington, 2014 [accessed 2014-08-10]. .

The World Competitiveness Yearbook 2004. Lausanne: International Institute for Management Development [interactive]. 2014 [accessed 2014-08-30]. .

van den End, J. W. 2006. Indicator and Boundaries of Financial Stability. De Nederlandsche Bank NV. Working Paper 097(2006).

Wignaraja, G.; Lezama, M.; Joiner, D. 2004. Small States in Transition: From Vulnerability to Competitiveness. United Kingdom: Commonwealth Secretariat.

DOI: http://dx.doi.org/10.13165/ST-14-4-2-12

Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM


  • There are currently no refbacks.

"Social Technologies" ISSN online 2029-7564