E-Commerce Platform Ranking Based on Target-Based Performance Indicators

Authors

Keywords:

E-commerce, Multi-criteria decision making, AHP, CRITIC, TOPSIS, Exponentially weighted moving average

Abstract

Managing a broad product assortment on an e-commerce platform requires category performance to be judged jointly across several, frequently conflicting, indicators rather than through a single sales figure, which turns category ranking into a multi-criteria decision-making problem. In such problems the outcome is driven above all by how the criteria weights are obtained, yet applications in the e-commerce domain almost always adopt either a subjective or an objective weighting scheme, rarely both. This study evaluates and ranks thirty-two product categories within an active e-commerce firm using seven target-based key performance indicators (KPIs), where each criterion value is operationalized as the ratio of realized performance to the predetermined target. Furthermore, the paper provides a comparative analysis of the outcomes yielded by subjective versus objective weighting methods applied to the same decision-making problem. Criteria weights are derived from the pairwise judgements of two domain experts through the Analytic Hierarchy Process (AHP) and, independently, from the statistical structure of the decision matrix through the Criteria Importance Through Intercriteria Correlation (CRITIC) method; both weight vectors are then supplied to a common TOPSIS ranking. Three months data are condensed into a single decision matrix using an exponentially weighted moving average (λ = 0.7) so that the most recent period dominates while earlier trends are retained. The two methods produce almost opposite weight structures — AHP concentrates roughly two-thirds of the weight in gross order count and net sales, whereas CRITIC assigns the largest weights to conversion rate and session count — yet the resulting rankings agree strongly (Spearman's ρ = 0.878, mean absolute rank shift of 3.7 positions, four of the top five categories shared). Categories that perform consistently across all criteria are insensitive to the weighting scheme, whereas categories with sharply unbalanced criteria profiles move by up to ten positions. The study delivers a systematic and reproducible decision-support model for category prioritisation and shows that the choice between subjective and objective weighting matters selectively rather than uniformly. 

Downloads

Download data is not yet available.

References

Dalbudak, E., & Rençber, Ö. F. (2022). Çok kriterli karar verme yöntemleri üzerine literatür incelemesi. Gaziantep Üniversitesi İktisadi ve İdari Bilimler Fakültesi Dergisi, 4(1), 1–16. https://doi.org/10.55769/gauniibf.1068692

Ersoy, N. (2022). Kriter ağırlıklandırma yöntemlerinin ÇKKV sonuçları üzerindeki etkisine yönelik gerçek bir hayat uygulaması. Manas Sosyal Araştırmalar Dergisi, 11(4), 1449–1463. https://doi.org/10.33206/mjss.1026666

Zoraghi, N., Amiri, M., Talebi, G., & Zowghi, M. (2013). A fuzzy MCDM model with objective and subjective weights for evaluating service quality in hotel industries. Journal of Industrial Engineering International, 9(1), 38. https://doi.org/10.1186/2251-712X-9-38

Marković, V., Stajić, L., Stević, Ž., Mitrović, G., Novarlić, B., & Radojičić, Z. (2020). A novel integrated subjective-objective MCDM model for alternative ranking in order to achieve business excellence and sustainability. Symmetry, 12(1), 164. https://doi.org/10.3390/sym12010164

Burnaz, S., & Topcu, Y. İ. (2006). A multiple-criteria decision-making approach for the evaluation of retail location. Journal of Multi-Criteria Decision Analysis, 14(1–3), 67–76. https://doi.org/10.1002/mcda.401

Tyagi, M., Kumar, P., & Kumar, D. (2014). A hybrid approach using AHP-TOPSIS for analyzing e-SCM performance. Procedia Engineering, 97, 2195–2203. https://doi.org/10.1016/j.proeng.2014.12.463

Li, R., & Sun, T. (2020). Assessing factors for designing a successful B2C e-commerce website using fuzzy AHP and TOPSIS-Grey methodology. Symmetry, 12(3), 363. https://doi.org/10.3390/sym12030363

Ishak, A., Ginting, R., & Wanli, W. (2021). Evaluation of e-commerce services quality using fuzzy AHP and TOPSIS. IOP Conference Series: Materials Science and Engineering, 1041, 012042. https://doi.org/10.1088/1757-899X/1041/1/012042

Ocampo, L., Besabella, O., Fallore, M., Guinandal, A. R., Merabueno, A., Himang, C., & Yamagishi, K. (2021). An integrated AHP-TOPSIS for evaluating online marketing strategies for the hospitality industry. International Journal of Asian Business and Information Management, 12(3), 489–510. https://doi.org/10.4018/IJABIM.20210701.oa11

Diakoulaki, D., Mavrotas, G., & Papayannakis, L. (1995). Determining objective weights in multiple criteria problems: The CRITIC method. Computers & Operations Research, 22(7), 763–770. https://doi.org/10.1016/0305-0548(94)00059-H

Krishnan, A. R., Kasim, M. M., Hamid, R., & Ghazali, M. F. (2021). A modified CRITIC method to estimate the objective weights of decision criteria. Symmetry, 13(6), 973. https://doi.org/10.3390/sym13060973

Görçün, Ö. F. (2021). Evaluation of the selection of proper metro and tram vehicle for urban transportation by using a novel integrated MCDM approach. Science Progress, 104(1), 1–18. https://doi.org/10.1177/0036850420950120

Yin, J., Wang, J., Wang, C., Wang, L., & Chang, Z. (2023). CRITIC-TOPSIS based evaluation of smart community governance: A case study in China. Sustainability, 15(3), 1923. https://doi.org/10.3390/su15031923

Arısoy, I., & İç, Y. T. (2025). Development of a new modified TOPSIS model to rank the e-commerce companies using the categoric data sets. Electronic Commerce Research. Advance online publication. https://doi.org/10.1007/s10660-025-10046-8

Chodak, G. (2024). Multi-criteria evaluation in e-commerce logistics. Springer.

Özsalman, E., Ulutaş, A., & Ünver, H. (2026). Performance evaluation of e-commerce websites based on multi-criteria decision-making methods. Journal of Theoretical and Applied Electronic Commerce Research, 21(6), 190. https://doi.org/10.3390/jtaer21060190

Hwang, C. L., & Yoon, K. (1981). Multiple attribute decision making: Methods and applications. Springer-Verlag. https://doi.org/10.1007/978-3-642-48318-9

Dolega, L., Rowe, F., & Branagan, E. (2021). Going digital? The impact of social media marketing on retail website traffic, orders and sales. Journal of Retailing and Consumer Services, 60, Article 102501. https://doi.org/10.1016/j.jretconser.2021.102501

Etro, F. (2021). Product selection in online marketplaces. Journal of Economics & Management Strategy, 30(3), 614–637. https://doi.org/10.1111/jems.12428

Etro, F. (2024). e-Commerce platforms and self-preferencing. Journal of Economic Surveys, 38(4), 1516–1543. https://doi.org/10.1111/joes.12594

Di Fatta, D., Patton, D., & Viglia, G. (2018). The determinants of conversion rates in SME e-commerce websites. Journal of Retailing and Consumer Services, 41, 161–168. https://doi.org/10.1016/j.jretconser.2017.12.008

McDowell, W. C., Wilson, R. C., & Kile, C. O., Jr. (2016). An examination of retail website design and conversion rate. Journal of Business Research, 69(11), 4837–4842. https://doi.org/10.1016/j.jbusres.2016.04.040

Perdikaki, O., Kesavan, S., & Swaminathan, J. M. (2012). Effect of traffic on sales and conversion rates of retail stores. Manufacturing & Service Operations Management, 14(1), 145–162. https://doi.org/10.1287/msom.1110.0356

Lohse, G. L., & Spiller, P. (1999). Internet retail store design: How the user interface influences traffic and sales. Journal of Computer-Mediated Communication, 5(2). https://doi.org/10.1111/j.1083-6101.1999.tb00339.x

Unal, M., & Park, Y.-H. (2023). Fewer clicks, more purchases. Management Science, 69(12), 7317–7334. https://doi.org/10.1287/mnsc.2023.4716

Saaty, T. L. (1980). The analytic hierarchy process: Planning, priority setting, resource allocation. McGraw-Hill. https://doi.org/10.21236/ADA214804

Spearman, C. (1904). The proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72–101. https://doi.org/10.2307/1412159

Aczél, J., & Saaty, T. L. (1983). Procedures for synthesizing ratio judgements. Journal of Mathematical Psychology, 27(1), 93–102. https://doi.org/10.1016/0022-2496(83)90028-7

Published

2026-10-21

Issue

Section

Articles

How to Cite

Bölükbaş, U., Çetinkaya, Y., & Adaş, K. U. (2026). E-Commerce Platform Ranking Based on Target-Based Performance Indicators. Journal of Information-Based Decision Making, 2(1), 1-26. https://jibdm.journal-publishing.org/index.php/jibdm/article/view/38