Evaluasi Kualitas Layanan OTA dalam Perspektif Manajemen Operasi Jasa: Pendekatan Text Mining dan Sentiment Analysis pada Aplikasi Traveloka

Authors

  • Vanya Pinkan Maridelana Universitas Jember, Indonesia
  • Setya Widyawan Prakosa Universitas Jember, Indonesia
  • Tria Putri Noviasari Universitas Jember, Indonesia

DOI:

https://doi.org/10.38035/jimt.v7i3.7825

Keywords:

text mining, analisis sentimen, IndoBERT, kualitas layanan digital, E-S-QUAL, manajemen operasi jasa

Abstract

Penelitian ini bertujuan untuk menganalisis kualitas layanan aplikasi Traveloka berdasarkan ulasan pengguna di Google Play Store menggunakan pendekatan text mining dan sentiment analysis berbasis IndoBERT. Data yang digunakan terdiri dari 121.498 ulasan berbahasa Indonesia di sepanjang tahun 2025. Analisis dilakukan melalui tahapan preprocessing, klasifikasi sentimen, serta pemetaan ulasan ke dalam empat dimensi E-S-QUAL yaitu efficiency, fulfillment, system availability, dan privacy. Hasil analisis menunjukkan bahwa 48,8% ulasan bersentimen positif dan 23,7% bersentimen negatif dengan rasio 2:1. Model IndoBERT menunjukkan performa yang baik dengan akurasi 89,2% dan skor F1 89,3%. Pengukuran skor kualitas layanan menunjukkan bahwa dimensi efficiency memperoleh skor positif (+0,39), sementara fulfillment (-0,26), system availability (-0,44), dan privacy (-0,71) menunjukkan skor negatif. Temuan ini mengindikasikan bahwa meskipun aplikasi dinilai mudah digunakan, masih terdapat permasalahan pada proses pemenuhan layanan, stabilitas sistem, dan keamanan data. Secara praktis, penelitian ini memberikan kontribusi bagi Traveloka dalam mengidentifikasi area prioritas perbaikan operasional berbasis data ulasan pengguna secara real-time, khususnya pada penguatan integrasi sistem dengan mitra layanan, peningkatan keandalan infrastruktur teknologi, serta optimalisasi perlindungan data dan keamanan transaksi. Pendekatan ini juga dapat dimanfaatkan sebagai mekanisme monitoring kualitas layanan digital secara berkelanjutan guna mendukung strategi peningkatan kepuasan dan loyalitas pengguna.

References

Al-Hawari, M. A. (2022). The role of online service quality in enhancing customer satisfaction and loyalty in digital platforms. Journal of Retailing and Consumer Services, 64.

Amra & Delma. (2025). Play Store marketing statistics 2025: Number of apps, users, revenue, downloads & more. https://www.amraandelma.com/play-store-marketing-statistics/

Ananthakrishnan, U. M., Proserpio, D., & Sharma, S. (2019). I hear you: Does quality improve with customer voice? Social Science Research Network. https://doi.org/10.2139/SSRN.3467236

Arcand, M., PromTep, S., Brun, I., & Rajaobelina, L. (2017). Mobile banking service quality and customer relationships. International Journal of Bank Marketing, 35(7), 1068–1089.

Ayo, C. K., Oni, A. A., Adewoye, O. J., & Eweoya, I. O. (2016). E-banking users’ behaviour: E-service quality, attitude, and customer satisfaction. International Journal of Bank Marketing, 34(3), 347–367.

Basha, S. M. (2023). Knowledge discovery from online reviews. In Translational Systems Sciences (pp. 71–104). https://doi.org/10.1007/978-981-99-1075-5_3

Batalas, N., Quevedo-Fernandez, J., Martens, J.-B., & Markopoulos, P. (2015). Meet your users in situ: Data collection from within apps in large-scale deployments. International Journal of Handheld Computing Research, 6(3), 17–32.

Bauer, H. H., Falk, T., & Hammerschmidt, M. (2006). eTransQual: A transaction process-based approach for capturing service quality in online shopping. Journal of Business Research, 59(7), 866–875.

Blut, M. (2021). E-service quality: Development of a hierarchical model. Journal of Service Research, 24(1), 5–26.

Bueno, L. A. (2024). Exploratory study of digital operational efficiency for Brazilian banks. https://doi.org/10.47749/t/unicamp.2024.1408575

Carlson, J., & O’Cass, A. (2011). Developing a framework for understanding e-service quality, its antecedents, consequences, and mediators. Managing Service Quality, 21(3), 264–286.

Cheng, Y., Xie, Q., & Zhang, Z. (2020). A method of real-time service quality evaluation based on customer behavior. https://doi.org/10.1145/3418981.3418982

Chuang, C.-C., Cheng, W.-L., & Hsu, K.-S. (2015). A comprehensive composite digital services quality assurance application on intelligent transportation system. Asia-Pacific Network Operations and Management Symposium, 368–371.

Dasgupta, S., & Sen, J. (2022). A framework of customer review analysis using the aspect-based opinion mining approach. Proceedings of OCIT, 233–237.

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT, 4171–4186.

Dhendra, & Utomo, G. V. (2025). Benchmarking IndoBERT and transformer models for sentiment classification on Indonesian e-government service reviews. Jurnal Transformatika, 23(1), 86–95.

Dhar, S., & Bose, I. (2022). Walking on air or hopping mad? Understanding the impact of emotions, sentiments and reactions on ratings in online customer reviews of mobile apps. Decision Support Systems, 162, 113769.

Duan, W., Cao, Q., Yu, Y., & Levy, S. (2013). Mining online user-generated content: Using sentiment analysis technique to study hotel service quality. Proceedings of the Hawaii International Conference on System Sciences, 3119–3128.

Ferreira, C., Robertson, J., Chohan, R., & Pitt, C. (2023). Using computerized text analysis to predict customers’ evaluation of their service experience. Developments in Marketing Science, 375–376.

Fitzsimmons, J. A., Fitzsimmons, M. J., & Bordoloi, S. (2022). Service management: Operations, strategy, information technology (10th ed.). McGraw-Hill.

Ghadiridehkordi, A., Shao, J., Boojihawon, R., Wang, Q., & Li, H. (2024). Leveraging sentiment analysis via text mining to improve customer satisfaction in UK banks. International Journal of Bank Marketing, 43(4), 780–802.

Hennig-Thurau, T., Gwinner, K. P., Walsh, G., & Gremler, D. D. (2004). Electronic word-of-mouth via consumer-opinion platforms. Journal of Interactive Marketing, 18(1), 38–52.

Ho, R. C., Withanage, M. S., & Khong, K. W. (2020). Sentiment drivers of hotel customers: A hybrid approach using unstructured data. Asia-Pacific Journal of Business Administration, 12(3–4), 237–250.

Hsueh, J.-T., & Hsu, S.-H. (2024). Turning negative reviews into operational insights: ABSS-GPT’s role in informing hotel decisions. Journal of Decision Systems, 1–16.

Huang, E. Y., Lin, S. W., & Fan, Y. C. (2015). MS-QUAL: Mobile service quality measurement. Electronic Commerce Research and Applications, 14(2), 126–142.

Johnston, R., Shulver, M., Slack, N., & Clark, G. (2021). Service operations management (5th ed.). Pearson.

Joshi, K. P., Joshi, A., & Yesha, Y. (2009). A framework for relating frontstage and backstage quality in virtualized services.

Kim, J., & Chung, J. (2024). Analysis of service quality in smart running applications using big data text mining techniques. Journal of Theoretical and Applied Electronic Commerce Research, 19, 3352–3369.

Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014). Sentiment analysis of short informal texts. Journal of Artificial Intelligence Research, 50, 723–762.

Koto, F., Rahimi, A., Lau, J. H., & Baldwin, T. (2020). IndoLEM and IndoBERT: A benchmark dataset and pre-trained language model for Indonesian NLP. In Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020), 757–770.

Lai, X., Wang, F., & Wang, X. (2021). Asymmetric relationship between customer sentiment and online hotel ratings. International Journal of Contemporary Hospitality Management, 33(6), 2137–2156.

Leem, B. H., & Eum, S. W. (2021). Using text mining to measure mobile banking service quality. Industrial Management & Data Systems, 121(5), 993–1007.

Nguyen, H. T., Nguyen, G. H., & Tran, Y. T. H. (2025). The impact of digital transformation on operational efficiency of commercial banks. International Journal of Innovative Research and Scientific Studies, 8(2), 4345–4353.

Pang, B., & Lee, L. (2004). A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. Proceedings of ACL, 271–278.

Parasuraman, A., Grewal, D. (2000). The impact of technology on the quality–value–loyalty chain. Journal of the Academy of Marketing Science, 28(1), 168–174.

Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1988). SERVQUAL. Journal of Retailing, 64(1), 12–40.

Parasuraman, A., Zeithaml, V. A., & Malhotra, A. (2005). E-S-QUAL. Journal of Service Research, 7(3), 213–233.

Qahri-Saremi, H., & Montazemi, A. R. (2022). Negativity bias in online reviews. European Journal of Information Systems, 32(4), 717–734.

Ramachandran, R., Sudhir, S., & Unnithan, A. B. (2021). Emotionality and product ratings in online reviews. IIMB Management Review, 33(4), 299–308.

Sari, Y., Wibowo, A., & Tjahyanto, A. (2020). Analisis sentimen terhadap layanan transportasi online menggunakan machine learning.

Shankar, A., & Jebarajakirthy, C. (2019). The influence of e-banking service quality on customer loyalty. International Journal of Bank Marketing, 37(5), 1119–1142.

Sujon, K. M., Hassan, R., & Choi, K. (2025). Accuracy, precision, recall, F1-score, or MCC? Journal of Big Data, 12, 268.

Tate, M., & Evermann, J. (2010). The end of SERVQUAL in online services research. E-Service Journal, 7(1), 60–85.

Thelwall, M., Buckley, K., & Paltoglou, G. (2011). Sentiment in Twitter events. Journal of the American Society for Information Science and Technology, 62(2), 406–418.

Traveloka. (2025). About Traveloka. https://www.traveloka.com/en-id/about-us

Vukovic, M., & Natarajan, A. (2012). Collective intelligence for enhanced quality management of IT services. Springer.

Wilie, B., Vincentio, K., Winata, G. I., Cahyawijaya, S., Li, X., Lim, A. Y., & Purwarianti, A. (2020). IndoNLU benchmark. Proceedings of EMNLP, 155–165.

Wibowo, A. P. (2019). Preprocessing teks bahasa Indonesia untuk analisis sentimen.

Zheng, W., Lu, H., Zhou, Y., Liang, J., Zheng, H., & Deng, Y. (2019). iFeedback: Exploiting user feedback for real-time issue detection. Automated Software Engineering, 352–363.

Published

2026-03-03

How to Cite

Maridelana, V. P., Prakosa, S. W., & Noviasari, T. P. (2026). Evaluasi Kualitas Layanan OTA dalam Perspektif Manajemen Operasi Jasa: Pendekatan Text Mining dan Sentiment Analysis pada Aplikasi Traveloka. Jurnal Ilmu Manajemen Terapan, 7(3), 247–259. https://doi.org/10.38035/jimt.v7i3.7825