Evaluasi Usability Aplikasi MyASN Menggunakan Metode System Usability Scale (SUS)
Article Sidebar
Main Article Content
Abstract
The rapid digital transformation in the public sector necessitates the development of service applications that are not only functionally robust but also highly usable. MyASN, as a digital personnel service platform for Indonesian civil servants (Aparatur Sipil Negara/ASN), is designed to facilitate access to employment-related information and administrative services. However, its implementation has revealed several usability issues, including login difficulties, slow system responsiveness, and feature instability, which negatively affect the overall user experience. This study aims to evaluate the usability level of the MyASN application using the System Usability Scale (SUS) method. Data were collected through the distribution of SUS questionnaires to application users. The results indicate an average SUS score of 54.08, which falls below the standard benchmark, placing the application in the Not Acceptable – Marginal category, with an adjective rating of Poor–OK and a grade of D. Furthermore, the Net Promoter Score (NPS) falls into the Detractor category, indicating low user satisfaction and a limited likelihood of recommendation. These findings suggest that the MyASN application exhibits significant shortcomings in terms of interface design, navigation, feature consistency, and system performance. Therefore, improvements are required, particularly in simplifying the user interface, enhancing system stability, and optimizing overall performance to improve user experience and the quality of digital personnel services.
Downloads
Article Details
Section
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
How to Cite
References
[1] B. N. Avianto, M. Ismowati, and N. Amelia, “Implementation E-Government in supporting of online-based Service Quality and Accessibility,” Journal Research of Social Science, Economics, and Management, vol. 2, no. 5, Dec. 2022, doi: 10.59141/jrssem.v2i05.317.
[2] M. F. Rizki and A. Y. S. Siahaan, “Implementasi Program Electronic Kinerja (E-Kinerja) Aparatur Sipil Negara (ASN) DI Badan Kepegawaian Daerah Kabupaten Serdang Bedagai,” SAJJANA: Public Administration Review, vol. 1, no. 1, pp. 1–12, Sep. 2023, doi: 10.32734/sajjana.v1i1.13649.
[3] S. K. Aditya, H. Alfiani, D. I. Sensuse, S. Lusa, P. A. W. Putro, and S. Indriasari, “Investigating E-Government Adoption: The Intention to Use MyASN Application by Indonesian National Civil Service Agency (NCSA),” Journal of Government and Civil Society, vol. 8, no. 1, p. 43, May 2024, doi: 10.31000/jgcs.v8i1.10890.
[4] F. R. P. Hulu, T. Raharjo, and T. Simanungkalit, “The impact of usability in information technology projects,” Computer Science and Information Technologies, vol. 5, no. 1, pp. 7–12, Mar. 2024, doi: 10.11591/csit.v5i1.p7-12.
[5] E. Yassien, R. Masa’deh, M. Mufleh, A. Alrowwad, and R. Masa’deh, “The Impact of ERP System’s Usability on Enterprise Resource Planning Project Implementation Success via the Mediating Role of User Satisfaction,” Journal of Management Research, vol. 9, no. 3, p. 49, Jun. 2017, doi: 10.5296/jmr.v9i3.11186.
[6] J. M. Ferreira, F. D. Rodríguez, A. Santos, O. Dieste, S. T. Acuña, and N. Juristo, “Impact of Usability Mechanisms: A Family of Experiments on Efficiency, Effectiveness and User Satisfaction,” IEEE Transactions on Software Engineering, vol. 49, no. 1, pp. 251–267, Jan. 2023, doi: 10.1109/TSE.2022.3149586.
[7] N. Zayim, H. Yildiz, and Y. K. Yüce, “Subjective Cognitive Load Evaluation of a Mobile Personal Health Record Application,” 2023. doi: 10.3233/SHTI230793.
[8] L. M. Mazur, P. R. Mosaly, C. Moore, and L. Marks, “Association of the Usability of Electronic Health Records With Cognitive Workload and Performance Levels Among Physicians,” JAMA Netw. Open, vol. 2, no. 4, p. e191709, Apr. 2019, doi: 10.1001/jamanetworkopen.2019.1709.
[9] F. Bagheri, F. Abbasi, M. Sadeghi, and R. Khajouei, “Evaluating the usability of a cancer registry system using Cognitive Walkthrough, and assessing user agreement with its problems,” BMC Med. Inform. Decis. Mak., vol. 23, no. 1, p. 23, Jan. 2023, doi: 10.1186/s12911-023-02120-8.
[10] M. A. Clarke, R. M. Schuetzler, J. R. Windle, E. Pachunka, and A. Fruhling, “Usability and cognitive load in the design of a personal health record,” Health Policy Technol., vol. 9, no. 2, pp. 218–224, Jun. 2020, doi: 10.1016/j.hlpt.2019.10.002.
[11] J. R. Lewis, “The System Usability Scale: Past, Present, and Future,” Int. J. Hum. Comput. Interact., vol. 34, no. 7, pp. 577–590, Jul. 2018, doi: 10.1080/10447318.2018.1455307.
[12] R. A. Grier, A. Bangor, P. Kortum, and S. C. Peres, “The System Usability Scale,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 57, no. 1, pp. 187–191, Sep. 2013, doi: 10.1177/1541931213571042.
[13] S. C. Peres, T. Pham, and R. Phillips, “Validation of the System Usability Scale (SUS),” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 57, no. 1, pp. 192–196, Sep. 2013, doi: 10.1177/1541931213571043.
[14] M. D. R. Sevilla-Gonzalez et al., “Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation,” JMIR Hum. Factors, vol. 7, no. 4, p. e21161, Dec. 2020, doi: 10.2196/21161.
[15] N. Charness and W. R. Boot, “A Grand Challenge for Psychology: Reducing the Age-Related Digital Divide,” Curr. Dir. Psychol. Sci., vol. 31, no. 2, pp. 187–193, Apr. 2022, doi: 10.1177/09637214211068144.
[16] G. Hülür and B. Macdonald, “Rethinking social relationships in old age: Digitalization and the social lives of older adults.,” American Psychologist, vol. 75, no. 4, pp. 554–566, May 2020, doi: 10.1037/amp0000604.
[17] M. Barodi and S. Lalaoui, “Civil servants’ readiness for AI adoption: The role of change management in Morocco’s public sector,” Problems and Perspectives in Management, vol. 23, no. 1, pp. 63–75, Jan. 2025, doi: 10.21511/ppm.23(1).2025.05.
[18] A. A. Yuniarto and I. W. Siregar, “From Manual to Digital: Modernizing the Sales Recording System for Growth at MSME Rumah Abon,” Journal of Scientific Insights, vol. 2, no. 5, pp. 510–525, Sep. 2025, doi: 10.69930/jsi.v2i5.537.
[19] J. Nielsen, Designing Web Usability: The Practice of Simplicity. New Riders, 2000.
[20] M. Hyzy et al., “System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis,” JMIR Mhealth Uhealth, vol. 10, no. 8, p. e37290, Aug. 2022, doi: 10.2196/37290.
[21] A. Jamal et al., “Usability Analysis of a Health Sciences Digital Library by Medical Residents: Cross-sectional Survey,” JMIR Form. Res., vol. 5, no. 6, p. e23293, Jun. 2021, doi: 10.2196/23293.
[22] F. Purwani and F. A. Farhah, “Usability Testing Analysis on Professional Social Media Using The System Usability Scale (SUS) Method,” Jurnal Perangkat Lunak, vol. 6, no. 3, pp. 392–399, Oct. 2024, doi: 10.32520/jupel.v6i3.3426.
[23] S. B. Harper and S. L. Dorton, “A Pilot Study on Extending the SUS Survey: Early Results,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 65, no. 1, pp. 447–451, Sep. 2021, doi: 10.1177/1071181321651162.
[24] H. Jo and D.-H. Park, “Mechanisms for successful management of enterprise resource planning from user information processing and system quality perspective,” Sci. Rep., vol. 13, no. 1, p. 12678, Aug. 2023, doi: 10.1038/s41598-023-39787-y.
[25] F. Fitria, M. Yahya, M. I. Ali, P. Purnamawati, and A. M. Mappalotteng, “The Impact of System Quality and User Satisfaction: The Mediating Role of Ease of Use and Usefulness in E-Learning Systems,” International Journal of Environment, Engineering and Education, vol. 6, no. 2, pp. 119–131, Aug. 2024, doi: 10.55151/ijeedu.v6i2.134.
[26] M. A. Faudzi, Z. C. Cob, S. A. Sharudin, R. Omar, and M. Ghazali, “The Effects of User Interface Design for Mobile Learning Application on Learner’s Extraneous Cognitive Load: A Conceptual Framework,” in Asian HCI Symposium’23, New York, NY, USA: ACM, Apr. 2023, pp. 51–57. doi: 10.1145/3604571.3604579.
[27] M. A. Faudzi, Z. C. Cob, M. Ghazali, R. Omar, and S. A. Sharudin, “User interface design in mobile learning applications: Developing and evaluating a questionnaire for measuring learners’ extraneous cognitive load,” Heliyon, vol. 10, no. 18, p. e37494, Sep. 2024, doi: 10.1016/j.heliyon.2024.e37494.
[28] W. T. Nakamura, E. C. de Oliveira, E. H. T. de Oliveira, D. Redmiles, and T. Conte, “What factors affect the UX in mobile apps? A systematic mapping study on the analysis of app store reviews,” Journal of Systems and Software, vol. 193, p. 111462, Nov. 2022, doi: 10.1016/j.jss.2022.111462.
[29] D. Biduski, E. A. Bellei, J. P. M. Rodriguez, L. A. M. Zaina, and A. C. B. De Marchi, “Assessing long-term user experience on a mobile health application through an in-app embedded conversation-based questionnaire,” Comput. Human Behav., vol. 104, p. 106169, Mar. 2020, doi: 10.1016/j.chb.2019.106169.
[30] O. Grljević, M. Marić, and R. Božić, “Exploring Mobile Application User Experience Through Topic Modeling,” Sustainability, vol. 17, no. 3, p. 1109, Jan. 2025, doi: 10.3390/su17031109.
[31] W. Ali, O. Riaz, S. Mumtaz, A. R. Khan, T. Saba, and S. A. Bahaj, “Mobile Application Usability Evaluation: A Study Based on Demography,” IEEE Access, vol. 10, pp. 41512–41524, 2022, doi: 10.1109/ACCESS.2022.3166893.