Evaluasi Perkuliahan Daring Menggunakan Metode Naive Bayes dan Post-Study System Usability Questionnaire (PSSUQ)
DOI:
https://doi.org/10.61769/telematika.v18i1.539Keywords:
online learning, effectiveness analysis, usability test, PSSUQ, Naive BayesAbstract
The spread of Covid-19 to almost all countries in the world affects various aspects of human life. Through Circular Letter Number 4 of 2020 concerning the Implementation of Education Policies in the Emergency Period of the Spread of Covid-19, the government decided to change the implementation of offline learning to online learning. XYZ University in Bandung City already has a Quality Assurance Division that is tasked with evaluating the use of information technology (IT) for the offline learning process, but it also needs an IT utilization evaluation instrument related to all aspects of online learning. This research aims to create an online learning evaluation system based on international standards by considering the quality aspects of the educational system, support system, learner quality, instructor quality, and information quality. PSSUQ method is used for 4 assessment categories with a 7-point Likert scale assessment of the technology usability concept. Meanwhile, the Naive Bayes method is used to analyse the polarity of comments related to the effectiveness of IT utilization in the online learning process. The results obtained from research on students of the Department of Information Systems class of 2018 and 2019, obtained 18 subcategories successfully exceeded the target with a score of 5.18. The ease to learn and ease to use subcategories have the highest average score of 6.30, while the previous experience subcategory has the lowest average score of 5.18. The ease to learn and ease to use subcategories have the highest average score of 6.30, while the previous experience subcategory has the lowest average score of 5.26. For processing the polarity of comments regarding the ease to use subcategory, a positive sentiment of 90.3% was obtained, visualized using a word cloud. The results of this study show that out of 24 subcategories of assessment aspects, only 1 is still below the average target and the utilization of IT in the online learning process meets its utilization objectives. The resulting evaluation instrument can be utilized as part of a sustainable quality assurance process.
References
Kemendikbud, “Surat Edaran Mendikbud No. 4 Tahun 2020 Tentang Pelaksanaan Kebijakan Pendidikan dalam Masa Darurat Penyebaran Corona Virus Disease (Covid- 19),” 2020. https://pusdiklat.kemdikbud.go.id/surat-edaran-mendikbud-no-4-tahun-2020-tentang-pelaksanaan-kebijakan-pendidikan-dalam-masa-darurat-penyebaran-corona-virus-disease-covid-1-9/
S. M. Gaib, M. Nanja, dan H. Dalai, “Analisis efektivitas pembelajaran daring Google Classroom menggunakan metode Naïve Bayes,” J. Nas. cosPhi, vol. 5, no. 2, hlm. 2597–9329, 2021.
T. H. Sirait, C. Fiarni, dan D. Meisinta, “Analisis tingkat kematangan teknologi informasi (studi kasus: kampus XYZ ),” J. Telemat., vol. 17, no. 1, hlm. 32–41, 2022.
C. Bheki Mpungose dan S. Khoza, “Postgraduate students’ experiences on the use of Moodle and Canvas learning management system,” Technol. Knowl. Learn., vol. 27, no. 4, hlm. 1–16, 2022, doi: 10.1007/s10758-020-09475-1.
F. Demir, Bruce-Kotey, dan F. Alenezi, “User experience matters: does one size fit all? Evaluation of learning management systems,” Technol. Knowl. Learn., vol. 27, no. 2, hlm. 49–67, 2022, doi: 10.1007/s10758-021-09518-1.
J. Han, J. Pei, dan M. Kamber, Data Mining: Concepts and Techniques, Second Edition (The Morgan Kaufmann Series in Data Management Systems), 2nd ed. Massachusetts: Morgan Kaufmann Publisher, 2006.
D. Al-Fraihat, M. Joy, R. Masa’deh, dan J. Sinclair, “Evaluating e-learning systems success: an empirical study,” Comput. Human Behav., vol. 102, no. January 2020, hlm. 67–86, 2019, doi: 10.1016/j.chb.2019.08.004.
F. Martin, D. Polly, A. Jokiaho, dan B. May, “Global standards for enhancing quality in online learning,” Q. Rev. Distance Educ., vol. 18, no. 2, hlm. 1–10, 2017.
Paulina, U. Rosidin, dan C. Ertikanto, “Instrumen penilaian pembelajaran bermuatan ketuhanan dan kecintaan terhadap lingkungan,” J. Pembelajaran Fis., vol. 2, no. 2, hlm. 29–40, 2014.
C. Fiarni, H. Maharani, dan E. Irawan, “Implementing rule-based and naive bayes algorithm on incremental sentiment analysis system for Indonesian online transportation services review,” Proc. 2018 10th Int. Conf. Inf. Technol. Electr. Eng. Smart Technol. Better Soc. ICITEE 2018, July, hlm. 597–602, 2018, doi: 10.1109/ICITEED.2018.8534912.
R. N. Devita, H. W. Herwanto, dan A. P. Wibawa, “Perbandingan kinerja metode Naive Bayes dan k-nearest neighbor untuk klasifikasi artikel berbahasa Indonesia,” J. Teknol. Inf. dan Ilmu Komput., vol. 5, no. 4, hlm. 427–434, 2018, doi: 10.25126/jtiik.201854773.
A. L. Fruhling dan S. Lee, “Assessing the reliability, validity, and adaptability of PSSUQ,” dalam A Conference on a Human Scale. 11th Americas Conference on Information Systems (AMCIS 2005), 2005.
I. Pujihastuti, “Prinsip penulisan kuesioner penelitian,” J. Agribisnis dan Pengemb. Wil., vol. 2, no. 1, hlm. 43–56, 2010.
G. Mills and L. Gay, Educational Research: Competencies for Analysis and Applications, 12th ed. London: Pearson, 2018.
S. M. Mohammad, “A practical guide to sentiment annotation: Challenges and solutions,” in Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, WASSA 2016 at the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, September, hlm. 174–179. doi: 10.18653/v1/w16-0429.
W. Syafitri, “Penilaian risiko keamanan informasi menggunakan metode NIST 800-30,” J. CoreIT, vol. 2, no. 2, hlm. 8–13, 2016.
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Cut Fiarni, Yosi Yonata, Romario
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
