EVALUASI FORMATIF BUKU PANDUAN PERSONALIZED LEARNING BERBASIS AI TERINTEGRASI LMS

Authors

  • Yulita Molliq Rangkuti Jurusan Matematika, Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Medan, Medan, Sumatera Utara, Indonesia
  • Abdurrahman Adisaputera Jurusan Bahasa dan Sastra Indonesia, Fakultas Bahasa dan Seni, Universitas Negeri Medan, Medan, Sumatera Utara, Indonesia
  • Eddiyanto Eddiyanto Jurusan Kimia, Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Medan, Medan, Sumatera Utara, Indonesia
  • Hutkemri Zulnaidi Department of Mathematics and Science Education, Faculty of Education, Universiti Malaya, Kuala Lumpur 50603, Malaysia
  • Amirrudin Bin Kamsin Department of Computer System and Technology, Faculty of Computer Science and Information Technology, Universiti Malaya, Kuala Lumpur 50603, Malaysia

DOI:

https://doi.org/10.51878/edutech.v6i4.16379

Keywords:

Evaluasi Formatif, Analisis Dokumen, Personalized Learning, Artificial Intelligence, Learning Management System

Abstract

ABSTRACT

The study produced a findings matrix and proposed revisions to learning profiles, attendance tutorials, incident forms, the allocation of responsibilities, and quality indicators. The study employs document analysis during the initial formative evaluation phase of a design-based research project. The corpus comprises the development proposal, the initial version of the guide, and three review reports covering language, quality management, and educational technology/LMS operations. The scores and comments within the review reports represent AI-generated suggestions that have not yet been verified through independent expert assessment. The analysis links review items, problem locations, corrective actions, and verification requirements. Mathematical reconstruction of the scores yields mean indices of 0.500 for language, 0.521 for quality management, and 0.500 for educational technology/LMS. Item B2 was excluded because it evaluated Indonesian language usage in an English-language guide. These indices serve as descriptive summaries of the suggested scores and do not establish content validity. Revision priorities include document consistency, navigation, accessibility, resources, menu instructions, recovery mechanisms, and compatibility. The study produced a findings matrix and proposed revisions to the guide for learning profiles, attendance tutorials, incident forms, authority allocation, and quality indicators. Independent expert assessment and verification of revisions are required before determining readiness for pilot testing; the practicality and learning effectiveness have not yet been tested.

ABSTRAK

Penelitian ini bertujuan mengidentifikasi ketidaksesuaian isi dan prosedur dalam buku panduan personalized learning berbasis Artificial Intelligence (AI) terintegrasi Learning Management System (LMS) serta menyusun rancangan revisinya. Kajian menggunakan analisis dokumen pada tahap evaluasi formatif awal penelitian pengembangan berbasis desain. Korpus mencakup proposal pengembangan, panduan versi pertama, dan tiga berkas telaah bidang bahasa, manajemen mutu, serta teknologi pendidikan dan operasional LMS. Skor dan komentar dalam berkas telaah merupakan usulan berbantuan AI yang belum dikonfirmasi melalui penilaian ahli secara mandiri; keduanya dianalisis sebagai isi dokumen, bukan sebagai data penilaian ahli. Analisis menghubungkan butir telaah, lokasi masalah, tindakan koreksi, dan kebutuhan bukti verifikasi. Rekonstruksi matematis skor menghasilkan rerata indeks 0,500 untuk bahasa, 0,521 untuk manajemen mutu, dan 0,500 untuk teknologi pendidikan–LMS. Butir B2 dikeluarkan karena menilai bahasa Indonesia pada panduan berbahasa Inggris. Indeks tersebut merupakan ringkasan deskriptif skor usulan dan tidak membuktikan validitas isi. Prioritas revisi mencakup konsistensi dokumen, navigasi, aksesibilitas, sumber daya, petunjuk menu, pemulihan, dan kompatibilitas. Kajian menghasilkan matriks temuan serta rancangan perbaikan profil belajar, tutorial presensi, formulir insiden, pembagian kewenangan, dan indikator mutu. Penilaian ahli independen serta verifikasi revisi diperlukan sebelum kesiapan uji coba ditetapkan; kepraktisan dan efektivitas pembelajaran belum diuji.

Downloads

Download data is not yet available.

References

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012

Banihashem, S. K., Noroozi, O., van Ginkel, S., Macfadyen, L. P., & Biemans, H. J. A. (2022). A systematic review of the role of learning analytics in enhancing feedback practices in higher education. Educational Research Review, 37, Article 100489. https://doi.org/10.1016/j.edurev.2022.100489

Bayly-Castaneda, K., Ramirez-Montoya, M.-S., & Morita-Alexander, A. (2024). Crafting personalized learning paths with AI for lifelong learning: a systematic literature review. Frontiers in Education, 9, Article 1424386. https://doi.org/10.3389/feduc.2024.1424386

Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024). A meta systematic review of artificial intelligence in higher education: a call for increased ethics, collaboration, and rigour. International Journal of Educational Technology in Higher Education, 21(1), Article 4. https://doi.org/10.1186/s41239-023-00436-z

Brummer, L., de Boer, H., Mouw, J. M., & Strijbos, J. W. (2024). A meta-analysis of the effects of context, content, and task factors of digitally delivered instructional feedback on learning performance. Learning Environments Research, 27(3), 453–476. https://doi.org/10.1007/s10984-024-09501-4

Capp, M. J. (2017). The effectiveness of universal design for learning: a meta-analysis of literature between 2013 and 2016. International Journal of Inclusive Education, 21(8), 791–807. https://doi.org/10.1080/13603116.2017.1325074

Celik, I. (2023). Towards Intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, Article 107468. https://doi.org/10.1016/j.chb.2022.107468

Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: the state of the field. International Journal of Educational Technology in Higher Education, 20(1), Article 22. https://doi.org/10.1186/s41239-023-00392-8

Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. https://doi.org/10.3102/0013189X032001005

Gyamfi, G., Hanna, B. E., & Khosravi, H. (2024). Impact of an instructional guide and examples on the quality of feedback: Insights from a randomised controlled study. Educational Technology Research and Development, 72, 1419–1437. https://doi.org/10.1007/s11423-024-10346-0

Hoadley, C., & Campos, F. C. (2022). Design-based research: What it is and why it matters to studying online learning. Educational Psychologist, 57(3), 207–220. https://doi.org/10.1080/00461520.2022.2079128

Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Buckingham Shum, S., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., & Koedinger, K. R. (2022). Ethics of AI in education: Towards a community-wide framework. International Journal of Artificial Intelligence in Education, 32(3), 504–526. https://doi.org/10.1007/s40593-021-00239-1

Ifenthaler, D., & Schumacher, C. (2016). Student perceptions of privacy principles for learning analytics. Educational Technology Research and Development, 64(5), 923–938. https://doi.org/10.1007/s11423-016-9477-y

Jacobsen, M., & McKenney, S. (2024). Educational design research: Grappling with methodological fit. Educational Technology Research and Development, 72, 2743–2762. https://doi.org/10.1007/s11423-023-10282-5

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274

Khosravi, H., Buckingham Shum, S., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gaševi?, D. (2022). Explainable Artificial Intelligence in education. Computers and Education: Artificial Intelligence, 3, Article 100074. https://doi.org/10.1016/j.caeai.2022.100074

Kleimola, R., Hirsto, L., & Ruokamo, H. (2025). Promoting higher education students’ self-regulated learning through learning analytics: A qualitative study. Education and Information Technologies, 30(4), 4959–4986. https://doi.org/10.1007/s10639-024-12978-4

Liu, Q., & Khalil, M. (2023). Understanding privacy and data protection issues in learning analytics using a systematic review. British Journal of Educational Technology, 54(6), 1715–1747. https://doi.org/10.1111/bjet.13388

Matcha, W., Uzir, N. A., Gaševi?, D., & Pardo, A. (2020). A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. IEEE Transactions on Learning Technologies, 13(2), 226–245. https://doi.org/10.1109/TLT.2019.2916802

McKenney, S., & Reeves, T. C. (2025). Educational design research for relevant & robust scholarship. Journal of Computing in Higher Education, 37(2), 614–638. https://doi.org/10.1007/s12528-025-09456-2

Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741

Ouyang, F., & Jiao, P. (2021). Artificial intelligence in education: The three paradigms. Computers and Education: Artificial Intelligence, 2, Article 100020. https://doi.org/10.1016/j.caeai.2021.100020

Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8, Article 422. https://doi.org/10.3389/fpsyg.2017.00422

Penfield, R. D., & Giacobbi, P. R., Jr. (2004). Applying a score confidence interval to Aiken’s item content-relevance index. Measurement in Physical Education and Exercise Science, 8(4), 213–225. https://doi.org/10.1207/s15327841mpee0804_3

Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147

Prinsloo, P., Slade, S., & Khalil, M. (2022). The answer is (not only) technological: Considering student data privacy in learning analytics. British Journal of Educational Technology, 53(4), 876–893. https://doi.org/10.1111/bjet.13216

van der Linden, J., van der Vleuten, C., Nieuwenhuis, L., & van Schilt-Mol, T. (2023). Formative use of assessment to foster self-regulated learning: The alignment of teachers’ conceptions and classroom assessment practices. Journal of Formative Design in Learning, 7, 195–207. https://doi.org/10.1007/s41686-023-00082-8

Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98–110. https://doi.org/10.1016/j.chb.2018.07.027

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1), Article 39. https://doi.org/10.1186/s41239-019-0171-0

Downloads

Published

2026-11-17

How to Cite

Rangkuti, Y. M., Adisaputera, A., Eddiyanto, E., Zulnaidi, H., & Kamsin, A. B. (2026). EVALUASI FORMATIF BUKU PANDUAN PERSONALIZED LEARNING BERBASIS AI TERINTEGRASI LMS . EDUTECH : Jurnal Inovasi Pendidikan Berbantuan Teknologi, 6(4), 3825–3841. https://doi.org/10.51878/edutech.v6i4.16379

Issue

Section

Articles

Similar Articles

1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.