PODCAST-BASED LEARNING: EVALUATING THE SUCCESS OF LEARNING MEDIA DEVELOPMENT IN VOCATIONAL EDUCATION

R Eka Murtinugraha, Shilmi Arifah, Rosmawita Saleh, Riyan Arthur, Nindya Reza Ostiyani

Abstract


Purpose – This study evaluates the success of developing podcast-based learning media in Vocational Education Management courses in higher education. The background of this study is the need for innovation in learning media responsive to the development of digital technology, especially in supporting vocational learning that emphasizes practical and applied skills.

Methodology – This study uses a quantitative approach with a survey design and an explanatory and correlational approach through the Partial Least Squares Structural Equation Modeling (PLS-SEM) method. The sampling technique was randomly conducted on 168 students from five Building Engineering Education Study Program classes who had taken the course. The research instrument covers six variables: content, technical aspects, learning design, involvement and motivation, implementation and benefits, and perceived usefulness.

Findings – The results showed that all indicators met convergent validity with an AVE value above 0.847 and high consistent reliability (CR> 0.95). The six aspects of the study contributed an influence of 87.10%, and the five measurement variables contributed 50.40%. Hypothesis H-DIR5 (IBA→PU) obtained a value of β = 0.213, T-statistic = 2.847 and ρ-value = 0.005. Based on this, the value of the technical aspect, implementation aspects, and benefits has a positive influence, which means that the more the two aspects increase, the more the perceived usefulness of media development increases.

Significance – This study provides an empirical evaluation model for the effectiveness of podcast-based learning media in vocational education. These findings can be the basis for developing digital learning strategies that are more effective, interactive, and relevant to students' needs and the demands of the world of work in the digital era. In addition, this study's results can enrich the literature on applying the PLS-SEM model in evaluating technology-based learning media in higher education environments.


Keywords


Evaluation, PLS-SEM, Podcast, Higher Education, Vocational Education Management

Full Text:

PDF

References


Achtenhagen, C., & Leona. (2019). The impact of digital technologies on vocational education and training needs: An exploratory study in the German food industry. Education + Training, 61(2), 222–233. https://doi.org/10.1108/ET-05-2018-0119

Adams, P. (2006). Exploring social constructivism: Theories and practicalities. Education 3-13, 34(3), 243–257. https://doi.org/10.1080/03004270600898893

Agustini, M., Yufiarti, Y., & Wuryani, W. (2020). Development of Learning Media based on Android Games for Children with Attention Deficit Hyperactivity Disorder. International Journal of Interactive Mobile Technologies (iJIM), 14(06), Article 06. https://doi.org/10.3991/ijim.v14i06.13401

Akram, H., & Abdelrady, A. H. (2022). Teachers’ Perceptions of Technology Integration in Teaching-Learning Practices: A Systematic Review. Frontiers in Psychology, 13(5), 23–40. https://doi.org/10.3389/fpsyg.2022.920317

Al-Fraihat, D., Joy, M., Masa'deh, R., & Sinclair, J. (2020). Evaluating E-learning systems' success: An empirical study. Computers in Human Behavior, 102, 67–86. https://doi.org/10.1016/j.chb.2019.08.004

Arifin, Z., Nurtanto, M., Priatna, A., Kholifah, N., & Fawaid, M. (2020). Technology Andragogy Work Content Knowledge Model as a New Framework in Vocational Education: Revised Technology Pedagogy Content Knowledge Model. TEM Journal, 9(2), 786–791. https://doi.org/10.18421/TEM92-48

Arthars, N., Thompson, K., & Sherry. (2025). Addressing skills shortages: Vocational education and training in schools, programs, and the Universities Accord. Journal of Higher Education Policy and Management, 47(3), 335–350. https://doi.org/10.1080/1360080X.2025.2478962

Astuti, M., Arifin, Z., Nurtanto, M., Mutohhari, F., & Warju, W. (2022). The maturity levels of the digital technology competence in vocational education. International Journal of Evaluation and Research in Education (IJERE), 11(2), Article 2. https://doi.org/10.11591/ijere.v11i2.22258

Bozkurt, A. (2020). Educational Technology Research Patterns in the Realm of the Digital Knowledge Age. Journal of Interactive Media in Education, 2020(1), 1–17. https://doi.org/10.5334/jime.570

Daryono, R. W., Hidayat, N., Nurtanto, M., & Fu'adi, A. (2024). Developing a competency framework for architectural engineering graduates: Perspectives by the construction industry in Indonesia. Journal of Technology and Science Education, 14(2), Article 2. https://doi.org/10.3926/jotse.1986

Daryono, R. W., Ramadhan, M. A., Kholifah, N., Isnantyo, F. D., & Nurtanto, M. (2023). An empirical study will be conducted to evaluate the student competency of vocational education. International Journal of Evaluation and Research in Education (IJERE), 12(2), Article 2. https://doi.org/10.11591/ijere.v12i2.22805

Daryono, R. W., Rochmadi, S., & Hidayat, N. (2021). Development and validation of video-based learning media to increase competency achievement in civil engineering education. Journal of Physics: Conference Series, 1833(1–10), 012022. https://doi.org/10.1088/1742-6596/1833/1/012022

Das, P., & Pradip, D. (2021). Usability and effectiveness of new media in agricultural learning and development: A case study on the southern states of India. Journal of Social Marketing, 11(4), 357–377. https://doi.org/10.1108/JSOCM-11-2019-0203

Fan, X. (2022). The development of EFL Learners' willingness to communicate and self-efficacy: The role of the flipped learning approach with social media. Frontiers in Psychology, 13(3), 1–12. https://doi.org/10.3389/fpsyg.2022.1001283

Fauzan, A., Triyono, M. B., Hardiyanta, R. A. P., Daryono, R. W., & Arifah, S. (2023). The Effect of Internship and Work Motivation on Students’ Work Readiness in Vocational Education: PLS-SEM Approach. Journal of Innovation in Educational and Cultural Research, 4(1), Article 1. https://doi.org/10.46843/jiecr.v4i1.413

Fawaid, M., Triyono, M. B., Sofyan, H., Nurtanto, M., Mutohhari, F., Jatmoko, D., Majid, N. W. A., & Rabiman, R. (2022). Entrepreneurial Intentions of Vocational Education Students in Indonesia: PLS-SEM Approach. Journal of Technical Education and Training, 14(2), Article 2. https://publisher.uthm.edu.my/ojs/index.php/JTET/article/view/11375

Hair, J., & Alamer, A. (2022). Partial Least Squares Structural Equation Modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 1–21. https://doi.org/10.1016/j.rmal.2022.100027

Hair, J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109(2), 101–110. https://doi.org/10.1016/j.jbusres.2019.11.069

Hanif, A., Herman, M. A., & Rahmi, P. W. L. (2023). Development of the QUIZIZZ Platform as an Interactive Quiz-Based Learning Media for Arabic Language Lessons at Madrasah IBTIDAIYAH. International Journal of Membrane Science and Technology, 10(2), Article 2. https://doi.org/10.15379/ijmst.v10i2.1207

Hariyanto, V. L., Daryono, R. W., Hidayat, N., Prayitno, S. H., & Nurtanto, M. (2022). A framework for measuring the level of achievement of vocational students' competency in architecture education. Journal of Technology and Science Education, 12(1), Article 1. https://doi.org/10.3926/jotse.1188

Hashim, R., Aldaba, A. M., M.Haneef, M. A., & Noordin, M. F. (2023). Partial Least Squares Modelling of Factors Influencing Empathy among Malaysian Secondary School Students. Malaysian Journal of Learning and Instruction, 20(1), Article 1. https://doi.org/10.32890/mjli2023.20.1.4

He, L., & Hamid, H. B. (2024). The suitability of skilled talent training in higher vocational colleges based on AI and 5G network connection in educational transformation and upgrading. Journal of Infrastructure, Policy and Development, 8(12), Article 12. https://doi.org/10.24294/jipd.v8i12.6964

Hennessy, S., D’Angelo, S., McIntyre, N., & Koomar, S. (2022). Technology Use for Teacher Professional Development in Low- and Middle-Income Countries: A systematic review. Computers and Education Open, 3(3), 1–13. https://doi.org/10.1016/j.caeo.2022.100080

Istiningsih, I. (2022). Impact of ICT integration on vocational high school teacher TPACK development in the digital age 4.0. World Journal on Educational Technology: Current Issues, 14(1), Article 1. https://doi.org/10.18844/wjet.v14i1.6642

Jaedun, A., Nurtanto, Muhammad, Mutohhari, Farid, Saputro, Ida Nugroho, & and Kholifah, N. (2024). Perceptions of vocational school students and teachers on developing interpersonal skills towards Industry 5.0. Cogent Education, 11(1), 2375184. https://doi.org/10.1080/2331186X.2024.2375184

Kaniawati, E., Mardani, M. E. M., Lestari, S. N., Nurmilah, U., & Setiawan, U. (2023). Evaluasi Media Pembelajaran. Journal of Student Research (JSR), 1(2), 18–32.

Kebede, A., Asgedom, A., & Asfaw, A. (2024). Is linking technical and vocational training with industry a bridge to employability? Lessons from a literature review for Ethiopia. Cogent Education, 11(1), 2406721. https://doi.org/10.1080/2331186X.2024.2406721

Khajornsilp, J., Mahaniyom, S., & Kenjaturas, A. (2021). The Development of a Physical Education Teaching Model in the COVID—19 Situation Based on the Concept of Active Learning with Digital Technology Media of Students in the Field of Physical Education and Health, Faculty of Education, Thailand National Sports University, Chon Buri Campus. Journal of Curriculum and Teaching, 10(4), Article 4. https://doi.org/10.5430/jct.v10n4p55

Kholifah, N., Nurtanto, M., Mutohhari, F., Majid, N. W. A., & Fawaid, M. (2024). The Role of Digital Technology Competency and Psychological Capital in Vocational Education Students: The Mediating Role of Entrepreneurial Self-Efficacy. Journal of Technical Education and Training, 16(3), Article 3. https://publisher.uthm.edu.my/ojs/index.php/JTET/article/view/15640

Kusdiyanti, H., Karkono, Sopingi, Febrianto, I., Wijaya, R., & Agustina, N. I. (2022). Development of Edu-Kit Media for Entrepreneurship Learning based on Gamification Model Toward Disruptive Education. International Journal of Interactive Mobile Technologies (iJIM), 16(04), Article 04. https://doi.org/10.3991/ijim.v16i04.28985

Kusuma, W. M., Sudira, P., Hasibuan, M. A., & Daryono, R. W. (2021). The Perceptions of Vocational School Students of Video Animation-Based Learning Media to Operate Lathes in Distance Learning. Journal of Education Technology, 5(2), Article 2. https://doi.org/10.23887/jet.v5i2.33139

Laufer, M., Leiser, A., Deacon, B., Perrin de Brichambaut, P., Fecher, B., Kobsda, C., & Hesse, F. (2021). Digital higher education: A divider or bridge builder? Leadership perspectives on edtech in a COVID-19 reality. International Journal of Educational Technology in Higher Education, 18(1), 1–17. https://doi.org/10.1186/s41239-021-00287-6

Mahmud, M., & Barnoto, B. (2023). Manajemen Program Vokasional dalam Meningkatkan Kualitas Peserta Didik. The Joer: Journal Of Education Research, 2(2), 234–241.

Mukaromah, N. H., Fuadi, A., & Daryono, R. W. (2024). Assessing the Impact of Principal Leadership and Teacher Performance on Educational Quality: The Role of TQM as a Mediator. Tarbawi: Jurnal Keilmuan Manajemen Pendidikan, 10(01), Article 01. https://doi.org/10.32678/tarbawi.v10i01.9991

Nguyen, C. Q., Nguyen, A. M. T., & Ba Le, L. (2022). Using partial least squares structural equation modeling (PLS-SEM) to assess the effects of entrepreneurial education on engineering students' entrepreneurial intention. Cogent Education, 9(1), 1–15. https://doi.org/10.1080/2331186X.2022.2122330

Novaliendry, D., Saltriadi, K. S., Mahyuddin, N., Sriwahyuni, T., & Ardi, N. (2022). Development of Interactive Media Based on Augmented Reality for Early Childhood Learning Around the Home. International Journal of Interactive Mobile Technologies (iJIM), 16(24), Article 24. https://doi.org/10.3991/ijim.v16i24.34501

Nurdianah, E., Sudira, P., & Daryono, R. W. (2022). Mobile-Based Application to Integrate Vocational Learning and Career Learning in Mechatronics Engineering Vocational High School. Journal of Education Technology, 6(3), Article 3. https://doi.org/10.23887/jet.v6i3.43669

Purnomo, A. K., Munir, M., & Daryono, R. W. (2024). The Role of Self-Awareness in Mediating the Influence of Islamic Boarding School Policies and Regulations on the Competency Development of Santri: PLS-SEM Approach. AL-ISHLAH: Jurnal Pendidikan, 16(3), Article 3. https://doi.org/10.35445/alishlah.v16i3.5179

Putri, L. M., & Daryono, R. W. (2024). Factor Analysis of Militant Attitudes with Prophetic Intellectual Principles in Muhammadiyah Organizations in Higher Education. JED (Jurnal Etika Demokrasi), 9(2), Article 2. https://doi.org/10.26618/jed.v9i2.14505

Reich, A., Rooney, D., & Lizier, A. L. (2021). Using technology integration frameworks in vocational education and training. International Journal of Training Research, 19(2), 93–106. https://doi.org/10.1080/14480220.2020.1864447

Richard, G. S., Joseph, A., Elikem, K., & Edem, B. K. (2023). Technology Integration in Technical and Vocational Education and Training (TVET): The Role of the Art Teacher. Journal of Technical Education and Training, 15(4), Article 4. https://publisher.uthm.edu.my/ojs/index.php/JTET/article/view/14648

Safiah, I., Yunus, M., Ahadin, Mislinawati, & Abdar, Y. (2023). OLM's Development to Improve Students' Ability to Produce Learning Media. International Journal of Emerging Technologies in Learning (iJET), 18(05), Article 05. https://doi.org/10.3991/ijet.v18i05.28437

Saifudin, I., Basuki, B., & Daryono, R. W. (2024). Exploring the Influence of Learning Intention and Usmani Methods on Reciting Al-Qur’an in Higher Education: Does the Mediation of Peer Teaching Matter? Abjadia : International Journal of Education, 9(1), Article 1. https://doi.org/10.18860/abj.v9i1.26607

Sánchez-Prieto, J., Trujillo-Torres, J. M., Gómez-García, M., & Gómez-García, G. (2021). Incident Factors in the Sustainable Development of Digital Teaching Competence in Dual Vocational Education and Training Teachers. European Journal of Investigation in Health, Psychology and Education, 11(3), Article 3. https://doi.org/10.3390/ejihpe11030054

Sarstedt, M., Hair, J. F., Nitzl, C., Ringle, C. M., & Howard, M. C. (2020). Beyond a tandem analysis of SEM and PROCESS: Use of PLS-SEM for mediation analyses! International Journal of Market Research, 62(3), 288–299. https://doi.org/10.1177/1470785320915686

Schnurr, M. A., & Taylor, A. (2021). Simulating the Sustainable Development Goals: Scaffolding, Social Media and Self-Reported Learning Outcomes Amongst Entry-Level Students. Journal of Political Science Education, 17(sup1), 255–274. https://doi.org/10.1080/15512169.2021.1920419

Sifuentes, R. I., & Chans, G. M. (2023). DiplomaTec: An experimental and gamified tool that contributes to vocational guidance and career decision-making for high school students. Proceedings of the 7th International Conference on Education and Multimedia Technology, 194–198. https://doi.org/10.1145/3625704.3625709

Widayanto, L. D., Soeharto, S., Sudira, P., Daryono, R. W., & Nurtanto, M. (2021). Implementing the Education and Training Program can be seen from the CIPPO Perspective. Journal of Education Research and Evaluation, 5(4), Article 4. https://doi.org/10.23887/jere.v5i4.36826

Widyastuti, P., Hadi, S., Daryono, R. W., & Samad, N. B. A. (2023). The Mediation Role of University Environment in the Relationship between Self-Efficacy and Family Environment on Entrepreneurial Education Interest: A PLS-SEM Approach. Indonesian Journal on Learning and Advanced Education (IJOLAE), 5(3), Article 3. https://doi.org/10.23917/ijolae.v5i3.22015

Wu, X. (2021). Application of Artificial Intelligence in Modern Vocational Education Technology. Journal of Physics: Conference Series, 1881(3), 1–7. https://doi.org/10.1088/1742-6596/1881/3/032074

Xie, Z., Feng, L., & Cen, M. (2025). Research on the Design of Quality Evaluation System of Vocational Education Industry-Teaching Integration Based on Hierarchical Analysis Method. Journal of Combinatorial Mathematics and Combinatorial Computing, 127b(1), 735–756. https://doi.org/10.61091/jcmcc127b-041

Zaenab, Z., Samsudi, S., Hidayah, I., & Wahyudin, A. (2023). Implementation of the Independent Curriculum in Digital Literacy Training for Interactive Learning Media to Improve Pedagogic Competencies of Teachers in MTsN Gowa Regency. International Conference on Science, Education, and Technology, 9(5), 899–906. https://proceeding.unnes.ac.id/ISET/article/view/2528

Zeng, J., Sun, T., & Zhang, L. (2025). Evaluation of scientific and technological innovation efficiency at Shandong Vocational and Technical University of International Studies: A two-stage DEA model approach. PLOS ONE, 20(5), 1–19. https://doi.org/10.1371/journal.pone.0318020

Zhou, X., Smith, C. J. M., & Al-Samarraie, H. (2023). Digital technology adaptation and initiatives: A systematic review of teaching and learning during COVID-19. Journal of Computing in Higher Education, 23, 1–22. https://doi.org/10.1007/s12528-023-09376-z

Zulmi, N., & Tentama, F. (2024). The effect of entrepreneurial readiness, adversity quotient, and social intelligence on students' employability. Journal of Education and Learning (EduLearn), 18(1), Article 1. https://doi.org/10.11591/edulearn.v18i1.20770




DOI: https://doi.org/10.36987/jes.v12i4.7400

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Shilmi Arifah

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Lisensi Creative Commons
Jurnal Eduscience (JES) by LPPM Universitas Labuhanbatu is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY - NC - SA 4.0)