Evaluation of a UPOU MOOC in terms of Selected Metrics from the Biggs’ 3P Model: Process Variable Result
Abstract
Since 2012, the University of the Philippines Open University (UPOU), following its mission of providing greater access to quality education and Republic Act 10650 (Open Distance Learning Law), has been offering Massive Open Online Courses, or MOOCs (Almodiel et al., 2020). However, evaluation of MOOCs must be done to ensure that learners are receiving quality education. This study follows the MOOC Quality Guidelines’ framework using Biggs’ (1993) 3P Model by the Commonwealth of Learning (2016). For this research, the August 2022 MOOC “Artificial Intelligence for Quality Assurance in Education” was assessed for quality assurance. It was evaluated in terms of selected metrics from the Biggs’ 3P Model, with this paper presenting the results of evaluating the learning process as a process variable. The process variable in this study refers to discussion forum posts made by the learner after every module. Only the posts made by learners who had given their consent for the study were analyzed using the Linguistic Inquiry and Word Count (LIWC) in three dimensions: analytic, clout, and dictionary words. With a total of 70 participants—42 male and 28 female—results showed a high percentage of engagement and quality of the posts from its analytics (66%-76%) and dictionary words (81%-87%), with average frequency (42%-55%) under the clout dimension. Evaluation of the MOOC will help provide best practices in offering MOOCS, thereby contributing to society as an open university in providing quality education for all. Results on the presage and product variables will be discussed in separate papers.
Received Date: April 10, 2025
Revised Date: May 15, 2025
Accepted Date: June 14, 2025
Click to Access and Download the Article:
References
- Allison, J. (2021). The Importance of Context: Assessing the Challenges of K-12 Computing Education through the Lens of Biggs 3P Model. In 21st Koli Calling International Conference on Computing Education Research (pp. 1–10).
- Almodiel, M. C., Mampusti, K. G. A., & Tanay, S. (2020). Social Media as Communication and Learner Support Tool in Massive Open Online Courses (MOOCs). International Journal on Open and Distance e-Learning (IJODEL), 6(1).
- Andres, J. M. L., Baker, R. S., Gašević, D., Siemens, G., Crossley, S. A., & Joksimović, S. (2018). Studying MOOC completion at scale using the MOOC replication framework. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 71–78).
- Barattucci, M. (2017). Approach to Study as an Indicator of the Quality of Teaching and of Learning Environment: the contribution of John Biggs. Journal of e-Learning and Knowledge Society, 13(2).
- Baturay, M. H. (2015). An overview of the world of MOOCs. Procedia-Social and Behavioral Sciences, 174, 427–433.
- Biggs, J. (1993). What do inventories of students' learning processes really measure? A theoretical review and clarification. British Journal of Educational Psychology, 63(1), 3–19.
- Chaplot, D. S., Rhim, E., & Kim, J. (2015). Predicting student attrition in MOOCs using sentiment analysis and neural networks. In Work. 17th Int. Conf. Artif. Intell. Educ. AIED-WS 2015 (Vol. 1432, pp. 7–12).
- Commonwealth of Learning. (2016). Guidelines for Quality Assurance and Accreditation of MOOCs. Commonwealth of Learning.
- Crowther, L. L., Robertson, N., & Anderson, E. S. (2020). Mindfulness for undergraduate health and social care professional students: Findings from a qualitative scoping review using the 3P model. Medical Education, 54(9), 796–810. https://doi.org/10.1111/medu.14151
- Ganotice Jr, F. A., & Chan, L. K. (2019). How can students succeed in computer-supported interprofessional team-based learning? Understanding the underlying psychological pathways using Biggs' 3P model. Computers in Human Behavior, 91, 211–219. https://doi.org/10.1016/j.chb.2018.09.020
- Hussein, D. M. E. D. M. (2018). A survey on sentiment analysis challenges. Journal of King Saud University-Engineering Sciences, 30(4), 330–338. https://doi.org/10.1016/j.jksues.2017.06.002
- Jansen, D., Rosewell, J., & Kear, K. (2017). Quality frameworks for MOOCs. In Open education: from OERs to MOOCs (pp. 261–281).
- Kanashiro, P., Iizuka, E. S., Sousa, C., & Dias, S. E. F. (2020). Sustainability in management education: A Biggs' 3P model application. International Journal of Sustainability in Higher Education, 21(4), 671–684. https://doi.org/10.1108/IJSHE-10-2019-0300
- Kember, D., Webster, B. J., & Chan, W. S. (2020). Refocusing the 3P model to incorporate a learning and teaching environment and graduate attributes. Educational Psychology, 40(5), 592–607. https://doi.org/10.1080/01443410.2019.1678142
- Librero, A. F. D. (2020). Benchmarking for Quality of UPOU MOOCs (Chapter 10). In M. F. Lumanta & P. G. Garcia (Eds.), QUALITY INITIATIVES IN AN OPEN AND DISTANCE e-LEARNING INSTITUTION: Towards Excellence and Equity (pp. 157–172). University of the Philippines Open University.
- LIWC. (2022). LIWC Website. https://www.liwc.app
- Lundqvist, K., Liyanagunawardena, T., & Starkey, L. (2020). Evaluation of student feedback within a mooc using sentiment analysis and target groups. International Review of Research in Open and Distributed Learning, 21(3), 140–156. https://doi.org/10.19173/irrodl.v21i3.4735
- Moore, R. L., Oliver, K. M., & Wang, C. (2019). Setting the pace: Examining cognitive processing in MOOC discussion forums with automatic text analysis. Interactive Learning Environments, 27(5-6), 655–669. https://doi.org/10.1080/10494820.2018.1517409
- Moreno-Marcos, P. M., Alario-Hoyos, C., Muñoz-Merino, P. J., Estévez-Ayres, I., & Kloos, C. D. (2018, April). Sentiment analysis in MOOCs: A case study. In 2018 IEEE Global Engineering Education Conference (EDUCON) (pp. 1489–1496). IEEE. https://doi.org/10.1109/EDUCON.2018.8363409
- Pennebaker, J. W., Boyd, J., Jordan, K., & Blackburn, K. (2015). The development and psychometric properties of LIWC2015
- Song, J. (2018). Elements in Mol-based College English learning environment-based on Biggs' 3P Model. Advances in Social Science, Education and Information Research, 89, 5–14.
- Tseng, S. F., Tsao, Y. W., Yu, L. C., Chan, C. L., & Lai, K. R. (2016). Who will pass? Analyzing learner behaviors in MOOCs. Research and Practice in Technology Enhanced Learning, 11(1), 1–11. https://doi.org/10.1186/s41039-016-0036-7
- Wen, M., Yang, D., & Rose, C. (2014, July). Sentiment Analysis in MOOC Discussion Forums: What does it tell us?. In Educational Data Mining 2014.
- Wong, J. S., Pursel, B., Divinsky, A., & Jansen, B. J. (2015, March). An analysis of MOOC discussion forum interactions from the most active users. In International conference on social computing, behavioral-cultural modeling, and prediction (pp. 452–457). Springer, Cham. https://doi.org/10.1007/978-3-319-16268-3_51
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
