Leveraging Transformer-based BERTopic Model on Stakeholder Insights Towards Philippine UAQTE

Leveraging Transformer-based BERTopic Model on Stakeholder Insights Towards Philippine UAQTE
  IJETT-book-cover           
  
© 2024 by IJETT Journal
Volume-72 Issue-3
Year of Publication : 2024
Author : Christian Y. Sy, Mary Joy P. Canon, Lany L. Maceda, Nancy M. Flores, Thelma D. Palaoag, Mideth B. Abisado
DOI : 10.14445/22315381/IJETT-V72I3P125

How to Cite?

Christian Y. Sy, Mary Joy P. Canon, Lany L. Maceda, Nancy M. Flores, Thelma D. Palaoag, Mideth B. Abisado, "Leveraging Transformer-based BERTopic Model on Stakeholder Insights Towards Philippine UAQTE," International Journal of Engineering Trends and Technology, vol. 72, no. 3, pp. 277-287, 2024. Crossref, https://doi.org/10.14445/22315381/IJETT-V72I3P125

Abstract
Free tertiary education expanded the scope of opportunities, enabling individuals to transform their aspirations into tangible achievements and empowering the nation’s brightest minds to pave the way for economic and social development. This study aims to analyze and investigate student beneficiaries’ perceptions within the Philippines’ Universal Access to Quality Tertiary Education (UAQTE) framework, contributing to a more informed assessment of its impact on pursuing inclusive educational policies and reforms. The “Boses Ko” toolkit was utilized to collect responses, adopting a ground-up approach to capture insights directly from student beneficiaries across various Higher Education Institutions (HEIs). Through unsupervised machine learning using BERTopic modeling, latent topics and themes were identified within the qualitative data, enabling a holistic understanding of stakeholders’ views. Silhouette and coherence scores and manual assessment by domain experts were used to evaluate the models. Key themes like “Educational Opportunity,” “Program Implementation,” and “Financial Support” were identified. Recommendations for policy reforms include enhancing educational opportunities, streamlining program implementation, and sustaining financial support within the UAQTE program.

Keywords
Free tertiary education, Stakeholder perceptions, Unsupervised machine learning, Topic modeling, BERTopic.

References
[1] Antonietta Di Giulio, and Rico Defila, “Enabling University Educators to Equip Students with Inter-and Transdisciplinary Competencies,” International Journal of Sustainability in Higher Education, vol. 18, no. 5, pp. 630-647, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[2] S. Tomy, and E. Pardede, “An Entrepreneurial Intention Model Focusing on Higher Education,” International Journal of Entrepreneurial Behaviour and Research, vol. 26, no. 7, pp. 1423-1447, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Mark Stafford-Smith et al., “Integration: The Key to Implementing the Sustainable Development Goals,” Sustainability Science, vol. 12, no. 6, pp. 911-919, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Anekwe Rita Ifeoma et al., “Effect of Entrepreneurship Development on Poverty Alleviation in Nigeria,” IOSR Journal of Business and Management (IOSR-JBM), vol. 20, no. 2, ver. 10, pp. 80-87, 2018.
[Google Scholar] [Publisher Link]
[5] Savo Heleta, and Tohiera Bagus, “Sustainable Development Goals and Higher Education: Leaving Many Behind,” Higher Education, vol. 81, no. 1, pp. 163-177, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Peter Messerli et al., “Global Sustainable Development Report 2019: The Future is Now-Science for Achieving Sustainable Development,” Independent Group of Scientists, pp. 1-216, 2019.
[Google Scholar] [Publisher Link]
[7] Raima Nazar et al., “Role of Quality Education for Sustainable Development Goals (SDGS),” People: International Journal of Social Sciences, vol. 4, no. 2, pp. 486-501, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[8] William Rosa et al., A New Era in Global Health Nursing and the United Nations 2030 Agenda for Sustainable Development, Springer Publishing Company, pp. 1-624, 2017.
[Google Scholar] [Publisher Link]
[9] Serena Clark et al., “Including Digital Connection in the United Nations Sustainable Development Goals: A Systems Thinking Approach for Achieving the SDGs,” Sustainability, vol. 14, no. 3, pp. 1-13, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[10] W. Leal Filho et al., “Using the Sustainable Development Goals towards a Better Understanding of Sustainability Challenges,” International Journal of Sustainable Development and World Ecology, vol. 26, no. 2, pp. 179-190, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Congress of the Philippines, Republic Act No. 10931, Seventeenth Congress, Republic of the Philippines, 2017. [Online]. Available: https://lawphil.net/statutes/repacts/ra2017/ra_10931_2017.html
[12] Kidjie Saguin, “The Politics of De-Privatisation: Philippine Higher Education in Transition,” Journal of Contemporary Asia, vol. 53, no. 3, pp. 471-493, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Joy N. Emmanuel, “Affordability in College Access: Improving Equitable Value for Low-Income, First-Generation, and Students of Color,” The Vermont Connection, vol. 44, no. 1, pp. 1-16, 2023.
[Google Scholar] [Publisher Link]
[14] Divina Edralin, and Ronald Pastrana, “Technical and Vocational Education and Training in the Philippines: In Retrospect and its Future Directions,” Bedan Research Journal, vol. 8, no. 1, pp. 138-172, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Adithya Kumar Maiya, and P.S. Aithal, “A Review based Research Topic Identification on How to Improve the Quality Services of Higher Education Institutions in Academic, Administrative, and Research Areas,” International Journal of Management, Technology, and Social Sciences (IJMTS), vol. 8, no. 3, pp. 103-153, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Mustafa Kayyali, “The Relationship between Rankings and Academic Quality,” International Journal of Management, Sciences, Innovation, and Technology IJMSIT, vol. 4, no. 3, pp. 1-11, 2023.
[Google Scholar] [Publisher Link]
[17] Stephanie Sevillano, 2.46M Filipinos Get Free College Education under the Duterte Admin, Philippine News Agency, 2022. [Online]. Available: https://www.pna.gov.ph/articles/1175587
[18] Firas Saidi, Zouheir Trabelsi, and Eswari Thangaraj, “A Novel Framework for Semantic Classification of Cyber Terrorist Communities on Twitter,” Engineering Applications of Artificial Intelligence, vol. 115, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Karoliina Isoaho, Daria Gritsenko, and Eetu Mäkelä, “Topic Modeling and Text Analysis for Qualitative Policy Research,” Policy Studies Journal, vol. 49, no. 1, pp. 300-324, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Minkyoung Song et al., “Comparative Analysis of National Cyber Security Strategies Using Topic Modelling,” International Journal of Advanced Computer Science and Applications, vol. 12, no. 12, pp. 62-69, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Yu Meng et al., “Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations,” WWW 2022 - Proceedings of the ACM Web Conference, New York, United States, pp. 3143-3152, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Raquel Silveira et al., “Topic Modelling of Legal Documents via LEGAL-BERT 1,” Proceedings of the First International Workshop RELATED - Relations in the Legal Domain, in Conjunction with ICAIL 22021, pp. 1-9, 2021.
[Google Scholar] [Publisher Link]
[23] Aly Abdelrazek et al., “Topic Modeling Algorithms and Applications: A Survey,” Information Systems, vol. 112, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Fatima Alhaj et al., “Improving Arabic Cognitive Distortion Classification in Twitter using BERTopic,” International Journal of Advanced Computer Science and Applications(IJACSA), vol. 13, no. 1, pp. 854-860, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Bilge Gencoglu et al., “Machine and Expert Judgments of Student Perceptions of Teaching Behavior in Secondary Education: Added Value of Topic Modeling with Big Data,” Computers & Education, vol. 193, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Xieling Chen et al., “Detecting Latent Topics and Trends in Educational Technologies over Four Decades Using Structural Topic Modeling: A Retrospective of all Volumes of Computers & Education,” Computers & Education, vol. 151, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Wenqi Fan et al., “Recommender Systems in the Era of Large Language Models (LLMs),” arXiv, 2023
[CrossRef] [Google Scholar] [Publisher Link]
[28] Sahil Sawant et al., “An Enhanced BERTopic Framework and Algorithm for Improving Topic Coherence and Diversity,” 2022 IEEE 24th Int Conf on High Performance Computing & Communications; 8 th Int Conf on Data Science & Systems; 20th Int Conf on Smart City; 8 th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys), Hainan, China, pp. 2251-2257, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Eunhye (Olivia) Park et al., “The Effects of Green Restaurant Attributes on Customer Satisfaction Using the Structural Topic Model on Online Customer Reviews,” Sustainability, vol. 12, no. 7, pp. 1-20, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[30] Weisi Chen et al., “Leveraging State-of-the-Art Topic Modeling for News Impact Analysis on Financial Markets: A Comparative Study,” Electronics, vol. 12, no. 12, pp. 1-22, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Ibai Guillén-Pacho, Carlos Badenes-Olmedo, and Oscar Corcho, “Dynamic Topic Modelling for Exploring the Scientiic Literature on Coronavirus: An Unsupervised Labelling Technique,” Research Square, 2023,
[CrossRef] [Google Scholar] [Publisher Link]
[32] Pouria Akbarighatar, Ilias Pappas, and Polyxeni Vassilakopoulou, “A Sociotechnical Perspective for Responsible AI Maturity Models: Findings from A Mixed-Method Literature Review,” International Journal of Information Management Data Insights, vol. 3, no. 2, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[33] Andry Alamsyah, and Nadhif Ditertian Girawan, “Improving Clothing Product Quality and Reducing Waste Based on Consumer Review Using RoBERTa and BERTopic Language Model,” Big Data and Cognitive Computing, vol. 7, no. 4, pp. 1-21, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[34] Priyanka Gupta et al., “Generative AI: A Systematic Review Using Topic Modelling Techniques,” Data and Information Management, pp. 1-66, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[35] Zongxia Li et al., “Beyond Automated Evaluation Metrics: Evaluating Topic Models on Practical Social Science Content Analysis Tasks,” arXiv, pp. 1-20, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[36] Chau Minh Pham et al., “TopicGPT: A Prompt-based Topic Modeling Framework,” arXiv, pp. 1-19, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[37] Lijimol George, and P. Sumathy, “An Integrated Clustering and BERT Framework for Improved Topic Modeling,” International Journal of Information Technology, vol. 15, pp. 2187-2195, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[38] Maarten Grootendorst, “BERTopic: Neural Topic Modeling with A Class-Based TF-IDF Procedure,” arXiv, pp. 1-10, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[39] Soya Park et al., “Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models,” 26th International Conference on Intelligent User Interfaces, TX USA, pp. 585-596, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[40] Ryan J. Gallagher et al., “Anchored Correlation Explanation: Topic Modeling with Minimal Domain Knowledge,” Transactions of the Association for Computational Linguistics, vol. 5, pp. 529-542, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[41] Yueshen Xu et al., “Hierarchical Topic Modeling with Automatic Knowledge Mining,” Expert Systems with Applications, vol. 103, pp. 106-117, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[42] Giuseppe Carenini et al., “Tracking COVID-19 Discourse on Twitter in North America: Infodemiology Study Using Topic Modeling and Aspect-Based Sentiment Analysis,” Journal of Medical Internet Research, vol. 23, no. 2, pp. 1-12, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[43] Angela Fan, Finale Doshi-Velez, and Luke Miratrix, “Prior Matters: Simple and General Methods for Evaluating and Improving Topic Quality in Topic Modeling,” arXiv, pp. 1-18, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[44] Alexander Hoyle et al., “Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherence,” 35th Conference on Neural Information Processing Systems (NeurIPS 2021), pp. 1-16, 2021.
[Google Scholar] [Publisher Link]
[45] Eickhoff Matthias, and Wieneke Runhild, “Understanding Topic Models in Context: A Mixed-Methods Approach to the Meaningful Analysis of Large Document Collections,” Proceedings of the 51st Hawaii International Conference on System Sciences, pp. 903-912, 2018.
[Google Scholar] [Publisher Link]
[46] Mekhail Mustak et al., “Artificial Intelligence in Marketing: Topic Modeling, Scientometric Analysis, and Research Agenda,” Journal of Business Research, vol. 124, pp. 389-404, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[47] Bhart Gupta, P. Prakasam, and T. Velmurugan, “Integrated BERT Embeddings, BiLSTM-BiGRU and 1-D CNN Model for Binary Sentiment Classification Analysis of Movie Reviews,” Multimedia Tools and Applications, vol. 81, no. 23, pp. 33067-33086, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[48] Akshay Khatri, P. Pranav, M. Anand Kumar, “Sarcasm Detection in Tweets with BERT and GloVe Embeddings,” arXiv, pp. 1-5, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[49] Eirik Duesund Helland, “Tackling Lower-Resource Language Challenges: A Comparative Study of Norwegian Pre-Trained BERT Models and Traditional Approaches for Football Article Paragraph Classification,” Master Theses, Norwegian University of Life Sciences, pp. 1-97, 2023.
[Google Scholar] [Publisher Link]
[50] Simon Roth, “Biased Machines in the Realm of Politics,” Doctoral Theses, Konstanz University, pp. 1-125, 2022.
[Google Scholar] [Publisher Link]