Cognitive Level Distribution in Bupena English Textbook: A SOLO Taxonomy Analysis

Tri Aliyah; Nursalim Nursalim; Fitri Arniati; Jusrianto AS

doi:10.51276/edu.v7i2.1707

Authors

Tri Aliyah Universitas Pendidikan Muhammadiyah Sorong
Nursalim Nursalim Universitas Pendidikan Muhammadiyah Sorong
Fitri Arniati Universitas Pendidikan Muhammadiyah Sorong
Jusrianto AS Universitas Pendidikan Muhammadiyah Sorong

DOI:

https://doi.org/10.51276/edu.v7i2.1707

Keywords:

Cognitive Level , EFL Textbook , HOTS–LOTS , SOLO Taxonomy , Thinking Skills

Abstract

This study investigates the distribution of lower-order and higher-order thinking skills (LOTS–HOTS) in the evaluation questions of the English Bupena textbook by integrating Bloom's Revised Taxonomy and the SOLO Taxonomy as a dual analytical framework. It aims to examine the extent to which textbook evaluation tasks support students' critical and higher-order thinking skills in line with curriculum demands. A total of 81 evaluation items were analyzed using qualitative descriptive content analysis supported by quantitative frequency calculations. Each item was systematically coded according to Bloom's cognitive dimensions and SOLO structural complexity, with reliability ensured through inter-coder agreement. The results show that 80.25% of the questions are LOTS, while only 19.75% are HOTS. Most items fall at the unistructural and multistructural levels, indicating limited opportunities for relational and extended abstract reasoning. These findings suggest that the textbook predominantly promotes surface-level learning rather than deep cognitive Engagement. The study highlights the value of multidimensional cognitive frameworks for evaluating the quality of EFL textbook assessment.

Downloads

Download data is not yet available.

Author Biographies

Tri Aliyah, Universitas Pendidikan Muhammadiyah Sorong

She was born in Sorong City on March 11, 1989. Currently a student at Universitas Pendidikan Muhammadiyah Sorong (UNIMUDA). Completed a Bachelor’s degree in English Education at STKIP Muhammadiyah Sorong in 2010.

Nursalim Nursalim, Universitas Pendidikan Muhammadiyah Sorong

He was born in Kebumen City on August 6, 1988. Currently a lecturer at Universitas Pendidikan Muhammadiyah Sorong (UNIMUDA). Completed a Bachelor’s degree in English Education at STKIP Muhammadiyah Sorong in 2010, a Master’s degree in English Education at Universitas Cenderawasih in 2016, and a Doctoral degree in English Education at Universitas Negeri Makassar in 2024.

Fitri Arniati, Universitas Pendidikan Muhammadiyah Sorong

She was born in Makassar City on August 16, 1976. Currently a lecturer at Universitas Pendidikan Muhammadiyah Sorong (UNIMUDA). Completed a Bachelor’s degree in English Literature at Universitas Hasanuddin in 2002, a Master’s degree in English at Universitas Hasanuddin in 2013, and a Doctoral degree in Linguistics at Universitas Hasanuddin in 2019.

Jusrianto AS, Universitas Pendidikan Muhammadiyah Sorong

He was born in Medan City on February 3, 2002. Currently a lecturer at Universitas Pendidikan Muhammadiyah Sorong (UNIMUDA). Completed a Bachelor’s degree in Sports Coaching Education at Universitas Negeri Makassar in 2014, a Master’s degree in Physical Education at Universitas Negeri Makassar in 2016, and is currently pursuing a Doctoral degree in Physical Education at Universitas Negeri Jakarta.

References

Abkary, N. S., & Purnawarman, P. (2020). Indonesian EFL Teachers' Challenges in Assessing Students' Higher-Order Thinking Skills (HOTS). Advances in Social Science, Education and Humanities Research, 503. https://doi.org/10.2991/assehr.k.201215.076

Alsuwat, S. E. (2025). Promoting Higher-Order Thinking in Saudi EFL Textbooks: A Comparative Study. English Language Teaching, 18(10), 75. https://doi.org/10.5539/elt.v18n10p75

Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives. Longman.

Balatska, O., & Vyslobodska, I. (2025). Bloom's Taxonomy: Advantages and Limitations. Grail of Science, 81(1), 39–43. https://doi.org/10.32782/2663-6085/2025/81.1.7

Belarbi, F. M., & Bensafa, A. (2020). An Evaluation of the Algerian EFL Baccalaureate Exam Under the Cognitive Domains of Bloom's Taxonomy. Arab World English Journal, 11(4), 534–546. https://doi.org/10.24093/awej/vol11no4.34

Boral, K., Mandal, S. K., Kumbhakar, M., & Dutta, S. K. (2025). Analysis of Higher Order Thinking Skills of Intended Mathematics Learning Outcomes in India. MIER Journal of Educational Studies, Trends and Practices, 15(1), 146–176. https://doi.org/10.52634/mier/2025/v15/i1/2856

Chanaa, A., & Faddouli, N. (2024). A Cognitive Level Evaluation Method Based on Machine Learning Approach and Bloom's Taxonomy for Online Assessments. Journal of Education and Learning (EduLearn), 18(2), 614–623. https://doi.org/10.11591/edulearn.v18i2.20948

Dakoranis, F. A., & Wahyuni, S. (2025). An Instructional Analysis of the 10th Grade Textbook Entitled "English for Critical Thinking" Using Bloom's Taxonomy. Language Circle: Journal of Language and Literature, 19(2s).

Dallasheh, W. (2024). Content Analysis of the EFL Textbook Units According to Bloom's Taxonomy: Between Theory and Practice. Journal of Higher Education Theory and Practice, 24(4), 208–230. https://doi.org/10.33423/jhetp.v24i4.6960

Decker, A., Margulieux, L. E., & Morrison, B. B. (2019). Using the SOLO Taxonomy to Understand Subgoal Labels Effect in CS1. In Proceedings of the 2019 ACM Conference on International Computing Education Research (ICER 2019) (pp. 209–217). ACM. https://doi.org/10.1145/3291279.3339405

Dewi, A. K., Cahyono, B. Y., & Zubaidi, N. (2024). The Effectiveness of Summary Writing Strategy with Bloom Taxonomy Questions. Lectura: Jurnal Pendidikan, 15(2), 405–419. https://doi.org/10.31849/lectura.v15i2.20257

Elmas, R., Rusek, M., Lindell, A., Nieminen, P., Kasapoğlu, K., & Bílek, M. (2020). The Intellectual Demands of the Intended Chemistry Curriculum in Czechia, Finland, and Turkey: A Comparative Analysis Based on the Revised Bloom's Taxonomy. Chemistry Education Research and Practice, 21, 839–851. https://doi.org/10.1039/d0rp00058b

Fernandez, P., & Guzon, A. (2025). A SOLO Taxonomy-Based Rubric for Assessing Conceptual Understanding in Applied Calculus. Journal on Mathematics Education, 16(2), 559–580. https://doi.org/10.22342/jme.v16i2.pp559-580

Hong, Y. (2024). Using Bloom's Taxonomy to Evaluate HOTS in the Tasks of the Chinese Grade 7 English Textbook. Journal of Education, Humanities and Social Sciences, 42, 182–189. https://doi.org/10.54097/vxdb4505

Husni, S. S., & Ginting, S. A. (2023). Higher Order Thinking Skills of Reading Exercises in English Textbook "Bahasa Inggris: Work in Progress" Based on Revised Bloom's Taxonomy. Genre: Journal of Language, Literature, and Language Teaching, 12(3), 243–256. https://doi.org/10.24114/gj.v12i3.53918

Islam, S., Stapa, M. B., & Rahman, M. M. (2021). Promises and Pitfalls of the Higher Secondary English Textbook of Bangladesh: A Critical Evaluation. Mextesol Journal, 45(3), 1–14. https://doi.org/10.61871/mj.v45n3-11

Jamaly, A., & AlJubouri, C. (2024). Questions Analysis of the General English Language Exam for the Sixth Vocational Grade in Light of Bloom's Taxonomy. International Journal of Religion, 5(11), 441–450. https://doi.org/10.61707/08fcd191

Karakousoglou, M., Jayaraman, J., Chrepa, V., & Anthony, R. (2022). E-Learning in Orthodontic Education: Assessment of a Virtual Case-Based (eCBL) Treatment Planning Course Using SOLO and Bloom's Taxonomy. Acta Scientific Dental Sciences, 6(6), 113–121. https://doi.org/10.31080/asds.2022.06.1521

Köksal, D., Ulum, Ö. G., & Yürük, N. (2023). Revised Bloom's Taxonomy in Reading Texts in EFL/ESL Settings. Acta Educationis Generalis, 13(1), 133–146. https://doi.org/10.2478/atd-2023-0007

Larsen, T. M., Endo, B. H., Yee, A. T., Do, T., & Lo, S. M. (2022). Probing Internal Assumptions of the Revised Bloom's Taxonomy. CBE Life Sciences Education, 21(4), ar50. https://doi.org/10.1187/cbe.20-08-0170

Marlino, A. (2025). Evaluating Cognitive Levels of Reading Comprehension Questions in Ninth Grade English Textbooks Using Revised Bloom's Taxonomy. Cerdika: Jurnal Ilmiah Indonesia, 5(8), 760–769. https://doi.org/10.59141/cerdika.v5i8.2795

Maryamah, S. E., Wati, S., & Suharto, P. P. (2024). Analyzing Higher Order Thinking Skills in Reading Exercises of Indonesian EFL Textbook. Salee: Study of Applied Linguistics and English Education, 5(2), 560–570. https://doi.org/10.35961/salee.v5i2.927

Netere, A. K., Hughes, T., Babey, A. M., Hawes, M., Mifsud, J., Kelly, J. P., & White, P. J. (2024). Evaluating the Quality of Multiple-Choice Question Pilot Database: A Global Educator-Created Tool for Concept-Based Pharmacology Learning. Pharmacology Research and Perspectives, 12(5), e70004. https://doi.org/10.1002/prp2.70004

Paralikar, S., Shah, C. J., Joshi, A., & Kathrotia, R. (2022). Acquisition of Higher-Order Cognitive Skills (HOCS) Using the Flipped Classroom Model: A Quasi-Experimental Study. Cureus, 14(4), e24249. https://doi.org/10.7759/cureus.24249

Purba, A. K. R., Perdanakusuma, D. S., Mustika, A., Fens, T., & Postma, M. J. (2025). Structured Oral Clinical Assessment for Pharmacotherapy Competencies in Medical Education: A Study of Validity and Reliability Analyses of Seven Domains. Korean Journal of Medical Education, 37(3), 331–343. https://doi.org/10.3946/kjme.2025.345

Ravand, H., Shahi, R., Effatpanah, F., & Moghadamzadeh, A. (2025). Measuring Cognitive Levels in High-Stakes Testing: A CDM Analysis of a University Entrance Examination Using Bloom's Taxonomy. Frontiers in Education, 10, 1644811. https://doi.org/10.3389/feduc.2025.1644811

Rinjaya, D., & Halimi, S. S. (2022). An Evaluation of Indonesian Textbooks Using Revised Bloom's Taxonomy. OKARA: Jurnal Bahasa dan Sastra, 16(1), 1–18. https://doi.org/10.19105/ojbs.v16i1.5813

Rustiyani, R., Sofyan, D., & Syafryadin, S. (2021). Levels of Cognitive Domain of Tasks in English Textbooks for Senior High School: A Revised Bloom's Taxonomy Analyses. English Education: Jurnal Tadris Bahasa Inggris, 14(2), 280–293. https://doi.org/10.24042/ee-jtbi.v14i2.9960

Süzük, E. (2023). Analyzing University Entrance Exam Physics Questions Using Physics Problems Taxonomy for Cognitive Processes. Journal of Human and Social Sciences (JOHASS), 2023(6). https://doi.org/10.53048/johass.1358206

Toosi, M. N., Alizadeh, M., Khodadadegi, M., Armandei, M., Ajalooian, Z., & Alikhani, R. (2021). Looking at the Levels of Bloom's Taxonomy in a Flipped Classroom Utilizing Study Guide and Interactive Assignment for Undergraduate Medical Students. Acta Medica Iranica, 58(12), 726–733. https://doi.org/10.18502/acta.v58i12.5157

Valcke, M., De Wever, B., Zhu, C., & Deed, C. (2009). Supporting Active Cognitive Processing in Collaborative Groups: The Potential of Bloom's Taxonomy as a Labeling Tool. The Internet and Higher Education, 12(3–4), 165–172. https://doi.org/10.1016/j.iheduc.2009.08.003

Widiastuti, M. K., & Mbato, C. L. (2025). LOTS and HOTS Reading Questions in EFL Textbooks (Kurikulum Merdeka): Unveiling Every Learning Process Purposes. JOALL (Journal of Applied Linguistics and Literature), 10(1), 48–70. https://doi.org/10.33369/joall.v10i1.37765