Evaluating the validity of Saudi English language undergraduate students’ results in light of proposed criteria

Sultan Abdullah Almuhaimeed

Abstract


Education is the process of acquiring knowledge, skills, values, peers, beliefs, practices and personal development. Mentoring methods include teaching, coaching, storytelling, discussion, and guided research. Education is often led by teachers; however, students can also engage in self-education. As education is a continuous process, it requires rectifying from time to time and that is achieved by conducting regular evaluation and assessment. The role of assessment cannot be denied in any educational process because it works as a course-correction tool. It is indeed one of the pillars of formal education. However, validation of learning results is rarely undertaken in institutions because no comprehensive method for this is available. The current study evaluates international and national best result assessment practices to prepare a balanced model for use in English language Departments in ESL/ EFL situations.  The criteria are applied at Mustaqbal University (MU), Saudi Arabia, and results showed that only some of the forty seven criteria are robustly applied, a few partially applied, and some not applied at all. Overall, the study establishes that result assessment needs a careful re-thinking at MU to place it among the most prestigious educational institutions of the world.


Keywords


evaluation; assessment; assessment model; international best practices; language assessment; results assessment

Full Text:

PDF

References


Abdullateef, S. T., & Muhammedzein, F. (2021). Dynamic assessment: A complementary method to promote EFL learning. Arab World English Journal (AWEJ), 12(2), 279-293.

ABET. (2020). ABET: Accreditation Policy and Procedure Manual. https://www.abet.org/wp-content/uploads/2021/01/A001-21-22-Accreditation-Policy-and-Procedure-Manual.pdf

ABET. (2021). Abet self-study questionnaire: Template for a self-study report, 2021-2022 Review Cycle.https://www.abet.org/accreditation/accreditation-criteria/self-study-templates/

Australian Skills Quality Authority. (2015). Conducting validation. https://www.asqa.gov.au/sites/default/files/202001/FACT_SHEET_Conducting_validation.pdf

Banta, T. W., Lund, J. P., Black K. E., & Oblander F. W. (1996). Assessment in practice: Putting principles to work on college campuses. San Francisco: Jossey-Bass.

Bobienko, O. M. (2012). Gauging the materials for the assessment of new educational results. TISBI Bulletin, 2(50), 173-183.

Brown, T. L. (2004). Teachers’ conceptions of assessment: Implications for policy and professional development. Assessment in Education, 11(3), 305-322.

Brožová, H., & Rydval, J. (2014). Analysis of exam results of the subject’ Applied Mathematics for IT’. Journal on Efficiency and Responsibility in Education and Science, 7(3-4), 59-65.

Cooper, E. L. (1994). Using standardized test results to assess student learning. ERIC Number: ED387154. https://eric.ed.gov/?id=ED387154

Council of Chief State School Officers (CCSSO). (2018). Revising the definition of formative assessment. Washington, DC: Author.

Deanship of Quality and Academic Accreditation. (2019). Designing and assuring quality of exams. Al-Baha University. https://bu.edu.sa/documents/636739/0/Ref.+3.1.5.2.pdf/3d3d7e54-5de5-9438-2b41-8515aeb17131?t=1593679855218

El-Khawas, E. (1989). How are assessment results being used? Assessment Update, 1(4), 1-2.

Ellington, H., Percival, F, & Race, P. (1993). Handbook of educational technology. London: Kogan Page.

Ferretti, F., Santi, G. R. P., Del Zozzo, A., Garzetti, M., & Bolondi, G. (2021). Assessment practices and beliefs: Teachers’ perspectives on assessment during long distance learning. Educ. Sci. 11, 264. https://doi.org/10.3390/educsci11060264

Ghaicha, A. (2016). Theoretical framework for educational assessment: A synoptic review. Journal of Education and Practice, 7(24), 212-231.

Glaskin-Clay, B. (2007). Part-time instructors: Closing the quality loop. College Quarterly, 10(3), 1-11.

Grainger, P. (2021). Enhancing assessment literacies through development of quality rubrics using a Triad based peer review process. Journal of University Teaching & Learning Practice, 18(4), 4-14. https://ro.uow.edu.au/jutlp/vol18/iss4/4

Jeltova, I., Birney, D., Fredine, N., Jarvin, L., Sternberg, R., & Grigorenko, E. (2009). Dynamic assessment as a process-oriented assessment in educational settings. Advances in Speech Language Pathology, 9(4). https://doi.org/10.1080/14417040701460390

Kane, M. (1992). An argument-based approach to validity. Psychological Bulletin, 112, 527–535.

Magno, C., & Ouano, J. (2010). Designing written assessment for student learning. Philippines: Phoenix Pub.

Marg, B. S. (2019). Evaluation reforms in higher educational institutions. New Delhi: University Grants Commission.

Markova, S. M., Gladkova, M. N., Yurtaeva, T.S., Bystrova, N.V., Vaganova, O. I., & Tsyplakova, S. A. (2014). Modular content pedagogical preparation of teachers of vocational training. Chronicles of the Combined Fund of Electronic Resources Science and Education, 1(66), 90.

Marshall, N., Shaw, K., Hunter, J., & Jones, I. (2020). Assessment by comparative judgement: An application to secondary statistics and English in New Zealand. New Zealand Journal of Educational Studies, 55, 49–71.

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-104). New York, NY American Council on education and Macmillan.

Miller, I. (2012). Edukometrie. https://www.miller.wz.cz/

Naveed Bin Rais, R., Rashid, M., Zakria, M., Hussain, S., Qadir, J., Imran, M. A. (2021). Employing industrial quality management systems for quality assurance in outcome-based engineering education: A review. Education Sciences, 11(45).

NCAA. (2019). Self-Evaluation scales for higher education programs. https://etec.gov.sa/en/productsandservices/NCAAA/AccreditationProgrammatic/Pages/Forms.aspx

Nitko, A. J. (2001). Conceptual frameworks to accommodate the validation of rapidly changing requirements for assessments, In Scott, D. (Ed.), Curriculum and assessment: International Perspectives on Curriculum Studies, (Vol. 1). London: Ablex Publishing.

Phan, T. C., Ngo, T. T., & Duong, N. T. (2019). A case study in teaching: The factors determining of assessing the competence of technology-based. Review of Information Engineering and Applications, 6(2), 37-45.

Phoenix, AZ: American Council on Education/ The Pryx Press, 13–104.

Plake, B. S., & Wise, L. L. (2014). What is the role and importance of the revised AERA, APA, NCME standards for educational and psychological testing?. Journal of Educational Measurement: Issues and Practice, 33(4), 4-12. https://doi.org/10.1111/emip.12045

Abdul Razak, A., Krishnasamy, H.N., Othman, N. (2021). “No trolls left behind!”: Using films to address communication apprehension in the English language classroom at Universiti Utara Malaysia. Journal of Language and Linguistic Studies, 17(3), 1258-1265. Doi: 10.52462/jlls.89

Robutti, O., Cusi, A., Clark-Wilson, A., Jaworski, B., Chapman, O., Esteley, C., & Joubert, M. (2016). ICME international survey on teachers working and learning through collaboration. ZDM, 48(5), 651-690.

Rudolph, L. B., Poje, D. J., & Van Dyke, J. (1994). Using the results of assessment for improvement. Assessment Update, 6(5), 4-7. https://doi.org/10.1002/au.3650060504

Saka, F. Ö. (2020). Considerations on the new curriculum of English Language Teaching programmes. Journal of Language and Linguistic Studies, 16(3), 1189-1202.

Schoepp, K., & Benson, S. (2016). Meta-Assessment: Assessing the learning outcomes assessment program. Innovative Higher Education, 41(4), 287-301.

United Nations Development Programme (UNDP). (2006). UNDP Annual Report. https://www.undp.org/publications/undp-annual-report-2006

University of Waterloo. (2021). Preparing tests and exams. Centre for Teaching Excellence, University of Waterloo.

Vaganova, O. I., Medvedeva, T. Y., Kirdyanova, E. R., Kazantseva, G. A., & Karpukova, A. A. (2016). Innovative approaches to assessment of results of higher school students training. International Journal of Environmental & Science Education, 11(13), 6246-6254.

Vodák, J., Soviar, J., & Lendel, V. (2013). The evaluation system proposal of the businesses preparedness for cooperative management implementation. Business: theory and practice, 14(4), 315-322.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Journal of Language and Linguistic Studies
ISSN 1305-578X (Online)
Copyright © 2005-2022 by Journal of Language and Linguistic Studies