Does indirect writing assessment have any relevance to direct writing assessment? Focus on validity and reliability

Faruk Kural

Abstract


The present paper, which is a study based on midterm exam results of 53 University English prep-school students, examines correlation between a direct writing test, measured holistically by multiple-trait scoring, and two indirect writing tests used in a competence exam, one of which is a multiple-choice cloze test and the other a rewrite test measured on the sentence grammar scale.  The purpose of the study is to compare and analyse the results obtained from the use of these distinct strategies in writing assessment and to see to what extent they are of value to account for the students’ writing skills and in what areas they can offer validity and reliability in diagnostic terms as well as investigating whether any quantitative correlations exist between the choice of topics and the level of achievement in essay-writing, in which the choice of topic also implied the choice of a particular rhetoric to be used as part of the essay writing task.


Keywords


Indirect writing assessment; direct writing assessment; validity; reliability

Full Text:

PDF

References


Alderson, J. C., C. M. Clapham & D. Wall (1995). Language Test Construction and Evaluation. Cambridge: Cambridge University Press.

Breland, H.M., Conlon, G.C., and Rogosa, D. (1976). A preliminary study of the test of standard written English. Princeton, NJ: Educational Testing Service, 1976.

Breland, H.M. and Gaynor, J.L. (1979) A comparison of direct and indirect assessments of writing skill. Journal of Educational Measurement, 1979, 16, 119-128.

Davidson, F. & B. K. Lynch (2002). Testcraft: A Teacher's Guide to Writing and Using Language Test Specifications. London: Yale University Press.

Godshalk, F.I., Swineford, F., and Coffman, W.E. (1966). The measurement of writing ability. New York, NY: College Entrance Examination Board, 1966.

Grabe, W. and Kaplan, R.B. (1988). Theory and Practice of Writing. New York: Addison Wesley Longman.

Hogan, T.P. and Mishler, C. (1980). Relationships between essay tests and objective tests of language skills for elementary school students. Journal of Educational Measurement, 1980, 17, 219-227.

Huntley, R.M., Schmeiser, C.B., and Stiggins, R.J. (1979). The assessment of rhetorical proficiency: The role of objective tests and writing samples. Paper presented at the annual meeting of the National Council of Measurement in Education, San Francisco, CA, 1979.

Huot, Brian. (1990) Reliability, Validity, and Holistic Scoring: What We Know and What We Need to Know. College Composition and Communication, 1990, 41.2: 201-213.

Moss, Pamela A., Cole, Nancy S., and Khampalikit, Choosak. (1981). A comparison of procedures to assess written language skills in grades 10, 7, and 4: Paper presented at the Annual Meeting of the American Educational Research Association, Los Angeles, CA, 1981.

Ruth, Leo and Sandra Murphy. (1988). Designing Writing Tasks for the Assessment of Writing. Norwood, New Jersey: Ablex Publishing Corp.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Journal of Language and Linguistic Studies
ISSN 1305-578X (Online)
Copyright © 2005-2022 by Journal of Language and Linguistic Studies