1、Testing & Assessment in ELT英语教学中的测试与评价方法英语教学中的测试与评价方法Outline1. A sketchy history2. Types of language tests 3. Testing techniques 4. Criteria for good language tests 5. Constructing multiple-choice questions 6. Critical discussion 1. History of Langauge Testing and AssessmentA Sketchy History1.1 Pre-
2、scientific Stage前科学阶段1.2 Psychometric-Structuralist Testing Stage心理测量学-结构主义测试阶段1.3 Integrative-Sociolinguistic Testing Stage 综合-社会语言学测试阶段1.4 Pragmatic and Communicative Testing Stage语用交际测试阶段1.1 Pre-scientific Stage Before the 1940s Grammar-translation method 语法翻译法 Traditional testing approachTraditi
3、onal Testing Approach What: grammatical rules, word formation, word usage How: written test, no oral test Question type: subjective, like translation, composition, written questions1.2 Psychometric-Structuralist Testing心理测量心理测量-结构主义测试结构主义测试 Since the 1950s Theoretical guidance Features Audiolingual
4、method 听说法 Discrete-point testing approach(分项测验分项测验/分立式测分立式测验验) 理论基础： 语言学中的结构主义语言观：语言=语音+词汇+句式+语法，语言能力可以分解为具体的部分来考查。 心理学中的行为主义教育论：刺激反应式学习方式，反复练习。 心理测量学：依据一定的心理学理论，运用一定的操作程序，把人的知识、能力、性格、态度等心理特性和行为进行量化。 Emphasizing reliability （信度）and validity （效度） Emphasizing objective and accurate assessment, Object
5、ive questions dominate, particularly multiple choices. Analyzing testing results statistically Enjoying a high reliability 信度高Discrete-point Testing A question only assesses one language point Testing: conducted at different levels of language structure 语言层面 Language proficiency：being assessed from
6、the aspects of listening, speaking, reading and writing 技能层面1.3 Integrative-Sociolinguistic Testing 综合综合-社会语言学测试社会语言学测试 Since the mid-1970s （动态语言观） Integrative skill tests 综合技能测试 Assess a learners ability to use many bits at the same time. Question types：cloze/composition/oral interview, etc.1.4 Pra
7、gmatic & Communicative Testing Stage语用交际测试阶段语用交际测试阶段 From the 1980s (功能语言观) Communicative approach From language usage to language use Pragmatic approach Integrity of language/whole language Assessing with tasks Accuracy, fluency and appropriateness Communicative competence 2. Types of Language Test
8、sTypes of Language Tests Formative & Summative Tests; 形成性和总结性 Objective & Subjective Tests; 客观性和主观性 Criterion-referenced & Norm-referenced Tests;标准参照性和常模参照性 Tests Classified According to Testing Purposes Discrete-point & Integrative Tests 分立式和综合测试 High stakes & Low-stakes Tests 高风险和低风险2.1 Formative
9、& Summative Formative Assessment: Being carried out throughtout the course; Diagnostic purpose; Assessment for learning; Teacher or learner-initiated Summative Assessment: Being carried out at the end of a course; Grading purpose, assign a course grade; Assessment of learning; Teacher-initiated2.2 C
10、riterion-referenced & Norm-referenced Criterion-referenced Assessment: A way of measuring candidates against defined (and objective) criteria; Relatively consistent Being used to establish a persons competence; Examples: Driving tests, IELTS, TEM, etc.Norm-referenced Assessment: A way of comparing c
11、andidates to identify whether the test taker performed better or worse than other test takers; Varying from year to year; Being used for selection; Examples: CEE (gaokao), TOEFL2.3 Objective & SubjectiveObjective Assessment: A single correct answer; Objective scoring, no judgment on the part of the
12、scorer. Examples: true/false, multiple choice, matching questions. Subjective Assessment: More than one way of expressing the correct answer; Subective scoring, calling for judgment on the part of the scorer. Examples: extended-response questions and essays. 2.4 Tests Classified According to Testing
13、 Purposesl Proficiency Test 水平测试、能力测试l Achievement Test 成绩测试、学业测试l Placement Test 分级测试、分班测试l Aptitude Test 能力倾向测试、学能测试l Diagnostic Test 诊断测试Proficiency Testl Measuring language proficiencyl The content 考试内容: Not based on the content of a language course which people taking the test may have followed
14、. It is based on a specification of what candidates have to be able to do in the language in order to be considered proficient. Examples: SAT, ACT, CEE, IELTS, PSC, PETS, BECAchievement Test Examining how successful a student, a teacher, or a syllabus, or a method is. Being closely linked to the cou
15、rse material used in class. Final achievement tests are those administered at the end of a course of study. Progress achievement tests are intended to measure the progress that students are making. Placement Testl To identify the appropriate stage of language course according to students ability.l T
16、o assign students to the appropriate level of classes they should take. Aptitude Test Measuring the extent to which an individual possesses specific language learning ability Being usually used for selection and diagnosis and for prediction of language learning success. Components of language aptitu
17、de: phonetic coding ability (sound discrimination and memory), grammatical sensitivity (recognizing the grammatical function of words), rote learning ability for new sound and meaning inductive learning ability for language patternsDiagnostic Testl To show students strengths and weaknesses. 2.5 Disc
18、rete-point & Integrative Discrete-point Test: multiple-choice questions Integrative Test: Dictation, translation, composition, etc.When he saw his mother, the little boy stopped _. A. crying B. cry C. to cry D. cried One day, the wife of a Chinese king sat watching a worm as it ate some mulberry lea
19、ves. Soon it stopped _. Then, as it slowly turned its head from side _ side, a very fine thread came out of its _. It wrapped the thread around and around itself until it was shut _ a little cocoon.2.6 High- & Low-stakes Tests A relative concept High-stakes: a test with important consequences for th
20、e test taker. Examples:CEE, TEM Low-stakes: End-term Exam测试种类总结测试种类总结分类标准分类标准 测试类别测试类别学习阶段不同学习阶段不同 形成性测试，终结性测试形成性测试，终结性测试评分方式评分方式 客观性测试，主观性测试客观性测试，主观性测试分数解释参照标准不同分数解释参照标准不同 标准参照测试，常模参照测试标准参照测试，常模参照测试测试目的测试目的 水平测试水平测试/成绩测试成绩测试/学能测试学能测试/分班测试分班测试/诊断测试诊断测试测试语言技能的分合测试语言技能的分合 分立式测试，综合式测试分立式测试，综合式测试测试对用户影响
21、的大小测试对用户影响的大小 低风险测试，高风险测试低风险测试，高风险测试3. Testing TechniquesTesting TechniquesMultiple-choice 多项选择题（单选或复选）多项选择题（单选或复选）Gap-filling 填充题填充题 Matching 配对题配对题Transformation 句型转换题句型转换题Cloze 完形填空题（填充或选择题）完形填空题（填充或选择题）True/False 是非题，判断正误题是非题，判断正误题 Error Correction 改错题改错题Dictation 听写听写Open Questions 开放式问题开放式问题Sh
22、ort Answer Qs简答题简答题Essay Writing写作写作Translation翻译翻译3.1 Multiple-choice QuestionsAn example: Noise made by a snake is called _. A mew B bark C hiss D quack Stem + Choices/Alternatives (the correct choice and distractors)Advantages: Efficiency Neutrality Universality Response clarityDisadvantages: Amb
23、iguity No partial credit guessing Time-consuming for item consrtuction3.2 Gap-fillingAn example:Eating too much fast food is not _. A hint：a root word (health), the first letter of the word (h_).Advantages: Testing grammar or vocabulary Essy to grade Relatively easy to construct. Disadvantages: Ambi
24、guity: more than one possible correct answers. Parents owe their children a set of solid values _ which to build their lives. (around/on)3.3 MatchingMatch the word on the left to the word with the opposite meaning.fat old young tallactive thinshort quiet This could be individual words, words and def
25、initions, pictures to words etc.Advantages: Testing vocabulary Easy to construct and gradeDisadvantages: Students may get the right answers without knowing all the words. 3.4 Transformationl This is an interesting book. (转为感叹句) What an interesting book this is!l I went to bed after I finished my hom
26、ework. I didnt go to bed until I finished my homework. It was not until I finished my homework that I went to bed. Not until I finished my homework did I go to bed. A student has to rewrite a sentence based on an instruction or a key word given. Advantages: Testing grammar and understanding of form
27、Fairly easy to gradeDisadvantages: A student may rewrite sentences to a formula. 3.5 Cloze 完形填空完形填空Complete the text by adding a word to each gap. One day, the wife of a Chinese king sat watching a worm as it ate some mulberry leaves. Soon it stopped _. Then, as it slowly turned its head from side _
28、 side, a very fine thread came out of its _. It wrapped the thread around and around itself until it was shut _ a little cocoon.Advantages: Much more integrative; Effective for testing grammar, vocabulary and intensive reading; A good indicator of overall language proficiency.Disadvantages: There ma
29、y have multiple correct answers.3.6 True/FalseDecide if the statement is true or false. England won the world cup in 1966. T/F The candidate must decide if a statement is true or false.Advantages: Test listening & reading comprehension Easy to grade Disadvantages: Guessing can result in many correct
30、 answers. 3.7 Error CorrectionFind the mistake in the sentence and correct them. He dont know why Tom refused to speak to him. Errors must be found and corrected in a sentence or passage. It could be an extra word, words missed, mistakes with verb forms, etc. Advantages: Useful for testing grammar a
31、nd vocabulary as well as reading and listening comprehension.Disadvantages: Some errors can be corrected in more than one way.The Internet is playing a important part in 56 our daily life. On the net, we can learn about 57 news both home and abroad and some other 58 informations as well. We can also
32、 make phone calls, 59 send messages by e-mails, go to net schools, and 60 learn foreign languages by ourselves. Beside, we 61 can enjoy music, watch sports matches, and play the 62 chess or cards. The net even help us do shopping, 63 make a chat with others and make friends with them. 64 In a word,
33、the Internet has made our life more easier. 65 3.8 Dictation One of the oldest techniques known for the teaching and testing of foreign languages; Being closely related to grammar translation method; Testing spelling, listening and recognition.Standard dictation 标准听写Partial dictation 部分听写Dictation w
34、ith competing noise 干扰听写 Dictation-composition 听写作文Elicited imitation 复述听写 3.9 Open QuestionsAnswer the questions. Why did John steal the money?Here the candidate must answer simple questions after reading or listening or as part of an oral interview. Advantages: Useful for testing any of the four s
35、kills, but less useful for testing grammar or vocabulary.Disadvantages: More difficult and time consuming to grade An element of subjectivity involved in judging how complete the answer is.3.10 Short Answer Questions Requiring the learner to write a word, phrase, number or symbol; often based on a p
36、assage; Sometines with a limit of words in one answer (3-5 words)3.11 Essay Writing Being widely used Often being criticized for their lack of objectivity. Requirements for writing:用词正确语句通顺结构合理内容符合要求文体得当 (措辞和行文 正式-非正式)The two new senators have proved themselves exceptionally able (guys/men).Writing
37、a letter to a close friend or writing a job application letterTypes of Essay Writing单句写作He doesnt like dogs as much as his wife does.His wife likes dogs better than him.组句成章（）They are students. （）Mr and Mrs White have two sons. （）Now Ben and Jerry are playing football with their father. （）Alice is o
38、nly three. （）The boys have a sister, Alice. （）Their names are Ben And Jerry. （）Alice is sitting on the grass with her mother. Advantages:InegrativeDisadvantages:Difficult to score reliably and time-consuming to grade Often affected by handwriting, presence or spelling errors, grammar used the subjec
39、tive judgments of the grader. Training of graders: time-consuming and needs to be repeated at frequent intervals throughout the grading.3.12 Translation Used method of testing in both classroom assessment and formal test. Criteria of good translation vary4. General Criteria of Language Testing 4.1 P
40、racticality Factors to consider: Financial limitations; Time constraints; Ease of administration; Scoring. A test that is prohibitively expensive is impractical. A test that takes a students ten hours to complete is impractical. A test that requires individual one-to-one proctoring is impractical. A
41、 test that takes a few minutes for a student to take and several hours for an examiner to evaluate is impractical. A test that can be scored only by computer is impractical if the test takes place a thousand miles away from the nearest computer. 3.2 Reliability 信度信度 A consistent measure of performan
42、ce. 可靠性/稳定性 Sources of unreliability: the test itself or the scoring of the test, that is, test reliability and rater reliability. Test reliability: the consistency of results if giving the same test to the same subject on two different occasions. Scoring or rater reliability: the consistency of sco
43、ring by two or more scorers or by the same scorer on different occasions. 3.3 Validity 效度效度 The degree to which the test actually measures what is intended to measure; Test what is important to test, not what is easy to test; The most complex and important criterion of a good test.Types of Validity
44、Content validity 内容效度 Construct validity 构念效度Face validity 表面效度Not what a test actually measures, but what it superficially appears to measure Criterion validity 标准效度The extent to which the tests are related to concrete criteria in the real world The extent to which a test is relevant and representa
45、tive of what it is used to measure. 内容与测试目标是否有关 测试内容是否具有代表性 测试内容是否适合测试对象The degree to which a test measures what it claims to be measuring based on a theoretical guidance试题是否以有效的语言观为依据；“结构或构念”指整个考试的理论基础。How to improve validity of a test: Specification of what is to be measured based on course syllub
46、us; Construction of the test items; Review by experienced teachers and experts4.4 Backwash 反拨作用反拨作用 Backwash: the effect of testing on teaching and learning. Backwash can be harmful (teaching to the test）or beneficial (diagnostic and promoting improvement).4.5 Difficulty and Discrimination Index of
47、difficulty 难度系数 Discrimination 区分度 (区分考生能力的程度)5. Developing Multiple-Choice QuestionsWhat to measure To measure knowledge recall as well as higher order thinking. Four types of content (facts, concepts, principles, and procedures) and five types of cognitive behaviors (recalling, understanding, pred
48、icting, evaluating, and problem solving). Factual informationl True FalseThe capital of Kentucky is Louisville. l Multiple Choice Which city is the capital of Kentucky? A. Frankfort B. Lexington C. Louisville D. Paducah Higher order thinkingWhat is likely to happen to mortgage interest rates when in
49、terest rates on savings go up? A. Increase B. Decrease C. No change D. UnpredictableTrue/False & Multiple Choice Questions More time-consuming for the teacher to construct good multiple-choice items than true/ false or completion items. The difficulty of finding suitable distractors, which are plaus
50、ible. Plausible: the distractor must have the potential for being selected as the correct answer. Two distractors are as effective as three if one of the three is not plausible. Reading level and reading speed of the students must be considered when constructing the items. To insure that one questio
