1、12/13/20221兰 春 寿12/13/20222一、英语测试的质量评估n评估英语测试的质量,首先要研究测试的有效性问题,即效度(validity);n质量评估要考虑的第二个问题,是测试结果的可信(可靠)程度,即信度(reliability);n还要考虑施测的可行性问题(practicality);n以及区分力(discriminating power)。12/13/20223试卷结构试卷结构是否考了所要考的?是否保证考试分数的公平性?准确性准确性一致性一致性12/13/20224考试内容考试内容考试内容是否是大纲的重点?考试内容是否涵盖大纲的主要内容?数量数量质量质量12/13/2022
2、51.效度n简单地说,是指某一种/某一次测试能在多大的程度测出预定要测量的东西,或者能在多大的程度完成预期的测量任务。n我们希望通过测试所测量的是我们想要测量的东西,而且仅仅是想要测量的东西,绝对不是不想测量的东西。n例如测“写作能力”,不要牵扯进“阅读能力”的测试或其他能力的测试。n实际上,由于种种原因,常常不能完全如愿。12/13/20226n因此,效度是程度的问题,可以分成若干等级,如高、较高、中等、较低和低。n效度只有高低之分,没有有无之别。n谈效度,不能离开具体的测试以及具体的目标。12/13/20227影响效度的因素n1)测试的目标不当。测试目标的确定要在测试能够到达的范围之内。英
3、语测试能揭示的,不是受测者在英语学习中的全部情况,而只是那些可测的,可计数的现象。n2)测试的内容不妥。必须使测试的内容尽可能准确地反映测试的目标。命题实际上是一个抽样的过程,要使抽样合理,每一次测试的题项必须有代表性,侧重点要明确 例如:某一大题以考语法为测试目标,如何合理抽样?12/13/20228n以考语法为测试目标的大题,每小题就要尽可能合理地覆盖想测的那些语法点,每小题应该有特定任务,重点考某个语法点。n命题时要尽量避免别的内容来干扰主要内容。由于重点考语法,不是考词汇,不是考文化背景知识,涉及的词语就不宜太难,太偏,而且要用所谓的culture-free items,以避免考生仅因
4、为不认识某些词语或不了解某种文化而做不好题。n又如,考词汇的试题,如何回避无关内容?12/13/20229n同样,测试的内容 太少、太多、太易、太难 样本太少样本太少 不足反映整体不足反映整体题量太大题量太大 变成速度测试变成速度测试测不出考生测不出考生的实际水平的实际水平测不出考生测不出考生的实际水平的实际水平12/13/202210n3)测试方法不对。测试的方法要与测试的内容相适宜。如:考口试要用口试法。n4)测试组织不好。测试需要严密、科学的组织工作,组织得好将有利于提高测试的效度和信度。n5)没有合理使用分数。要正确有效地使用通过测试获得的包括分数在内的各种数据。n6)考生方面的一些主
5、观因素。如:考生的积极性,情绪等等。12/13/2022112.信度n信度是指考试结果的可信程度,实际上是指考试的一致性,所要了解的是考试在多大程度上具有一致性。n信度的研究必须有比较,通常从三个方面来研究:12/13/202212n1)测试的稳定性()测试的稳定性(stability)。)。常用的方法是测试常用的方法是测试-再测再测试法(试法(the test-retest method),就是用同一套试卷在,就是用同一套试卷在尽可能相似的环境中对同一批考生测试两次。即第一次测尽可能相似的环境中对同一批考生测试两次。即第一次测后隔一段时间再测,间隔的长短按需要而定。比较两次测后隔一段时间再测
6、,间隔的长短按需要而定。比较两次测试的成绩,求出相关系数,判定测试的稳定程度。试的成绩,求出相关系数,判定测试的稳定程度。n求相关系数,有求相关系数,有pearson的积矩相关系数和的积矩相关系数和spearman排排列次序相关系数。列次序相关系数。n用前一种方法只要知道总人数,两次的分数就可以算出来。用前一种方法只要知道总人数,两次的分数就可以算出来。n用后一种方法,是研究两次测试的次序相关(用后一种方法,是研究两次测试的次序相关(rank correlation),根据成绩把考生两次测试的名次排出来,根据成绩把考生两次测试的名次排出来,比较两次名次上的差异。比较两次名次上的差异。n相关系数
7、最好高于相关系数最好高于0.9,至少不低于,至少不低于0.8。系数高,测试稳。系数高,测试稳定性就高。定性就高。12/13/202213n2)测试的等值性(equivalence)。常用等值(卷)法(the equivalent-forms method)。用同一测试的两份等值试卷对同一批人进行测试,比较两次的成绩,算出相关系数,判断两次测试的等值性。12/13/202214n3)测试的内部一致性(internal consistency)。测内部一致性用得比较多的方法是分半法(split-half method)。用一份试卷施测,然后把试卷分成题数相等的两个部分,求这两部分分数的相关系数。(
8、奇数题与偶数题、前一半题与后一半题)n只计算客观题,用Kuder Richardson的 KR21公式,如果是主观题,则用Cronbach的公式。12/13/20221512/13/20221612/13/202217提高信度的主要方法提高信度的主要方法n1)适当增加题量。)适当增加题量。题量增加,试题的覆盖面大,题目的代表性题量增加,试题的覆盖面大,题目的代表性好,测量误差就在一定程度上减少。好,测量误差就在一定程度上减少。n2)注意各题的同质性。)注意各题的同质性。即题目的一致程度,如:题型一样、题即题目的一致程度,如:题型一样、题量一样、覆盖面一样、指导语一样,编排一样。量一样、覆盖面一
9、样、指导语一样,编排一样。n3)控制好题目的难易程度,提高区分度。)控制好题目的难易程度,提高区分度。题目难易程度适当,题目难易程度适当,区分度高,对两次或多次测试考生按照成绩高低排列次序就比较区分度高,对两次或多次测试考生按照成绩高低排列次序就比较任意一致,测试的相关性就可能提高,信度也就提高了。任意一致,测试的相关性就可能提高,信度也就提高了。n4)尽可能消除各种干扰因素。)尽可能消除各种干扰因素。使全体考生在十分相似的考试环使全体考生在十分相似的考试环境中考试。境中考试。n5)改进评分方法,提高评分的客观性和准确性。)改进评分方法,提高评分的客观性和准确性。标准化测试在以上标准化测试在以
10、上5个方面都有切实可行的办法,因此信度高。个方面都有切实可行的办法,因此信度高。12/13/2022183.可行性n测试无论规模大小,其过程分为三个阶段:准备阶段、施测阶段和评分阶段,每个阶段都有可行性问题。n对于大规模的考试,命题人员尽可能考虑周到,为后续工作提供方便。n例如:试卷的版面设计要规范、方便考生、阅卷教师和工作人员;为阅卷教师提供的答案要明确、全面,评分标准要详尽,答题卡的设计要方便计算机阅卷。编排12/13/2022194.区分性n测试应该要起到能够区分考生能力高低的作用。n测试要具有多大的区分度,视具体情况具体分析。n一般的“过关”考试,希望大部分甚至全部的人都通过考试,这时
11、区分度就不宜太高。n高考是选拔类的考试,区分度应该怎样?对于具有选拔性功能的高考对于具有选拔性功能的高考来说,考试目的是为了择优,这就需来说,考试目的是为了择优,这就需要有很强的区分力。要有很强的区分力。12/13/202220难易度与区分度n测试评分结束后,应依据测试的结果进行题项分析(item analysis),计算每小题的难易度(facility value)和区分度(discrimination index)n难度值:该数值与难度呈反比,范围在01,数值越高,越容易。n把试卷中每道题的难度值加起来除以题数,所得的值为整卷的难度值。12/13/20222112/13/202222n区分
12、度:反映的是试题区分力的强弱程度。区分指数为-1-+1.n在计算区分指数时,把考生按照所得的总分的高低分成人数相等的高低两个组。当高分组答对某题的人数比低分组答对此题当高分组答对某题的人数比低分组答对此题的人多时,区分指数为正数;的人多时,区分指数为正数;当两组人数一样时,区分指数为当两组人数一样时,区分指数为0;当前者人数反比后者少时,区分指数为负数。当前者人数反比后者少时,区分指数为负数。12/13/202223高分组答对该题的人数区分指数区分指数低高分组答对该题的人数每组人数(高分组和低分组人数应一样)区分度区分度12/13/202224n为了提高试题的区分度,通常在试测之后要修改或删除
13、区分度低的题目,特别是区分度0的。n把所有题目的区分度加起来除以题数就获得整份试卷的区分指数。12/13/20222512/13/202226n67.The purpose of the passage is to show you how to _.nA.play your cards right nB.use your cards abroad nC.draw cash with your cards nD.pay for goods with your cards12/13/202227n一道试题至少由以下三个部分组成:题干(文本、图片、音频、视频等)(辨析、理解、分析、推理、概括、产出
14、)答案(选择式和构建式)12/13/20222821.Tom:Mike,our team will play against the Rockets this weekend.Im sure we will win.Mike:_!A.Congratulations B.Cheers C.Best wishes D.Good luckn选材n设置考点n设置干扰项12/13/2022291.单项填空n本大题的命制要着重考查语法和词汇知识在特定语境中的应用,要特别注意语境的设置,并保证主干知识的覆盖面。12/13/2022301.单项填空n题干题干n由一个句子或一组短对话构成。题干至少包含一个可作为
15、考点的语法结构或意义关系。n答案答案n答案选项通常是一个词、短语、结构或交际用语。它是正确理解题干中的语法结构或意义关系的必然结果,也就是,正确答案的选择必须基于对题干结构或意义的正确理解。n干扰项干扰项n单项填空中的干扰方式主要包括(1)词形干扰、(2)词义干扰、(3)用法干扰以及(4)结构干扰。12/13/202231单项填空单项填空:考点分类题干结构语法属性结构分析固定结构意义意义理解逻辑关系选择项动词变化语法辨析意义辨析语用辨析二维分类I could have been on time for the meeting,but I _ in a traffic jam for over
16、half an hour.have caughthave been caughtwas caughtcaught12/13/202232Faced with Challenges,you should believe your courage is _ makes a difference.whatthatwhichwhether12/13/202233考点设置突出考点设置突出 知识链知识链干扰项设置突出干扰项设置突出 相同语法范畴相同语法范畴 或或 具有某一区别特征具有某一区别特征考点明确考点明确分布合理分布合理12/13/202234单项填空考点分析单项填空考点分析(福建(福建2009高考
17、英语)高考英语)n21.A.I practice every day B.Thank you very muchC.No,I dont think so D.Well,its not good enough n22.A.have pollutedB.is being polluted C.has been polluted D.have been polluted n23.A.ofB.forC.by D.aboutn24.A.thatB.whenC.which D.where n25.A.voices had comeB.came voicesC.voices would comeD.did
18、voices comen26.A.she means B.you mean C.I mean D.we mean n27.A.beg B.hesitate C.desire D.seek n28.A.fight for B.apply for C.call on D.wait on n29.A.delay B.effort C.schedule D.considerationn30.A.exactly B.fortunately C.surprisingly D.hardlyn31.A.will makeB.had madeC.was making D.makes n32.A.Remindin
19、gB.RemindedC.To remind D.Having remindedn33.A.when B.while C.after D.since n34.A.markingB.markedC.having marked D.being markedn35.A.would not winB.would not have wonC.would win D.would have won 12/13/202235单项填空考点分析单项填空考点分析(福建(福建2009高考英语)高考英语)n21.A.I practice every day B.Thank you very muchC.No,I don
20、t think so D.Well,its not good enough n22.A.have pollutedB.is being polluted C.has been polluted D.have been polluted n23.A.ofB.forC.by D.aboutn24.A.thatB.whenC.which D.where n25.A.voices had comeB.came voicesC.voices would comeD.did voices comen26.A.she means B.you mean C.I mean D.we mean n27.A.beg
21、 B.hesitate C.desire D.seek n28.A.fight for B.apply for C.call on D.wait on n29.A.delay B.effort C.schedule D.considerationn30.A.exactly B.fortunately C.surprisingly D.hardlyn31.A.will makeB.had madeC.was making D.makes n32.A.RemindingB.RemindedC.To remind D.Having remindedn33.A.when B.while C.after
22、 D.since n34.A.markingB.markedC.having marked D.being markedn35.A.would not winB.would not have wonC.would win D.would have won 12/13/202236单项填空考点分析单项填空考点分析(福建(福建2009高考英语)高考英语)n21.A.I practice every day B.Thank you very muchC.No,I dont think so D.Well,its not good enough n22.A.have pollutedB.is bein
23、g polluted C.has been polluted D.have been polluted n23.A.ofB.forC.by D.aboutn24.A.thatB.whenC.which D.where n25.A.voices had comeB.came voicesC.voices would comeD.did voices comen26.A.she means B.you mean C.I mean D.we mean n27.A.beg B.hesitate C.desire D.seek n28.A.fight for B.apply for C.call on
24、D.wait on n29.A.delay B.effort C.schedule D.considerationn30.A.exactly B.fortunately C.surprisingly D.hardlyn31.A.will makeB.had madeC.was making D.makes n32.A.RemindingB.RemindedC.To remind D.Having remindedn33.A.when B.while C.after D.since n34.A.markingB.markedC.having marked D.being markedn35.A.
25、would not winB.would not have wonC.would win D.would have won 12/13/202237单项填空考点分析单项填空考点分析(福建(福建2009高考英语)高考英语)n21.A.I practice every day B.Thank you very muchC.No,I dont think so D.Well,its not good enough n22.A.have pollutedB.is being polluted C.has been polluted D.have been polluted n23.A.ofB.forC
26、.by D.aboutn24.A.thatB.whenC.which D.where n25.A.voices had comeB.came voicesC.voices would comeD.did voices comen26.A.she means B.you mean C.I mean D.we mean n27.A.beg B.hesitate C.desire D.seek n28.A.fight for B.apply for C.call on D.wait on n29.A.delay B.effort C.schedule D.considerationn30.A.exa
27、ctly B.fortunately C.surprisingly D.hardlyn31.A.will makeB.had madeC.was making D.makes n32.A.RemindingB.RemindedC.To remind D.Having remindedn33.A.when B.while C.after D.since n34.A.markingB.markedC.having marked D.being markedn35.A.would not winB.would not have wonC.would win D.would have won 12/1
28、3/202238单项填空考点分析单项填空考点分析(福建(福建2009高考英语)高考英语)n21.A.I practice every day B.Thank you very muchC.No,I dont think so D.Well,its not good enough n22.A.have pollutedB.is being polluted C.has been polluted D.have been polluted n23.A.ofB.forC.by D.aboutn24.A.thatB.whenC.which D.where n25.A.voices had comeB.
29、came voicesC.voices would comeD.did voices comen26.A.she means B.you mean C.I mean D.we mean n27.A.beg B.hesitate C.desire D.seek n28.A.fight for B.apply for C.call on D.wait on n29.A.delay B.effort C.schedule D.considerationn30.A.exactly B.fortunately C.surprisingly D.hardlyn31.A.will makeB.had mad
30、eC.was making D.makes n32.A.RemindingB.RemindedC.To remind D.Having remindedn33.A.when B.while C.after D.since n34.A.markingB.markedC.having marked D.being markedn35.A.would not winB.would not have wonC.would win D.would have won 12/13/202239选择项选择项结构结构意义意义分类分类词类词类语法属性语法属性结构分析结构分析固定结构固定结构意义理解意义理解逻辑关系
31、逻辑关系动词变化动词变化谓语动词谓语动词22,312535非谓语动词非谓语动词3234语法辨析语法辨析情态动词情态动词冠词冠词代词代词26介词介词23连词连词从句引导词从句引导词2433语义辨析语义辨析动词动词27,28名词名词29形容词形容词副词副词30语用辨析语用辨析交际用语交际用语2112/13/202240n22.-Why does the Lake smell terrible?-Because large quantities of water _.语法属性语法属性A.have pollutedB.is being polluted C.has been polluted D.ha
32、ve been polluted n25.For a moment nothing happened Then _ all shouting together.结结构分析构分析A.voices had comeB.came voices C.voices would come D.did voices comen31.According to the literary review,Shakespeare _ his charities live through their language in his plays.语法属性语法属性A.will makeB.had made C.was ma
33、kingD.makes n32._ not to miss the flight at 15:20,the manager set out for the airport in a hurry.结构分析结构分析A.Reminding B.RemindedC.To remind D.Having remindedn34.In April,2009,President Hu inspected the warships in Qingdao,_ the 60th anniversary of the founding of the PLA Navy.意义理解意义理解A.markingB.marke
34、dC.having marked D.being markedn35.But for the help of my English teacher,I _ the first prize in the English Writing Competition.特殊结构特殊结构A.would not win B.would not have wonC.would win D.would have won12/13/202241n23.-How amazing it is that astronauts are exploring outer space!-Its a challenge,I gue
35、ss,_ man against nature.意义理解A.ofB.forC.byD.aboutn24.Its helpful to put children in a situation _ they can see themselves differently.结构分析A.thatB.whenC.whichD.wheren26.-Your mum is very kind.-Yeah,My mum is pretty considerate,you know what _,she always arranges everything around me.逻辑关系A.she means B.
36、you mean C.I mean D.we meann33.She had just finished her homework _ her mother asked her to practice playing the piano yesterday.固定结构A.when B.whileC.afterD.since 12/13/202242n27.We are at your service.Dont _ to turn to us if you have any further problems.意义理解意义理解nA.begnB.hesitatenC.desirenD.seekn28.
37、The Somali robbers frequent attacks on the sea urged the United Nations to _ all nations to take immediate action.意义理解意义理解nA.fight fornB.apply fornC.call onnD.wait onn29.The World Health Organization gave a warning to the public without any _ when the virus of H1N1 hit Mexico in April,2009.意义理解意义理解n
38、A.delaynB.effortnC.schedulenD.consideration12/13/202243命题技巧:n(a)考点与答对概率考点与答对概率 n Youre going to the movies,_?narent youndont wenarent theynarent InYoure going to the movies,_ you?narent ndontnareA.do12/13/202244nDont you find it surprising that such a nice house _ uninhabited by its owner ever since
39、 the time it was built?nwould have been leavednshould have been leftnshould be leavednwould be left命题技巧:12/13/202245n22.-Why does the Lake smell terrible?-Because large quantities of water _.A.have polluted B.is being polluted C.has been polluted D.have been polluted 12/13/202246n(b)干扰项的相容:对于不懂得正确选项
40、的考生来说,每个干扰项都应该具有似乎可能性命题技巧:12/13/20224712/13/202248n(C)答案的唯一性答案的唯一性nWhich do you think tastes _,the chicken or the fish?nwellngoodnbetternbest nFrankly only one of these two dishes tastes good.The other tastes awful.nWhich do you think tastes good,the chicken or the fish?nThese two dishes,the chicken
41、 and the fish,both taste better than all the others.nBut we must choose one for the first prize.Which do you think tastes best,the chicken or the fish?1.Youve tried my wifes two famous dishes the chicken and the fish.Which do you think tastes _?命题技巧:12/13/202249n(d)消除提示正确选项的线索nSome people think that
42、 they have a _to the problems of car crowding and pollution in large cities.nA.solution B.answer C.advice D.suggestionnHe is a brutal man and so everybody _ him.A.dislike B.respects C.pities D.praises命题技巧:12/13/202250n(e)避免诡题nWhen I met Tim yesterday,it was the first time I _ him since Christmas.nsa
43、wnhave seennhad seennhave been seeingnI would say it is not impossible for someone not as careful as you are to _ this not very important point.noverdonoverlooknoverratenoverstate命题技巧:12/13/202251n(f)注意口语与书面语的使用 n-The meeting has been canceled.n-_ I would not have come.A.Have I know earlier B.Had I
44、know earlier C.Knowing that earlier D.Know that earlier命题技巧:12/13/202252命题技巧:n(g)题干与选项的简洁nI _ this time yesterday.A.am writing to my parents B.was writing to may parents C.has been writing to my parents D.wrote to my parents12/13/202253完型填空试题结构试题结构 线索词语线索词语考试词语考试词语干扰干扰短文短文答案答案12/13/202254考点设置:突出关联性考
45、点设置:突出关联性n考点词语考点词语n选择考试词语的原则是:它必须可以根据篇章结构、意义连贯或其它上下文信息进行推导的词语。n线索词语线索词语n线索词语或结构主要来源于词语搭配、句子结构、篇章衔接和意义连贯等信息。n干扰项干扰项n完形填空的干扰项主要从搭配、结构、意义或连贯四个层面对答案进行干扰。12/13/202255完形填空题:完形填空题:考点分类n词:词:词语搭配词语搭配n句:结构和意义句:结构和意义n篇:衔接和连贯篇:衔接和连贯12/13/202256考点层次与焦点因素 12/13/20225712/13/202258nThe position of children in Ameri
46、can family and society is no longer what is used to be.The 36 family in colonial North America was mainly concerned with survival and 37 that,its own economic prosperity.Thus,children were 38 in terms of their productivity,and they played the role of producer quite early.39 they fulfilled this role,
47、their position in the family was one of subordination.n36.A.poor B.ordinary C.happy D.wealthyn37.A.except B.for C.beyond D.throughn38.A.supported B.received C.encouraged D.valuedn39.A.Until B.After C.Although D.When12/13/2022592009试卷完形填空考点归纳12/13/202260阅读理解 试题结构试题结构n阅读理解试题由阅读短文和若干个理阅读理解试题由阅读短文和若干个理解
48、问题组成,要求考生按照理解问题解问题组成,要求考生按照理解问题的要求,从阅读短文中获取合适的信的要求,从阅读短文中获取合适的信息,回答阅读理解的问题,即:判断息,回答阅读理解的问题,即:判断所获取的信息是否与试题提供的所获取的信息是否与试题提供的4个个选项中的某一项相匹配。选项中的某一项相匹配。n所以,阅读理解问题的所以,阅读理解问题的4个选择项中个选择项中只有一项是基于原文信息内容的正确只有一项是基于原文信息内容的正确理解,其余理解,其余3个选项或是对原文信息个选项或是对原文信息的错误理解,或是基于原文以外的信的错误理解,或是基于原文以外的信息。息。n阅读理解试题结构可以用右图表示:阅读理解
49、试题结构可以用右图表示:12/13/202261阅读理解阅读理解:考点分类信息处理信息处理单句信息单句信息句组信息句组信息全文信息全文信息信息理解信息理解意义理解意义理解 字面意义字面意义 解释意义解释意义 语境意义语境意义 隐含意义隐含意义 推理意义推理意义 概括意义概括意义 语言理解语言理解 词义猜测词义猜测 篇章结构篇章结构超篇章信息超篇章信息 作者态度作者态度 写作目的写作目的考点设置突出信息块信息块12/13/202262阅读理解阅读理解:干扰项n基本原则:a.干扰信息来源于原文 b.干扰信息要集中 c.不要互相干扰信息组合12/13/202263阅读理解阅读理解:干扰项n干扰方式
50、局部信息 信息组合 信息不符(干扰项信息大于、小于或相反于原文信息)篇外信息12/13/202264阅读理解阅读理解:干扰项n干扰项写题技巧:干扰项写题技巧:利用语篇层面的信息理解错误利用语篇层面的信息理解错误 a)对信息的错误联想:即:某点意思是阅读材料里本来有的,却把它和材对信息的错误联想:即:某点意思是阅读材料里本来有的,却把它和材料语篇里没有的、不相干的一些别的意思联系在一起,产生错误联想。料语篇里没有的、不相干的一些别的意思联系在一起,产生错误联想。b)对信息的错误判断:利用的是对信息在语篇中的意义的判断错误,体现对信息的错误判断:利用的是对信息在语篇中的意义的判断错误,体现为真假混