Topic3ValidityValidityDefinition:Atestissaidtobevalidifitmeasuresaccuratelywhatitisintendedtomeasure.Typesofvalidity:

ContentvalidityCriterion-relatedvalidityConstructvalidityFacevalidity3.1Contentvalidity

Atestissaidtohavecontentvalidityifitscontentconstitutesarepresentativesampleofthelanguageskills,

structures,etc.withwhichitismeanttobeconcerned.Inordertojudgewhetherornotthetesthasacontentvalidity,weneedaspecificationoftheskillsorstructures,ect.thatitismeanttocover.AcomparisonoftestspecificationandtestcontentisthebasisforjudgmentsastocontentvalidityTheimportanceofcontentvalidityFirstly,thegreateratest’scontentvalidity,themorelikelytobeanaccuratemeasureofwhatissupposedtomeasure.Secondly,suchatest,atest-specificationsnotrepresentedatall,islikelytohaveaharmfulbackwasheffect.Areaswhicharenottestedarelikelytobecomeignoredinteachingandleaning.3.2

Criterion—relatedvalidity

(效標(biāo)關(guān)聯(lián)效度)

Definition:ClassificationDefinition:

Anotherapproachtotestvalidityistoseehowfarresultsonthetestagreewiththoseprovidedbysomeindependentandhighlydependableassessmentofthecandidatesability.(CET摸擬題與CET實(shí)考題的各項(xiàng)分?jǐn)?shù)的相關(guān)性)效標(biāo)就是考察檢定考試效度的參照標(biāo)準(zhǔn)，效標(biāo)關(guān)聯(lián)效度也就是與該參照標(biāo)準(zhǔn)有關(guān)的效度。效標(biāo)關(guān)聯(lián)效度就是以某一種測(cè)驗(yàn)分?jǐn)?shù)與其效標(biāo)分?jǐn)?shù)之間的相關(guān)來(lái)表示的效度。換言之，一組考生參加某種考試的分?jǐn)?shù)與同一組考生參加另一公認(rèn)、的有較高效度的測(cè)驗(yàn)結(jié)果的一致性程度就是該考試的效標(biāo)效度。Therearetwokindsofcriterion—relatedvalidity:

ConcurrentvalidityConcurrent(共時(shí)性)validityisestablishedwhenthetestandcriterionareadministeredataboutthesametime.(例如:設(shè)計(jì)一次口語(yǔ)測(cè)試，因?yàn)闆](méi)有充足的時(shí)間去測(cè)試課程標(biāo)準(zhǔn)要求的全部語(yǔ)言功能，所以，對(duì)每位測(cè)試者進(jìn)行10鐘的口試。但我們不能確定10分鐘的口試能否反映被試著的實(shí)際口語(yǔ)能力。我們先設(shè)計(jì)了一次考試，考試時(shí)間45分鐘，并覆蓋較多的語(yǔ)言功能，以此，建立了一個(gè)口試標(biāo)準(zhǔn)；再將著10分鐘的口語(yǔ)考試結(jié)果與這個(gè)標(biāo)準(zhǔn)作相關(guān)分析，然后確定這十分鐘的效度。）Anoralachievementtest

Courseobjectives

Alargenumberof‘functions’

45minutes10minutes?FulltestscoresshortenedtestscoresEvidenceforconcurrentvalidity:Degreeofagreementcalculationofdegreeofagreement:

correlationcoefficient(possiblevalue:-1~1,thehigherthebetter)1:perfect(positive)agreement0:zeroagreement-1:negativeagreementAtestoforalabilityforahighleveldiplomaticpostNotrationaltoruntheriskofappointingsomeonewithinsufficientoralabilityLoweragreementNOTallowedAbriefinterviewformingpartofaplacementtestLoweragreementallowedCalculatingcorrelationcoefficientinSPSS.PredictiveValidityThisconcernsthedegreetowhichatestcanpredictcandidates’futureperformance.e.g.Couldaproficiencytestpredictastudent’sabilitytocopewithagraduatecourseataBritishuniversity.Discussion:Validatingaplacementtest.How?3.3ConstructValidity(結(jié)構(gòu)效度):Atest,partofatest,oratestingtechniqueissaidtohaveconstructvalidityifitcanbedemonstratedthatitmeasuresjusttheabilitywhichitissupposedtomeasure.Theword‘construct’referstoanyunderlyingability(ortrait)whichishypothesizedinatheoryoflanguageability.Forexample,whentestingreadingability,wehypothesizethattheabilitytoreadinvolvesasetofsub-abilities,suchasguessingunknownwordmeaningsfromthecontext.Thenweshouldrefertoresearchliteraturetoestablishwhetherornotsuchanabilityexistedandcouldbemeasuredinapartofthetest.

Ifwewereabletodemonstratethatwewereindeedmeasuringthatability,thenwesaythetesthasconstructvalidity.結(jié)構(gòu)效度研究是一個(gè)搜集證據(jù)證實(shí)某一考試的確在測(cè)試我們想測(cè)試的那種心理屬性的過(guò)程。一個(gè)考試如果被證實(shí)是在測(cè)量我們想測(cè)量的那種能力，那么這個(gè)考試就具有較好的結(jié)構(gòu)效度，它是一個(gè)編制假設(shè)再證實(shí)假設(shè)的過(guò)程。Howdoweknowthatthetestismeasuringwritingability?

Hypothesis:Ourtheoryofwritingtellsusthatunderlyingwritingabilityareanumberofsub-abilities:controlofpunctuationsensitivitytostylesstructurescoherenceandcohesion….Inordertomeasurethesesub-abilities,weadministerapilottestwhichinvolvestwosteps:用選擇題測(cè)試寫(xiě)作能力（間接考試）步驟：找一組被試（第一次參加考試），對(duì)他們的寫(xiě)作能力全面抽樣（讓他們做包含標(biāo)點(diǎn)、語(yǔ)法、體裁等的選擇題）；把測(cè)試結(jié)果與范文相比較：如果結(jié)果與范文相關(guān)系數(shù)高，說(shuō)明可以用選擇題測(cè)試寫(xiě)作能力1.Weobtainextensivesamplesofthewritingabilityofthegrouptowhomtestisfirstadministered,andhavethesereliablyscored.2.Wethencomparescoresonthepilottestwiththescoresgivenforthesamplesofwriting.Iftheagreementishigh,wearemeasuringwritingabilitywiththetest.按照假設(shè)分別測(cè)量各項(xiàng)能力：假設(shè)：標(biāo)點(diǎn)語(yǔ)法體裁寫(xiě)作能力↙↓↘／∣﹨／∣﹨／∣﹨單選填空改錯(cuò)單選填空改錯(cuò)單選填空改錯(cuò)7066685560628580823.4FaceValiditye.g.Anoraltestdoesn’trequirecandidatestospeakwouldnothavefacevalidity.Atestissaidtohavefacevalidityifitlook