SOURCES OF VARIANCE COMPONENT IN DETERMINING RELIABILITY OF WEST AFRICAN EXAMINATION COUNCIL ESSAY QUESTIONS IN PHYSICS USING THE GENERALIZABILITY THEORY

Abstract

sources of variance component in determining reliability of west African examination council essay questions in physics using the generalizability theory investigates the sources of error variance in senior secondary school certificate examination in 2019 physics essay question. The design is two facet fully crossed G–study and D–study. The population is made up of (1,767) senior secondary three (SS3) students in Obio/Akpor Local Government Area of Rivers State. Simple random sampling technique was used to select 10 senior secondary schools out of 25 senior secondary schools through balloting. Purposive sampling technique was used to select 150 students who registered for only West African examination council. West African examination council (WASSCE 2019) physics questions were administered to the students in their various schools while 2 raters rated student’s scripts. Instrument for data collection 2019 May/June physics essay questions of West African senior school certificate examination (WASSCE), each item is rated on 10 points marking scheme which was adapted by the raters. The data collected was analyzed using a computer software SPSS through General linear model under Variance components MINQUE method. The result shows that student is the highest contribution of measurement (∂2 ∂2i. =. 016); the interaction effect of the variance component shows that student*item (∂ si = 2.957) interacted more and better followed by item*rater (∂2ir = .036) and item*student (∂2is = .024) while student*item*rater (∂2sir = -2.868) which is equal to zero. The interaction effect of variance component interacted very high among students and item (∂2si). The estimation of G and D study reliability coefficient which indicates that; the universe score 1.030, Relative error variance 2.981; Absolute error variance 4.878, G-study coefficient 0.26 and Index of dependability 0.17 were obtained from the score. The index of dependability is very low hence the questions were difficult. West African examination council (WAEC) should have a unit of psychometricians to verify their essay questions to establish if it has good index of dependability before sending it out for use. West African examination council (WAEC) should use generalizability theory for reliability test of all their essay questions before storing in their item banks to reduce the difficulty level of their items.