ERIC Number: ED663356
Record Type: Non-Journal
Publication Date: 2024-Sep-20
Pages: N/A
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Learning Materials and Their Effectiveness: Quasi-Experimental Evidence from Northern Nigeria
Wael Moussa; Emily Koester; Elizabeth Adelman
Society for Research on Educational Effectiveness
Background: This paper estimates the causal effects of an intervention under the UK-funded Partnership for Learning for All in Nigeria (PLANE). PLANE is a seven-year (2021-2028) early literacy and numeracy program that aims to improve student outcomes in Northwest Nigeria. In this region, fewer than 28% of children and youth. Numerous factors hinder learning, including limited teacher training, subpar instructional methods, scarce educational materials, overcrowded schools, poverty, and low parental education (Humphreys, 2015; National Population Commission, 2016). Less than half of children have access to English or math textbooks, and only 13% have local language textbooks (RTI International, 2016). PLANE is addressing these challenges in 1,953 schools across three northern states including teacher training and provision of literacy and math materials. Objective: This study explores whether learning materials enhance student learning outcomes. Existing research finds that provision of learning materials does not guarantee learning gains, in part because of language mismatch or lack of proper use at the school level (Glewwe & Muralidharan, 2016; Murnane & Ganimian, 2014). Thus, our paper adopts a quasi-experimental approach to explore the direct effects of providing local language materials to both students and teachers, coupled with teacher training on their use. In addition, we explore equity implications by testing whether the intervention impacts vary by sex or socioeconomic standing. Setting: The study takes place in three Northern states in Nigeria, Jigawa, Kano, and Kaduna, spanning 17 Local Government Areas (LGAs), which are the equivalent of district-level subnational units. The study includes second grade children in formal primary schools, the majority of whom speak Hausa as their first language. We measure reading and math performance using the Early Grade Reading and Math Assessment (EGR/MA) developed by RTI International, which has been used globally and has been adapted to the Hausa language (Dubeck & Gove, 2015). Participants: The analytic sample includes a total of 224 schools across 47 LGAs, 111 of whom are PLANE implementing schools and 113 are control schools from neighboring LGAs. We sampled approximately 6 second grade students at each school. Additionally, we collected student assessment data across 4 rounds spanning the beginning and end of the 2022-23 and 2023-24 school years, respectively. Research Design: PLANE implements in target LGAs (i.e. districts) that were selected jointly by program staff and state education officials. Because the districts were non-randomly selected, a randomized trial was impossible. We therefore use a spatial regression discontinuity (SRD) design as the empirical strategy to estimate intervention. The SRD relies on geographic proximity of schools to district borders as the basis for assignment. In this case, the LGA borders represent sharp cutoffs for the implementation of PLANE. This methodology relies on the condition that schools and students are similar on either side of the border, thus mimicking the properties of a randomized trial. We supplement the analysis by incorporating a pre-intervention baseline and multiple postintervention periods, enabling us to trace the evolution of the program impacts over time (Butts, 2023). Results: We estimate that the provision of student and teacher learning materials, coupled with teacher training on material use, has significant positive impacts on students' reading and math outcomes. Because of the data available across multiple time periods, we provide some insight into the temporal dynamics associated with the intervention's impacts. We find that the intervention showed no significant impacts in the first year of implementation, but these impacts then become positive and significant in the second year. This is true for both reading and math outcomes. In the first year, we estimate reading and impacts that range between -0.18 and 0.13 SD, depending on the subgroup and assessment subject, while in the second year, the estimated impacts range between 0.24 and 0.63 SD, respectively. Conclusion: We demonstrate that provision of learning materials can be effective in yielding significant improvements in student learning in low-resource contexts. Our findings do not dismiss earlier research results but suggest that while learning materials alone may have limited impact, their effectiveness is significantly enhanced when combined with appropriate contextualization and teacher training, thereby maximizing the potential benefits of similar educational interventions. The paper also provides insight into how teacher/institutional experience with the intervention plays a role in realizing the potential positive effects of the intervention. This finding reflects the need for time for teachers to acclimate and adjust their teaching routines and lesson plans to newly provided materials.
Descriptors: Foreign Countries, Instructional Materials, Educational Resources, Partnerships in Education, Afro Asiatic Languages, Language of Instruction, Elementary School Curriculum, Elementary School Students, Elementary School Teachers, Professional Development, Grade 2, Reading Skills, Reading Tests, Mathematics Skills, Mathematics Tests, Achievement Gains, Instructional Improvement
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; e-mail: contact@sree.org; Web site: https://www.sree.org/
Publication Type: Reports - Research
Education Level: Elementary Education; Early Childhood Education; Grade 2; Primary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Society for Research on Educational Effectiveness (SREE)
Identifiers - Location: Nigeria; United Kingdom
Grant or Contract Numbers: N/A