Original Research

Disentangling the language effect in South African schools: Measuring the impact of ‘language of assessment’ in grade 3 literacy and numeracy

Nicholas Spaull
South African Journal of Childhood Education | Vol 6, No 1 | a475 | DOI: https://doi.org/10.4102/sajce.v6i1.475 | © 2016 Nicholas Spaull | This work is licensed under CC Attribution 4.0
Submitted: 07 July 2016 | Published: 03 December 2016

About the author(s)

Nicholas Spaull, SARChl Chair in Integrated Studies of Learning Language, Mathematics and Science in Primary School, University of Johannesburg, South Africa

Abstract

The aim of this article is to exploit an unusual occurrence whereby a large group of South African grade 3 students were tested twice, 1 month apart, on the same test in different languages. Using a simplified difference-in-difference methodology, it becomes possible to identify the causal impact of writing a test in English when English is not a student’s home language for 3402 students. The article aims to address the extent to which language factors (relative to non- language factors) can explain the high levels of underperformance in reading and mathematics in South Africa. I find that the language of assessment effect is between 0.3 and 0.7 standard deviations in literacy and 0 and 0.3 standard deviations in numeracy. This is approximately 1–2 years worth of learning in literacy and 0–1 year worth of learning in numeracy. By contrast, the size of the composite effect of home background and school quality is roughly 4 years worth of learning for both numeracy (1.2 standard deviations) and literacy (1.15 standard deviations). These results clearly show that the ‘language effect’ should be seen within the broader context of a generally dysfunctional schooling system. They further stress the importance of the quality of instruction, not only the language of learning and assessment. The fact that the literacy and numeracy achievement of South African children is so low in grade 3 (prior to any language switch to English in grade 4) should give pause to those who argue that language is the most important factor in determining achievement, or lack thereof, in South Africa.

Keywords

language of assessment; English Second Language; South Africa; literacy and numeracy

Metrics

Total abstract views: 5455
Total article views: 9788

 

Crossref Citations

1. How is their word knowledge growing? Exploring Grade 3 vocabulary in South African township schools
Elizabeth J. Pretorius, Lieke Stoffelsma
South African Journal of Childhood Education  vol: 7  issue: 1  first page: 13  year: 2017  
doi: 10.4102/sajce.v7i1.553

2. Mother-tongue education in a multilingual township: Possibilities for recognising lok’shin lingua in South Africa
Rockie Sibanda
Reading & Writing  vol: 10  issue: 1  year: 2019  
doi: 10.4102/rw.v10i1.225

3. Investigating English First Additional Language educators’ reading comprehension practices in selected schools in Gauteng, South Africa
Tilla Olifant, MP Cekiso, Naomi Boakye
South African Journal of Education  vol: 42  issue: 4  first page: 1  year: 2022  
doi: 10.15700/saje.v42n4a2094

4. The categorisation of questions in the assessment of language subjects for multilingual learners in South African primary schools
Nonhlanhla Ntuli, Ramona Kunene Nicolas
South African Journal of African Languages  vol: 43  issue: 2  first page: 138  year: 2023  
doi: 10.1080/02572117.2023.2248739

5. Leadership and context for the improvement of quality education in socio-deprived school contexts
Jan Heystek, Melese Shula
South African Journal of Education  vol: 44  issue: 2  first page: 1  year: 2024  
doi: 10.15700/saje.v44n2a2306

6. Evaluating the alignment between the Grade 9 mathematics Annual National Assessment and the TIMSS test items
Zwelithini Bongani Dhlamini
South African Journal of Education  vol: 41  issue: 3  first page: 1  year: 2021  
doi: 10.15700/saje.v41n3a1765

7. The Role of Translanguaging in Teaching Mathematics at Adult Correctional Centre Classrooms in South Africa
Siphelele Mbatha
E-Journal of Humanities, Arts and Social Sciences  first page: 825  year: 2024  
doi: 10.38159/ehass.2024563

8. Using games to develop number sense in early grade maths clubs
Lynn H. Bowie, Mellony H. Graven
South African Journal of Childhood Education  vol: 14  issue: 1  year: 2024  
doi: 10.4102/sajce.v14i1.1493

9. Relative difficulty of early grade compare type word problems: Learning from the case of isiXhosa
Ingrid E. Mostert
Pythagoras  vol: 41  issue: 1  year: 2020  
doi: 10.4102/pythagoras.v41i1.538

10. Exploring open education resources for teaching pre-reading in the intermediate phase
Marina Burger, Duduzile P. Zwane, Debbie A. Sanders, Kim C. Miller-Weber
Reading & Writing  vol: 16  issue: 1  year: 2025  
doi: 10.4102/rw.v16i1.519

11. Language of administration and academic test performance in Ghanaian children
Jessica L. Garcia, Paulina A. Kulesz, Elena L. Grigorenko
International Journal of Educational Research  vol: 130  first page: 102549  year: 2025  
doi: 10.1016/j.ijer.2025.102549

12. From mother tongue to English: A language policy shift at a multilingual township school in Gauteng
Rockie Sibanda, Lina P. Tshehla
South African Journal of Childhood Education  vol: 15  issue: 1  year: 2025  
doi: 10.4102/sajce.v15i1.1598

13. Exploring Grade Nine Geometry Spatial Mathematical Reasoning in the South African Annual National Assessment
Zwelithini Bongani Dhlamini, Kabelo Chuene, Kwena Masha, Israel Kibirige
EURASIA Journal of Mathematics, Science and Technology Education  vol: 15  issue: 11  year: 2019  
doi: 10.29333/ejmste/105481

14. Exploring Grade 8 English First Additional Language learners’ reading comprehension challenges
Agnitius Molwantoa, Florence Olifant
Reading & Writing  vol: 16  issue: 1  year: 2025  
doi: 10.4102/rw.v16i1.556

15. Quality assurance processes of language assessment artefacts and the development of language teachers’ assessment competence
Matthews M. Makgamatha
South African Journal of Childhood Education  vol: 12  issue: 1  year: 2022  
doi: 10.4102/sajce.v12i1.1151

16. Chronicling chronotopes: landscaping language for Kenyan multilingual classrooms
Rehema Abiyo, Marcelyn Oostendorp
Ethnography and Education  first page: 1  year: 2025  
doi: 10.1080/17457823.2025.2597766

17. Diversity of mathematical expression: the language of comparison in English and isiXhosa early grade mathematics texts
Ingrid Mostert, Nicky Roberts
Research in Mathematics Education  vol: 24  issue: 1  first page: 3  year: 2022  
doi: 10.1080/14794802.2020.1821757

18. Factors affecting Grade 6 learners’ reading performance in a rural school in Maluti, South Africa
Madoda Cekiso, Tsielo Rabelemane, Jay Jadezweni, Itani P. Mandende, Marius Dieperink
Reading & Writing  vol: 13  issue: 1  year: 2022  
doi: 10.4102/rw.v13i1.327