Measuring the quality of teaching practices in primary schools:: assessing the validity of the Teach observation tool in Punjab, Pakistan.

Ezequiel Molina; Syeda Farwa Fatima; Andrew Dean Ho; Carolina Melo; Tracy Marie Wilichowski; Adelle Pushparatnam

doi:10.1016/j.tate.2020.103171

Measuring the quality of teaching practices in primary schools: assessing the validity of the Teach observation tool in Punjab, Pakistan.

Ezequiel Molina^*, Syeda Farwa Fatima, Andrew Dean Ho, Carolina Melo, Tracy Marie Wilichowski, Adelle Pushparatnam

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

7 Scopus citations

Abstract

Monitoring the quality of teaching practices of primary school teachers in low-and-middle-income countries is often hampered by the lack of freely available classroom observation tools that are feasible to administer, validated in their own setting, and can be used as part of national monitoring systems. To address this discrepancy, Teach, an open-access classroom observation tool, was developed to measure the quality of teaching practices of primary school teachers in low-and-middle-income countries. This paper uses data from Punjab, Pakistan to evaluate the validity of Teach. Results show that Teach scores were internally consistent, presented good inter-rater reliability, and provided sufficient information to differentiate low from high-quality teaching practices. Further, higher Teach scores were associated with higher student outcomes.

Original language	English
Article number	103171
Journal	Teaching and Teacher Education
Volume	96
DOIs	https://doi.org/10.1016/j.tate.2020.103171
State	Published - Nov 2020

Bibliographical note

Funding Information:
This study was made possible by the World Bank's Systems Approach for Better Education (SABER) Trust Fund, which is supported by the United Kingdom's Department for International Development (DFID) and Australia's Department of Foreign Affairs and Trade (DFAT). We are grateful to the many researchers, survey experts, and observers who supported the data collection effort and to all of the participating schools in Punjab, Pakistan. In particular, we'd like to thank the World Bank's Punjab SABER Service Delivery team, led by Koen Martijn Geven, and including Tazeen Fasih, Sarfraz Bhatti, Eema Masood, Abdal Mufti, Maria Qureshi, and Mahjabeen Raza. We are also grateful to Omar Arias, Luis Benveniste, Deon Filmer, and Halsey Rogers, who provided feedback on previous versions of this paper. Moreover, we'd like to thank the Teach Advisory Panel composed of Lindsay Brown, Pam Grossman, Heather Hill, Sara Rimm-Kaufman, Andrew Ragatz, Erica Woolway, and Nick Yoder for providing feedback during the development of the tool. Lastly, and most importantly, the team members would like to thank all the teachers who welcomed us into their classroom as part of this project. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors and do not necessarily represent the views of the International Bank for Reconstruction and Development (IBRD), its affiliate organizations, the Executive Directors of the World Bank, or the governments they represent.

Funding Information:
This study was made possible by the World Bank’s Systems Approach for Better Education (SABER) Trust Fund, which is supported by the United Kingdom’s Department for International Development (DFID) and Australia’s Department of Foreign Affairs and Trade (DFAT). We are grateful to the many researchers, survey experts, and observers who supported the data collection effort and to all of the participating schools in Punjab, Pakistan. In particular, we’d like to thank the World Bank’s Punjab SABER Service Delivery team, led by Koen Martijn Geven, and including Tazeen Fasih, Sarfraz Bhatti, Eema Masood, Abdal Mufti, Maria Qureshi, and Mahjabeen Raza. We are also grateful to Omar Arias, Luis Benveniste, Deon Filmer, and Halsey Rogers, who provided feedback on previous versions of this paper. Moreover, we’d like to thank the Teach Advisory Panel composed of Lindsay Brown, Pam Grossman, Heather Hill, Sara Rimm-Kaufman, Andrew Ragatz, Erica Woolway, and Nick Yoder for providing feedback during the development of the tool. Lastly, and most importantly, the team members would like to thank all the teachers who welcomed us into their classroom as part of this project. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors and do not necessarily represent the views of the International Bank for Reconstruction and Development (IBRD), its affiliate organizations, the Executive Directors of the World Bank, or the governments they represent.

Publisher Copyright:
© 2020

Keywords

Education
Education policy and planning
Public service delivery
Teacher performance
Teacher training

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1016/j.tate.2020.103171

Cite this

@article{9fac4a40a4c946708364c5a859b6dd8d,

title = "Measuring the quality of teaching practices in primary schools:: assessing the validity of the Teach observation tool in Punjab, Pakistan.",

abstract = "Monitoring the quality of teaching practices of primary school teachers in low-and-middle-income countries is often hampered by the lack of freely available classroom observation tools that are feasible to administer, validated in their own setting, and can be used as part of national monitoring systems. To address this discrepancy, Teach, an open-access classroom observation tool, was developed to measure the quality of teaching practices of primary school teachers in low-and-middle-income countries. This paper uses data from Punjab, Pakistan to evaluate the validity of Teach. Results show that Teach scores were internally consistent, presented good inter-rater reliability, and provided sufficient information to differentiate low from high-quality teaching practices. Further, higher Teach scores were associated with higher student outcomes.",

keywords = "Education, Education policy and planning, Public service delivery, Teacher performance, Teacher training",

author = "Ezequiel Molina and Fatima, {Syeda Farwa} and Ho, {Andrew Dean} and Carolina Melo and Wilichowski, {Tracy Marie} and Adelle Pushparatnam",

note = "Funding Information: This study was made possible by the World Bank's Systems Approach for Better Education (SABER) Trust Fund, which is supported by the United Kingdom's Department for International Development (DFID) and Australia's Department of Foreign Affairs and Trade (DFAT). We are grateful to the many researchers, survey experts, and observers who supported the data collection effort and to all of the participating schools in Punjab, Pakistan. In particular, we'd like to thank the World Bank's Punjab SABER Service Delivery team, led by Koen Martijn Geven, and including Tazeen Fasih, Sarfraz Bhatti, Eema Masood, Abdal Mufti, Maria Qureshi, and Mahjabeen Raza. We are also grateful to Omar Arias, Luis Benveniste, Deon Filmer, and Halsey Rogers, who provided feedback on previous versions of this paper. Moreover, we'd like to thank the Teach Advisory Panel composed of Lindsay Brown, Pam Grossman, Heather Hill, Sara Rimm-Kaufman, Andrew Ragatz, Erica Woolway, and Nick Yoder for providing feedback during the development of the tool. Lastly, and most importantly, the team members would like to thank all the teachers who welcomed us into their classroom as part of this project. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors and do not necessarily represent the views of the International Bank for Reconstruction and Development (IBRD), its affiliate organizations, the Executive Directors of the World Bank, or the governments they represent. Funding Information: This study was made possible by the World Bank{\textquoteright}s Systems Approach for Better Education (SABER) Trust Fund, which is supported by the United Kingdom{\textquoteright}s Department for International Development (DFID) and Australia{\textquoteright}s Department of Foreign Affairs and Trade (DFAT). We are grateful to the many researchers, survey experts, and observers who supported the data collection effort and to all of the participating schools in Punjab, Pakistan. In particular, we{\textquoteright}d like to thank the World Bank{\textquoteright}s Punjab SABER Service Delivery team, led by Koen Martijn Geven, and including Tazeen Fasih, Sarfraz Bhatti, Eema Masood, Abdal Mufti, Maria Qureshi, and Mahjabeen Raza. We are also grateful to Omar Arias, Luis Benveniste, Deon Filmer, and Halsey Rogers, who provided feedback on previous versions of this paper. Moreover, we{\textquoteright}d like to thank the Teach Advisory Panel composed of Lindsay Brown, Pam Grossman, Heather Hill, Sara Rimm-Kaufman, Andrew Ragatz, Erica Woolway, and Nick Yoder for providing feedback during the development of the tool. Lastly, and most importantly, the team members would like to thank all the teachers who welcomed us into their classroom as part of this project. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors and do not necessarily represent the views of the International Bank for Reconstruction and Development (IBRD), its affiliate organizations, the Executive Directors of the World Bank, or the governments they represent. Publisher Copyright: {\textcopyright} 2020",

year = "2020",

month = nov,

doi = "10.1016/j.tate.2020.103171",

language = "English",

volume = "96",

journal = "Teaching and Teacher Education",

issn = "0742-051X",

publisher = "Elsevier Ltd.",

}

TY - JOUR

T1 - Measuring the quality of teaching practices in primary schools:

T2 - assessing the validity of the Teach observation tool in Punjab, Pakistan.

AU - Molina, Ezequiel

AU - Fatima, Syeda Farwa

AU - Ho, Andrew Dean

AU - Melo, Carolina

AU - Wilichowski, Tracy Marie

AU - Pushparatnam, Adelle

N1 - Funding Information: This study was made possible by the World Bank's Systems Approach for Better Education (SABER) Trust Fund, which is supported by the United Kingdom's Department for International Development (DFID) and Australia's Department of Foreign Affairs and Trade (DFAT). We are grateful to the many researchers, survey experts, and observers who supported the data collection effort and to all of the participating schools in Punjab, Pakistan. In particular, we'd like to thank the World Bank's Punjab SABER Service Delivery team, led by Koen Martijn Geven, and including Tazeen Fasih, Sarfraz Bhatti, Eema Masood, Abdal Mufti, Maria Qureshi, and Mahjabeen Raza. We are also grateful to Omar Arias, Luis Benveniste, Deon Filmer, and Halsey Rogers, who provided feedback on previous versions of this paper. Moreover, we'd like to thank the Teach Advisory Panel composed of Lindsay Brown, Pam Grossman, Heather Hill, Sara Rimm-Kaufman, Andrew Ragatz, Erica Woolway, and Nick Yoder for providing feedback during the development of the tool. Lastly, and most importantly, the team members would like to thank all the teachers who welcomed us into their classroom as part of this project. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors and do not necessarily represent the views of the International Bank for Reconstruction and Development (IBRD), its affiliate organizations, the Executive Directors of the World Bank, or the governments they represent. Funding Information: This study was made possible by the World Bank’s Systems Approach for Better Education (SABER) Trust Fund, which is supported by the United Kingdom’s Department for International Development (DFID) and Australia’s Department of Foreign Affairs and Trade (DFAT). We are grateful to the many researchers, survey experts, and observers who supported the data collection effort and to all of the participating schools in Punjab, Pakistan. In particular, we’d like to thank the World Bank’s Punjab SABER Service Delivery team, led by Koen Martijn Geven, and including Tazeen Fasih, Sarfraz Bhatti, Eema Masood, Abdal Mufti, Maria Qureshi, and Mahjabeen Raza. We are also grateful to Omar Arias, Luis Benveniste, Deon Filmer, and Halsey Rogers, who provided feedback on previous versions of this paper. Moreover, we’d like to thank the Teach Advisory Panel composed of Lindsay Brown, Pam Grossman, Heather Hill, Sara Rimm-Kaufman, Andrew Ragatz, Erica Woolway, and Nick Yoder for providing feedback during the development of the tool. Lastly, and most importantly, the team members would like to thank all the teachers who welcomed us into their classroom as part of this project. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors and do not necessarily represent the views of the International Bank for Reconstruction and Development (IBRD), its affiliate organizations, the Executive Directors of the World Bank, or the governments they represent. Publisher Copyright: © 2020

PY - 2020/11

Y1 - 2020/11

N2 - Monitoring the quality of teaching practices of primary school teachers in low-and-middle-income countries is often hampered by the lack of freely available classroom observation tools that are feasible to administer, validated in their own setting, and can be used as part of national monitoring systems. To address this discrepancy, Teach, an open-access classroom observation tool, was developed to measure the quality of teaching practices of primary school teachers in low-and-middle-income countries. This paper uses data from Punjab, Pakistan to evaluate the validity of Teach. Results show that Teach scores were internally consistent, presented good inter-rater reliability, and provided sufficient information to differentiate low from high-quality teaching practices. Further, higher Teach scores were associated with higher student outcomes.

AB - Monitoring the quality of teaching practices of primary school teachers in low-and-middle-income countries is often hampered by the lack of freely available classroom observation tools that are feasible to administer, validated in their own setting, and can be used as part of national monitoring systems. To address this discrepancy, Teach, an open-access classroom observation tool, was developed to measure the quality of teaching practices of primary school teachers in low-and-middle-income countries. This paper uses data from Punjab, Pakistan to evaluate the validity of Teach. Results show that Teach scores were internally consistent, presented good inter-rater reliability, and provided sufficient information to differentiate low from high-quality teaching practices. Further, higher Teach scores were associated with higher student outcomes.

KW - Education

KW - Education policy and planning

KW - Public service delivery

KW - Teacher performance

KW - Teacher training

UR - http://www.scopus.com/inward/record.url?scp=85089430427&partnerID=8YFLogxK

U2 - 10.1016/j.tate.2020.103171

DO - 10.1016/j.tate.2020.103171

M3 - Article

AN - SCOPUS:85089430427

SN - 0742-051X

VL - 96

JO - Teaching and Teacher Education

JF - Teaching and Teacher Education

M1 - 103171

ER -