Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface

Claudio Alvarez; Luis A. Rojas; Juan de Dios Valenzuela

doi:10.1007/978-3-031-05064-0_1

Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface

Claudio Alvarez^*, Luis A. Rojas, Juan de Dios Valenzuela

^*Autor correspondiente de este trabajo

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

Resumen

Computer programming skills are essential for a variety of disciplines in the fields of Science, Technology, Engineering and Mathematics (STEM). To support learning of programming in personalized ways, Programming Tutors (PTs) have been utilized in higher education contexts for decades. However, implementation of PTs with mobile devices has remained unexplored from both design and adoption standpoints. In this research, we designed, implemented, and trialled a PT based on Telegram Messenger. The tutor was introduced to a cohort of engineering freshmen (N= 227 ) in a computer programming course; however, it was introduced as an optional learning tool with no extrinsic incentives for fostering its adoption. Under these conditions, students’ activity with the tool was monitored for 11 days. A total of 99 students (44.7 % ) chose to use the tutor and did so at least once. In average, students who used the tutor solved 9.2 tasks out of a maximum of 18 (SD= 5.49 ). The use of notifications was found highly influential to motivate tutor use: within 3 days of a student receiving a reminder notification, 80.6% of responses to tasks were registered. The tutor scored a mean of 73.8 (SD= 13.81 ) in the Systems Usability Scale. Students suggestions for improvement emphasized the need for more elaborate feedback after submitting their responses to problems and leveling of task difficulty. Regarding the tutor’s best features, mobility and ease of use of the interface were found the most prominent.

Idioma original	Inglés
Título de la publicación alojada	Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface
Subtítulo de la publicación alojada	Applications in Education and Commerce - 14th International Conference, SCSM 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings
Editores	Gabriele Meiselwitz
Editorial	Springer Science and Business Media Deutschland GmbH
Páginas	3-20
Número de páginas	18
ISBN (versión impresa)	9783031050633
DOI	https://doi.org/10.1007/978-3-031-05064-0_1
Estado	Publicada - 2022
Evento	14th International Conference on Social Computing and Social Media, SCSM 2022 Held as Part of the 24th HCI International Conference, HCII 2022 - Virtual, Online Duración: 26 jun. 2022 → 1 jul. 2022

Serie de la publicación

Nombre	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volumen	13316 LNCS
ISSN (versión impresa)	0302-9743
ISSN (versión digital)	1611-3349

Conferencia

Conferencia	14th International Conference on Social Computing and Social Media, SCSM 2022 Held as Part of the 24th HCI International Conference, HCII 2022
Ciudad	Virtual, Online
Período	26/06/22 → 1/07/22

Nota bibliográfica

Funding Information:
Acknowledgements. We thank Dr. Alyssa F. Wise for her cooperation with this research. This research was funded by ANID/FONDECYT Initiation into Research grant 11160211.

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Acceder al documento

10.1007/978-3-031-05064-0_1

Otros archivos y enlaces

Citar esto

Alvarez, C., Rojas, L. A., & de Dios Valenzuela, J. (2022). Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface. En G. Meiselwitz (Ed.), Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface: Applications in Education and Commerce - 14th International Conference, SCSM 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings (pp. 3-20). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13316 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-05064-0_1

Alvarez, Claudio ; Rojas, Luis A. ; de Dios Valenzuela, Juan. / Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface. Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface: Applications in Education and Commerce - 14th International Conference, SCSM 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings. editor / Gabriele Meiselwitz. Springer Science and Business Media Deutschland GmbH, 2022. pp. 3-20 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{d8bf63c7d96f416e9741a3fc23a7ab01,

title = "Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface",

abstract = "Computer programming skills are essential for a variety of disciplines in the fields of Science, Technology, Engineering and Mathematics (STEM). To support learning of programming in personalized ways, Programming Tutors (PTs) have been utilized in higher education contexts for decades. However, implementation of PTs with mobile devices has remained unexplored from both design and adoption standpoints. In this research, we designed, implemented, and trialled a PT based on Telegram Messenger. The tutor was introduced to a cohort of engineering freshmen (N= 227 ) in a computer programming course; however, it was introduced as an optional learning tool with no extrinsic incentives for fostering its adoption. Under these conditions, students{\textquoteright} activity with the tool was monitored for 11 days. A total of 99 students (44.7 % ) chose to use the tutor and did so at least once. In average, students who used the tutor solved 9.2 tasks out of a maximum of 18 (SD= 5.49 ). The use of notifications was found highly influential to motivate tutor use: within 3 days of a student receiving a reminder notification, 80.6% of responses to tasks were registered. The tutor scored a mean of 73.8 (SD= 13.81 ) in the Systems Usability Scale. Students suggestions for improvement emphasized the need for more elaborate feedback after submitting their responses to problems and leveling of task difficulty. Regarding the tutor{\textquoteright}s best features, mobility and ease of use of the interface were found the most prominent.",

keywords = "Instant messaging, Programming tutor, User study",

author = "Claudio Alvarez and Rojas, {Luis A.} and {de Dios Valenzuela}, Juan",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 14th International Conference on Social Computing and Social Media, SCSM 2022 Held as Part of the 24th HCI International Conference, HCII 2022 ; Conference date: 26-06-2022 Through 01-07-2022",

year = "2022",

doi = "10.1007/978-3-031-05064-0_1",

language = "English",

isbn = "9783031050633",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "3--20",

editor = "Gabriele Meiselwitz",

booktitle = "Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface",

address = "Germany",

}

Alvarez, C, Rojas, LA & de Dios Valenzuela, J 2022, Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface. En G Meiselwitz (ed.), Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface: Applications in Education and Commerce - 14th International Conference, SCSM 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13316 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 3-20, 14th International Conference on Social Computing and Social Media, SCSM 2022 Held as Part of the 24th HCI International Conference, HCII 2022, Virtual, Online, 26/06/22. https://doi.org/10.1007/978-3-031-05064-0_1

Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface. / Alvarez, Claudio; Rojas, Luis A.; de Dios Valenzuela, Juan.
Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface: Applications in Education and Commerce - 14th International Conference, SCSM 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings. ed. / Gabriele Meiselwitz. Springer Science and Business Media Deutschland GmbH, 2022. p. 3-20 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13316 LNCS).

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

TY - GEN

T1 - Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface

AU - Alvarez, Claudio

AU - Rojas, Luis A.

AU - de Dios Valenzuela, Juan

PY - 2022

Y1 - 2022

N2 - Computer programming skills are essential for a variety of disciplines in the fields of Science, Technology, Engineering and Mathematics (STEM). To support learning of programming in personalized ways, Programming Tutors (PTs) have been utilized in higher education contexts for decades. However, implementation of PTs with mobile devices has remained unexplored from both design and adoption standpoints. In this research, we designed, implemented, and trialled a PT based on Telegram Messenger. The tutor was introduced to a cohort of engineering freshmen (N= 227 ) in a computer programming course; however, it was introduced as an optional learning tool with no extrinsic incentives for fostering its adoption. Under these conditions, students’ activity with the tool was monitored for 11 days. A total of 99 students (44.7 % ) chose to use the tutor and did so at least once. In average, students who used the tutor solved 9.2 tasks out of a maximum of 18 (SD= 5.49 ). The use of notifications was found highly influential to motivate tutor use: within 3 days of a student receiving a reminder notification, 80.6% of responses to tasks were registered. The tutor scored a mean of 73.8 (SD= 13.81 ) in the Systems Usability Scale. Students suggestions for improvement emphasized the need for more elaborate feedback after submitting their responses to problems and leveling of task difficulty. Regarding the tutor’s best features, mobility and ease of use of the interface were found the most prominent.

AB - Computer programming skills are essential for a variety of disciplines in the fields of Science, Technology, Engineering and Mathematics (STEM). To support learning of programming in personalized ways, Programming Tutors (PTs) have been utilized in higher education contexts for decades. However, implementation of PTs with mobile devices has remained unexplored from both design and adoption standpoints. In this research, we designed, implemented, and trialled a PT based on Telegram Messenger. The tutor was introduced to a cohort of engineering freshmen (N= 227 ) in a computer programming course; however, it was introduced as an optional learning tool with no extrinsic incentives for fostering its adoption. Under these conditions, students’ activity with the tool was monitored for 11 days. A total of 99 students (44.7 % ) chose to use the tutor and did so at least once. In average, students who used the tutor solved 9.2 tasks out of a maximum of 18 (SD= 5.49 ). The use of notifications was found highly influential to motivate tutor use: within 3 days of a student receiving a reminder notification, 80.6% of responses to tasks were registered. The tutor scored a mean of 73.8 (SD= 13.81 ) in the Systems Usability Scale. Students suggestions for improvement emphasized the need for more elaborate feedback after submitting their responses to problems and leveling of task difficulty. Regarding the tutor’s best features, mobility and ease of use of the interface were found the most prominent.

KW - Instant messaging

KW - Programming tutor

KW - User study

UR - https://doi.org/10.1007/978-3-031-05064-0_1

UR - http://www.scopus.com/inward/record.url?scp=85133208313&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/562a9204-7924-31e3-b4d1-e4832e70493c/

U2 - 10.1007/978-3-031-05064-0_1

DO - 10.1007/978-3-031-05064-0_1

M3 - Conference contribution

AN - SCOPUS:85133208313

SN - 9783031050633

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 3

EP - 20

BT - Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface

A2 - Meiselwitz, Gabriele

PB - Springer Science and Business Media Deutschland GmbH

T2 - 14th International Conference on Social Computing and Social Media, SCSM 2022 Held as Part of the 24th HCI International Conference, HCII 2022

Y2 - 26 June 2022 through 1 July 2022

ER -

Alvarez C, Rojas LA, de Dios Valenzuela J. Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface. En Meiselwitz G, editor, Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface: Applications in Education and Commerce - 14th International Conference, SCSM 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings. Springer Science and Business Media Deutschland GmbH. 2022. p. 3-20. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-05064-0_1