Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study

Javier Ibarra; Claudio Álvarez; Matías Recabarren

doi:10.1007/978-3-031-67998-8_6

Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study

Javier Ibarra, Claudio Álvarez, Matías Recabarren^*

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The ability to succinctly and effectively communicate complex ideas is increasingly recognized as a critical skill for engineering professionals, defining a realm of ill-defined learning tasks. The elevator pitch, particularly, serves as a prime example of this necessity. This study explores the extension of the EPIC intelligent tutoring system, originally designed to enhance oral communication skills in development and performance of elevator pitches through individual learning, by integrating collaborative capabilities with a focus on peer-assessment. A pilot study with 24 engineering students was conducted to assess the user experience, usability and learning outcomes. Results indicate that students’ experience and usability perceptions are generally positive. Moreover, students who positively rated the peer-assessment functionalities showed marked improvements in their abilities to deliver effective elevator pitches. Pedagogical implications and design criteria aiming to improve students’ valuation of collaborative work are discussed.

Original language	English
Title of host publication	Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings
Editors	Patricia Santos, Davinia Hernández-Leo, Claudio Álvarez, Minoru Kobayashi, Gustavo Zurita
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	81-96
Number of pages	16
ISBN (Print)	9783031679971
DOIs	https://doi.org/10.1007/978-3-031-67998-8_6
State	Published - 2024
Event	30th International Conference on Collaboration Technologies and Social Computing, CollabTech 2024 - Barcelona, Spain Duration: 11 Sep 2024 → 14 Sep 2024

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14890 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	30th International Conference on Collaboration Technologies and Social Computing, CollabTech 2024
Country/Territory	Spain
City	Barcelona
Period	11/09/24 → 14/09/24

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Keywords

Intelligent Tutoring System
Oral Communication
Peer-Assessment

Access to Document

10.1007/978-3-031-67998-8_6

Cite this

Ibarra, J., Álvarez, C., & Recabarren, M. (2024). Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study. In P. Santos, D. Hernández-Leo, C. Álvarez, M. Kobayashi, & G. Zurita (Eds.), Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings (pp. 81-96). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14890 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-67998-8_6

Ibarra, Javier ; Álvarez, Claudio ; Recabarren, Matías. / Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities : An Evaluation Study. Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings. editor / Patricia Santos ; Davinia Hernández-Leo ; Claudio Álvarez ; Minoru Kobayashi ; Gustavo Zurita. Springer Science and Business Media Deutschland GmbH, 2024. pp. 81-96 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{7db9bead10014e2eb72ae933d4763a71,

title = "Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study",

abstract = "The ability to succinctly and effectively communicate complex ideas is increasingly recognized as a critical skill for engineering professionals, defining a realm of ill-defined learning tasks. The elevator pitch, particularly, serves as a prime example of this necessity. This study explores the extension of the EPIC intelligent tutoring system, originally designed to enhance oral communication skills in development and performance of elevator pitches through individual learning, by integrating collaborative capabilities with a focus on peer-assessment. A pilot study with 24 engineering students was conducted to assess the user experience, usability and learning outcomes. Results indicate that students{\textquoteright} experience and usability perceptions are generally positive. Moreover, students who positively rated the peer-assessment functionalities showed marked improvements in their abilities to deliver effective elevator pitches. Pedagogical implications and design criteria aiming to improve students{\textquoteright} valuation of collaborative work are discussed.",

keywords = "Intelligent Tutoring System, Oral Communication, Peer-Assessment",

author = "Javier Ibarra and Claudio {\'A}lvarez and Mat{\'i}as Recabarren",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 30th International Conference on Collaboration Technologies and Social Computing, CollabTech 2024 ; Conference date: 11-09-2024 Through 14-09-2024",

year = "2024",

doi = "10.1007/978-3-031-67998-8_6",

language = "English",

isbn = "9783031679971",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "81--96",

editor = "Patricia Santos and Davinia Hern{\'a}ndez-Leo and Claudio {\'A}lvarez and Minoru Kobayashi and Gustavo Zurita",

booktitle = "Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings",

address = "Germany",

}

Ibarra, J, Álvarez, C & Recabarren, M 2024, Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study. in P Santos, D Hernández-Leo, C Álvarez, M Kobayashi & G Zurita (eds), Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14890 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 81-96, 30th International Conference on Collaboration Technologies and Social Computing, CollabTech 2024, Barcelona, Spain, 11/09/24. https://doi.org/10.1007/978-3-031-67998-8_6

Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study. / Ibarra, Javier; Álvarez, Claudio ; Recabarren, Matías.
Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings. ed. / Patricia Santos; Davinia Hernández-Leo; Claudio Álvarez; Minoru Kobayashi; Gustavo Zurita. Springer Science and Business Media Deutschland GmbH, 2024. p. 81-96 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14890 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities

T2 - 30th International Conference on Collaboration Technologies and Social Computing, CollabTech 2024

AU - Ibarra, Javier

AU - Álvarez, Claudio

AU - Recabarren, Matías

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

PY - 2024

Y1 - 2024

N2 - The ability to succinctly and effectively communicate complex ideas is increasingly recognized as a critical skill for engineering professionals, defining a realm of ill-defined learning tasks. The elevator pitch, particularly, serves as a prime example of this necessity. This study explores the extension of the EPIC intelligent tutoring system, originally designed to enhance oral communication skills in development and performance of elevator pitches through individual learning, by integrating collaborative capabilities with a focus on peer-assessment. A pilot study with 24 engineering students was conducted to assess the user experience, usability and learning outcomes. Results indicate that students’ experience and usability perceptions are generally positive. Moreover, students who positively rated the peer-assessment functionalities showed marked improvements in their abilities to deliver effective elevator pitches. Pedagogical implications and design criteria aiming to improve students’ valuation of collaborative work are discussed.

AB - The ability to succinctly and effectively communicate complex ideas is increasingly recognized as a critical skill for engineering professionals, defining a realm of ill-defined learning tasks. The elevator pitch, particularly, serves as a prime example of this necessity. This study explores the extension of the EPIC intelligent tutoring system, originally designed to enhance oral communication skills in development and performance of elevator pitches through individual learning, by integrating collaborative capabilities with a focus on peer-assessment. A pilot study with 24 engineering students was conducted to assess the user experience, usability and learning outcomes. Results indicate that students’ experience and usability perceptions are generally positive. Moreover, students who positively rated the peer-assessment functionalities showed marked improvements in their abilities to deliver effective elevator pitches. Pedagogical implications and design criteria aiming to improve students’ valuation of collaborative work are discussed.

KW - Intelligent Tutoring System

KW - Oral Communication

KW - Peer-Assessment

UR - http://www.scopus.com/inward/record.url?scp=85202293239&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-67998-8_6

DO - 10.1007/978-3-031-67998-8_6

M3 - Conference contribution

AN - SCOPUS:85202293239

SN - 9783031679971

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 81

EP - 96

BT - Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings

A2 - Santos, Patricia

A2 - Hernández-Leo, Davinia

A2 - Álvarez, Claudio

A2 - Kobayashi, Minoru

A2 - Zurita, Gustavo

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 11 September 2024 through 14 September 2024

ER -

Ibarra J, Álvarez C , Recabarren M. Extending an Intelligent Tutoring System for Oral Communication with Peer Assessment Capabilities: An Evaluation Study. In Santos P, Hernández-Leo D, Álvarez C, Kobayashi M, Zurita G, editors, Collaboration Technologies and Social Computing - 30th International Conference, CollabTech 2024, Proceedings. Springer Science and Business Media Deutschland GmbH. 2024. p. 81-96. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-67998-8_6