Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

James R. Birt; Darryl Clare; Michael A. Cowling

doi:10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

James R. Birt, Darryl Clare, Michael A. Cowling

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review

148 Downloads (Pure)

Abstract

Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

Original language	English
Title of host publication	2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)
Editors	Duarte Duque, Jeremy White, Nuno Rodrigues, Joao L. Vilaca, Nuno Dias
Pages	1-6
Number of pages	6
ISBN (Electronic)	9781728103006
DOIs	https://doi.org/10.1109/SeGAH.2019.8882435
Publication status	Published - 5 Aug 2019
Event	7th IEEE International Conference on Serious Games and Applications for Health - Kyoto, Kyoto, Japan Duration: 5 Aug 2019 → 7 Aug 2019 Conference number: 7th http://www.segah.org/2019/index.html

Publication series

Name	2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019

Conference

Conference	7th IEEE International Conference on Serious Games and Applications for Health
Abbreviated title	SeGAH 2019
Country	Japan
City	Kyoto
Period	5/08/19 → 7/08/19
Internet address	http://www.segah.org/2019/index.html

Access to Document

10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health EducationAccepted author manuscript, 1.13 MBLicence: Other

Link to publication in Scopus

Fingerprint Dive into the research topics of 'Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education'. Together they form a unique fingerprint.

4 Invited talk
1 Organising a conference, workshop, ...

XR Enhanced Simulation in Higher Education - Presentation to the Auckland University of Technology Scholarship of Technology Enhanced Learning Group
James Birt (Speaker) & Michael A. Cowling (Speaker)
9 Aug 2019
Activity: Talk or presentation › Invited talk
Digital Twins and XR - Presentation to the undergraduate engineers at IIT
James Birt (Speaker)
9 Mar 2021
Activity: Talk or presentation › Invited talk
Presenting Mixed Reality Research Lab: Mobile MR Demo
James Birt (Speaker)
31 Jan 2019
Activity: Talk or presentation › Invited talk

4 Article
1 Chapter
1 Conference contribution
1 Presentation

Mixed Reality Multimodal Learning Analytics
Cowling, M. A. & Birt, J. R., 27 Jan 2020, Encyclopedia of Educational Innovation. Peters, M. & Heraud, R. (eds.). Springer
Research output: Chapter in Book/Report/Conference proceeding › Chapter › Research › peer-review

Open Access
File
21 Downloads (Pure)
Assessing mobile mixed reality affordances as a comparative visualization pedagogy for design communication
Birt, J. R. & Cowling, M. A., 28 Nov 2018, In: Research in Learning Technology. 26, 25 p., 2128 .
Research output: Contribution to journal › Article › Research › peer-review

Open Access
File
9 Citations (Scopus)

106 Downloads (Pure)
Integrating Mixed Reality Spatial Learning Analytics into Secure Electronic Exams
Cowling, M. A., Hillier, M. & Birt, J. R., 28 Nov 2018, ASCILITE 2018 Conference Proceedings - Open Oceans: Learning without borders. Campbell, M., Willems, J., Adachi, C., Blake, D., Doherty, I., Krishnan, S., Macfarlane, S., Ngo, L., O’Donnell, M., Palmer, S., Riddell, L., Story, I., Suri, H. & Tai, J. (eds.). ASCILITE, p. 330-334 5 p.
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review

Open Access
File

Cite this

Birt, J. R., Clare, D., & Cowling, M. A. (2019). Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. In D. Duque, J. White, N. Rodrigues, J. L. Vilaca, & N. Dias (Eds.), 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1-6). [8882435] (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019). https://doi.org/10.1109/SeGAH.2019.8882435

Birt, James R. ; Clare, Darryl ; Cowling, Michael A. / Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). editor / Duarte Duque ; Jeremy White ; Nuno Rodrigues ; Joao L. Vilaca ; Nuno Dias. 2019. pp. 1-6 (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019).

@inproceedings{52ef4d2fe5a9471da56df424cf4acfe6,

title = "Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education",

abstract = "Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.",

author = "Birt, {James R.} and Darryl Clare and Cowling, {Michael A.}",

year = "2019",

month = aug,

day = "5",

doi = "10.1109/SeGAH.2019.8882435",

language = "English",

series = "2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019",

pages = "1--6",

editor = "Duarte Duque and Jeremy White and Nuno Rodrigues and Vilaca, {Joao L.} and Nuno Dias",

booktitle = "2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)",

note = "7th IEEE International Conference on Serious Games and Applications for Health<br/>, SeGAH 2019 ; Conference date: 05-08-2019 Through 07-08-2019",

url = "http://www.segah.org/2019/index.html",

}

Birt, JR, Clare, D & Cowling, MA 2019, Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. in D Duque, J White, N Rodrigues, JL Vilaca & N Dias (eds), 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)., 8882435, 2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019, pp. 1-6, 7th IEEE International Conference on Serious Games and Applications for Health
, Kyoto, Japan, 5/08/19. https://doi.org/10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. / Birt, James R.; Clare, Darryl; Cowling, Michael A.

2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). ed. / Duarte Duque; Jeremy White; Nuno Rodrigues; Joao L. Vilaca; Nuno Dias. 2019. p. 1-6 8882435 (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review

TY - GEN

T1 - Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

AU - Birt, James R.

AU - Clare, Darryl

AU - Cowling, Michael A.

N1 - Conference code: 7th

PY - 2019/8/5

Y1 - 2019/8/5

N2 - Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

AB - Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

UR - http://www.scopus.com/inward/record.url?scp=85075024047&partnerID=8YFLogxK

U2 - 10.1109/SeGAH.2019.8882435

DO - 10.1109/SeGAH.2019.8882435

M3 - Conference contribution

T3 - 2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019

SP - 1

EP - 6

BT - 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)

A2 - Duque, Duarte

A2 - White, Jeremy

A2 - Rodrigues, Nuno

A2 - Vilaca, Joao L.

A2 - Dias, Nuno

T2 - 7th IEEE International Conference on Serious Games and Applications for Health<br/>

Y2 - 5 August 2019 through 7 August 2019

ER -

Birt JR, Clare D, Cowling MA. Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. In Duque D, White J, Rodrigues N, Vilaca JL, Dias N, editors, 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). 2019. p. 1-6. 8882435. (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019). https://doi.org/10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

Abstract

Publication series

Conference

Access to Document

XR Enhanced Simulation in Higher Education - Presentation to the Auckland University of Technology Scholarship of Technology Enhanced Learning Group

Digital Twins and XR - Presentation to the undergraduate engineers at IIT

Presenting Mixed Reality Research Lab: Mobile MR Demo

Mixed Reality Multimodal Learning Analytics

Assessing mobile mixed reality affordances as a comparative visualization pedagogy for design communication

Integrating Mixed Reality Spatial Learning Analytics into Secure Electronic Exams

Cite this