Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

James R. Birt; Darryl Clare; Michael A. Cowling

doi:10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

James R. Birt, Darryl Clare, Michael A. Cowling

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review

8 Citations (Scopus)

350 Downloads (Pure)

Abstract

Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

Original language	English
Title of host publication	2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)
Editors	Duarte Duque, Jeremy White, Nuno Rodrigues, Joao L. Vilaca, Nuno Dias
Pages	1-6
Number of pages	6
ISBN (Electronic)	9781728103006
DOIs	https://doi.org/10.1109/SeGAH.2019.8882435
Publication status	Published - 5 Aug 2019
Event	7th IEEE International Conference on Serious Games and Applications for Health - Kyoto, Kyoto, Japan Duration: 5 Aug 2019 → 7 Aug 2019 Conference number: 7th http://www.segah.org/2019/index.html

Publication series

Name	2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019

Conference

Conference	7th IEEE International Conference on Serious Games and Applications for Health
Abbreviated title	SeGAH 2019
Country/Territory	Japan
City	Kyoto
Period	5/08/19 → 7/08/19
Internet address	http://www.segah.org/2019/index.html

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health EducationAccepted author manuscript, 1.13 MBLicence: Other

Cite this

Birt, J. R., Clare, D., & Cowling, M. A. (2019). Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. In D. Duque, J. White, N. Rodrigues, J. L. Vilaca, & N. Dias (Eds.), 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1-6). Article 8882435 (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019). https://doi.org/10.1109/SeGAH.2019.8882435

Birt, James R. ; Clare, Darryl ; Cowling, Michael A. / Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). editor / Duarte Duque ; Jeremy White ; Nuno Rodrigues ; Joao L. Vilaca ; Nuno Dias. 2019. pp. 1-6 (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019).

@inproceedings{52ef4d2fe5a9471da56df424cf4acfe6,

title = "Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education",

abstract = "Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.",

author = "Birt, {James R.} and Darryl Clare and Cowling, {Michael A.}",

year = "2019",

month = aug,

day = "5",

doi = "10.1109/SeGAH.2019.8882435",

language = "English",

series = "2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019",

pages = "1--6",

editor = "Duarte Duque and Jeremy White and Nuno Rodrigues and Vilaca, {Joao L.} and Nuno Dias",

booktitle = "2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)",

note = "7th IEEE International Conference on Serious Games and Applications for Health<br/>, SeGAH 2019 ; Conference date: 05-08-2019 Through 07-08-2019",

url = "http://www.segah.org/2019/index.html",

}

Birt, JR, Clare, D & Cowling, MA 2019, Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. in D Duque, J White, N Rodrigues, JL Vilaca & N Dias (eds), 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)., 8882435, 2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019, pp. 1-6, 7th IEEE International Conference on Serious Games and Applications for Health
, Kyoto, Japan, 5/08/19. https://doi.org/10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. / Birt, James R.; Clare, Darryl; Cowling, Michael A.
2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). ed. / Duarte Duque; Jeremy White; Nuno Rodrigues; Joao L. Vilaca; Nuno Dias. 2019. p. 1-6 8882435 (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review

TY - GEN

T1 - Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

AU - Birt, James R.

AU - Clare, Darryl

AU - Cowling, Michael A.

N1 - Conference code: 7th

PY - 2019/8/5

Y1 - 2019/8/5

N2 - Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

AB - Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with six practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners.

UR - http://www.scopus.com/inward/record.url?scp=85075024047&partnerID=8YFLogxK

UR - http://www.mixedrealityresearch.com/

U2 - 10.1109/SeGAH.2019.8882435

DO - 10.1109/SeGAH.2019.8882435

M3 - Conference contribution

T3 - 2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019

SP - 1

EP - 6

BT - 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH)

A2 - Duque, Duarte

A2 - White, Jeremy

A2 - Rodrigues, Nuno

A2 - Vilaca, Joao L.

A2 - Dias, Nuno

T2 - 7th IEEE International Conference on Serious Games and Applications for Health<br/>

Y2 - 5 August 2019 through 7 August 2019

ER -

Birt JR, Clare D, Cowling MA. Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. In Duque D, White J, Rodrigues N, Vilaca JL, Dias N, editors, 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). 2019. p. 1-6. 8882435. (2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019). doi: 10.1109/SeGAH.2019.8882435

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

Abstract

Publication series

Conference

UN SDGs

Access to Document

Other files and links

Fingerprint

Mixed Reality Research Lab

Digital Twins and XR - Presentation to the undergraduate engineers at IIT

XR Enhanced Simulation in Higher Education - Presentation to the Auckland University of Technology Scholarship of Technology Enhanced Learning Group

Presenting Mixed Reality Research Lab: Mobile MR Demo

Mixed Reality Multimodal Learning Analytics

Assessing mobile mixed reality affordances as a comparative visualization pedagogy for design communication

Integrating Mixed Reality Spatial Learning Analytics into Secure Electronic Exams

Cite this

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

Abstract

Publication series

Conference

UN SDGs

Access to Document

Other files and links

Fingerprint

Related Projects

Mixed Reality Research Lab

Related Activities

Digital Twins and XR - Presentation to the undergraduate engineers at IIT

XR Enhanced Simulation in Higher Education - Presentation to the Auckland University of Technology Scholarship of Technology Enhanced Learning Group

Presenting Mixed Reality Research Lab: Mobile MR Demo

Related Research Outputs

Mixed Reality Multimodal Learning Analytics

Assessing mobile mixed reality affordances as a comparative visualization pedagogy for design communication

Integrating Mixed Reality Spatial Learning Analytics into Secure Electronic Exams

Cite this