Multimodal cognitive nonverbal and verbal interactions: The neurorehabilitation of autistic children via mobile toy robots

Research output: Contribution to journalArticleResearchpeer-review

10 Citations (Scopus)

Abstract

Multimodal cognitive nonverbal processes could be thought as a building block from which emotional and verbal expressions could emerge. With the intention to explore this hypothesis, we studied the interaction between autistic children and mobile toy robots during free spontaneous game play both quantitatively and qualitatively. Cognitive nonverbal criteria (eye contact, touch, manipulation, and posture) were analyzed, firstly in a dyadic interaction and secondly in a triadic interaction. The frequency of nouns and verbs including those which express positive emotion was figured out only in dyadic interaction. Once the cognitive nonverbal state between the child and the robot established, the child interacts with a third person displaying positive emotion. A positive correlation exists between multimodal cognitive nonverbal processes and verbal expression when the free game play with the robot is possible. This data suggests that in free spontaneous game play (i.e., ecological situation) the mobile toy robots could be used as a neural orthesis to enhance severe, middle and moderate autistic children's brain multimodal activity. The findings allow us to infer that this neural orthesis could pave the way for the development of synergistic dialogues between autistic children and human environment.

Original languageEnglish
Pages (from-to)214-222
Number of pages9
JournalInternational Journal on Advances in Life Sciences
Volume5
Issue number3-4
Publication statusPublished - 2013
Externally publishedYes

Fingerprint

verbal interaction
Play and Playthings
toy
robot
Robots
interaction
Emotions
emotion
Touch
Brain
Posture
manipulation
brain
dialogue
Neurological Rehabilitation
contact
human being

Cite this

@article{ac79b98e2f11435e987b06c41d6f8851,
title = "Multimodal cognitive nonverbal and verbal interactions: The neurorehabilitation of autistic children via mobile toy robots",
abstract = "Multimodal cognitive nonverbal processes could be thought as a building block from which emotional and verbal expressions could emerge. With the intention to explore this hypothesis, we studied the interaction between autistic children and mobile toy robots during free spontaneous game play both quantitatively and qualitatively. Cognitive nonverbal criteria (eye contact, touch, manipulation, and posture) were analyzed, firstly in a dyadic interaction and secondly in a triadic interaction. The frequency of nouns and verbs including those which express positive emotion was figured out only in dyadic interaction. Once the cognitive nonverbal state between the child and the robot established, the child interacts with a third person displaying positive emotion. A positive correlation exists between multimodal cognitive nonverbal processes and verbal expression when the free game play with the robot is possible. This data suggests that in free spontaneous game play (i.e., ecological situation) the mobile toy robots could be used as a neural orthesis to enhance severe, middle and moderate autistic children's brain multimodal activity. The findings allow us to infer that this neural orthesis could pave the way for the development of synergistic dialogues between autistic children and human environment.",
author = "Irini Giannopulu",
year = "2013",
language = "English",
volume = "5",
pages = "214--222",
journal = "International Journal on Advances in Life Sciences",
issn = "1942-2660",
publisher = "International Academy, Research, and Industry Association (IARIA)",
number = "3-4",

}

TY - JOUR

T1 - Multimodal cognitive nonverbal and verbal interactions

T2 - The neurorehabilitation of autistic children via mobile toy robots

AU - Giannopulu, Irini

PY - 2013

Y1 - 2013

N2 - Multimodal cognitive nonverbal processes could be thought as a building block from which emotional and verbal expressions could emerge. With the intention to explore this hypothesis, we studied the interaction between autistic children and mobile toy robots during free spontaneous game play both quantitatively and qualitatively. Cognitive nonverbal criteria (eye contact, touch, manipulation, and posture) were analyzed, firstly in a dyadic interaction and secondly in a triadic interaction. The frequency of nouns and verbs including those which express positive emotion was figured out only in dyadic interaction. Once the cognitive nonverbal state between the child and the robot established, the child interacts with a third person displaying positive emotion. A positive correlation exists between multimodal cognitive nonverbal processes and verbal expression when the free game play with the robot is possible. This data suggests that in free spontaneous game play (i.e., ecological situation) the mobile toy robots could be used as a neural orthesis to enhance severe, middle and moderate autistic children's brain multimodal activity. The findings allow us to infer that this neural orthesis could pave the way for the development of synergistic dialogues between autistic children and human environment.

AB - Multimodal cognitive nonverbal processes could be thought as a building block from which emotional and verbal expressions could emerge. With the intention to explore this hypothesis, we studied the interaction between autistic children and mobile toy robots during free spontaneous game play both quantitatively and qualitatively. Cognitive nonverbal criteria (eye contact, touch, manipulation, and posture) were analyzed, firstly in a dyadic interaction and secondly in a triadic interaction. The frequency of nouns and verbs including those which express positive emotion was figured out only in dyadic interaction. Once the cognitive nonverbal state between the child and the robot established, the child interacts with a third person displaying positive emotion. A positive correlation exists between multimodal cognitive nonverbal processes and verbal expression when the free game play with the robot is possible. This data suggests that in free spontaneous game play (i.e., ecological situation) the mobile toy robots could be used as a neural orthesis to enhance severe, middle and moderate autistic children's brain multimodal activity. The findings allow us to infer that this neural orthesis could pave the way for the development of synergistic dialogues between autistic children and human environment.

UR - http://www.scopus.com/inward/record.url?scp=84892376259&partnerID=8YFLogxK

M3 - Article

VL - 5

SP - 214

EP - 222

JO - International Journal on Advances in Life Sciences

JF - International Journal on Advances in Life Sciences

SN - 1942-2660

IS - 3-4

ER -