A serious game for multimodal training of physician novices

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Serious games are usually applied to cognitive learning. However, the development of recent NaturalUser Interfaces (NUI) enables us to use serious games for a more holistic training. This projectproposes to implement an educative game that teaches medical students how to carry out aneurological examination. The purpose is to improve not only the cognitive knowledge of the youngphysicians but also their sensorimotor skills.The game takes place in a virtual doctor office, which is modelled in 3D. Many possible clinical casesrelated to different neurologic diseases are simulated. The users are tested at two skill levels. First ofall, they have to choose the right exam according to the patient’s symptoms. This initial stage is usedto assess the theoretical expertise of the students. If the choice is correct, the physical examinationbegins. In order to evaluate the motor performance, a Kinect NUI is used. Such a device allows for thenatural and intuitive control of the doctor’s avatar because there is a direct link between theindividual’s and the avatar’s joints. Due to the fact that the real movements of the student are recordedwith some accuracy, it is possible to gauge whether or not the medical gesture is properly applied tothe virtual patient. In particular, the force and the precision of the movements are measured andcompared to reference values.After each examination immediate feedback is given, so that the learners may rectify their choices andimprove the quality of their motor skills at the next training session. Overall, the objective of thissoftware is to enable the future physicians to practice a basic medical exam on a wide scope ofneurologic disorders, without any risk for the patients and through an enjoyable approach.
Original languageUnknown
Title of host publicationProceedings of the 6th International Conference of Education, Research and Innovation
Number of pages6
Publication statusPublished - 1 Jan 2013
Event6th International Conference of Education, Research and Innovation -
Duration: 1 Jan 2013 → …


Conference6th International Conference of Education, Research and Innovation
Period1/01/13 → …


  • Serious games
  • sensorimotor learning

Cite this