Recently, a video of a LinkedIn post grabbed my attention that introduced a tablet-PC based Augmented Reality system to be used for training clinical staff how to interact with patients.
Simulating complex working situations that require a combination of social, technical and team skills is a highly interesting application domain for Augmented Reality. Nurses and further members of the clinical staff being in charge of patient care are confronted with this type of scenarios on a daily bases. Augmented Reality gives trainers full design freedom to generate endless training scenarios in order to reflect real working conditions.
Katy Russell, Business Development Manager at Campus Interactive has kindly answered my small list of questions about this application and the related Augmented Reality App.
Katy, can you describe the intention of your app and the target audience in the medical field?
The purpose is to create empathy and enhance caring whilst delivering the technical skills nurses must provide. By introducing patient scenarios using AR, nurses feel much more connected to what they are doing. It’s much better than a teacher explaining a patient scenario. The target audience is medical, nursing and healthcare schools where training is required on Sim Man.
How do you achieve the overlay/registration of the dummy and the videos showing the actors?
We started by editing the films to remove the backgrounds so the real background could be seen in AR view. This is important so the nurses can see the monitors etc. Originally we set-up a point cloud and aligned the films to the dummy this way. However, we are now using face tracking technology.
Did you do user studies, evaluations that prove the benefit of your approach?
Yes – Mel Lindley , Deborah Clark & Robin Gissing from the University conducted an evaluation. (Author info: the following figure shows the outcome of the study)
What are the important aspects that can be better learned with your app?
This augmented reality use case is available to all our partner institutions and can be adapted for all medical scenarios, dentistry scenarios, sports therapy scenarios, first aid scenarios and even veterinary scenarios! We tailor make the videos to suit the cultural circumstances of the area where nurses are working. Accents, use of language, slang etc. are incorporated for authenticity.
Thank you for your time!