Validating Touch Surgery™: A cognitive task simulation and rehearsal app for intramedullary femoral nailing

      Abstract

      Background

      The role of simulation in orthopaedic surgical training is becoming increasingly evident, as simulation allows repeated sustained practice in an environment that does not harm the patient. Previous studies have shown that the cognitive aspects of surgery are of equal if not greater importance in developing decision making than the practical aspects.

      Aim

      To observe construct, content and face validity of four IFN modules on a cognitive simulator, Touch Surgery™.

      Methods

      39 novices and 10 experts were recruited to complete four simulation modules on surgical decision-making that represented the procedural steps of preparing the patient and equipment, inserting and locking an intramedullary femoral nail. Real-time objective performance metrics were obtained, stored electronically and analysed using median and Bonett-Price 95% confidence intervals from the participant's primary attempt to assess for construct validity. The median score of a post-study questionnaire using 5-point Likert scales assessed face and content validity. Data was confirmed as non-parametric by the Kolmogorov–Smirnov test. Significance was calculated using the Mann–Whitney U test for independent data whilst the Wilcoxon signed ranked test was used for paired data. Significance was set as 2-tailed p-value < 0.05.

      Results

      Experts significantly outperformed novices in all four modules to demonstrate construct validity (p < 0.001). Specifically, experts scored 32.5% higher for patient positioning and preparation (p < 0.0001), 31.5% higher for femoral canal preparation (p < 0.0001), 22.5% higher for proximal locking (p < 0.0001) and 17% higher scores for distal locking and closure (p < 0.001). Both cohorts either agreed or strongly agreed that the graphics, simulated environment and procedural steps were realistic. Also, both cohorts agreed that the app was useful for surgical training and rehearsal, should be implemented within the curriculum and would want to use it to learn other surgical procedures.

      Conclusion

      IFN on the Touch Surgery app demonstrated construct, face and content validity. Users can demonstrate cognitive competencies prior to performing surgical procedures in the operating room. The application is an effective adjunct to traditional learning methods and has potential for curricular implementation.

      Keywords

      To read this article in full you will need to make a payment
      Subscribe to Injury
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Weiss R.J.
        • Montgomery S.M.
        • Al Dabbagh Z.
        • Jansson K.A.
        National data of 6409 Swedish inpatients with femoral shaft fractures: stable incidence between 1998 and 2004.
        Injury. 2009; 40: 304-308
        • Hedlund R.
        • Lindgren U.
        Epidemiology of diaphyseal femoral fracture.
        Acta Orthop Scand. 1986; October (57): 423-427
      1. Kneebone R, Aggarwal R. Surgical training using simulation. BMJ 2009;338(May):b1001.

      2. Department of Health. Guidance on the implementation of the European Working Time Directive. April 29, 2004. Available at: http://www.dohc.ie/issues/european_working_time_directive/ [cited 10.01.15].

        • Fitzgibbons S.C.
        • Chen J.
        • Jagsi R.
        • Weinstein D.
        Long-term follow-up on the educational impact of ACGME duty hour limits: a pre-post survey study.
        Ann Surg. 2012; 256: 1108-1112
        • Reznick R.K.
        • MacRae H.
        Teaching surgical skills—changes in the wind.
        N Engl J Med. 2006; 355: 2664-2669
        • Kahol K.
        • Satava R.M.
        • Ferrara J.
        • Smith M.L.
        Effect of short-term pretrial practice on surgical proficiency in simulated environments: a randomized trial of the preoperative warm-up effect.
        J Am Coll Surg. 2009; 208: 255-268
        • Frischknecht A.C.
        • Boehler M.L.
        • Schwind C.J.
        • Brunsvold M.E.
        • Gruppen L.D.
        • Brenner M.J.
        • Hauge L.S.
        How prepared are your interns to take calls? Results of a multi-institutional study of simulated pages to prepare medical students for surgery internship.
        Am J Surg. 2014; 208: 307-315
        • Promberger R.
        • Ott J.
        • Bures C.
        • Kober F.
        • Freissmuth M.
        • Seemann R.
        • Hermann M.
        Can a surgeon predict the risk of postoperative hypoparathyroidism during thyroid surgery? A prospective study on self-assessment by experts.
        Am J Surg. 2014; 208: 13-20
        • Clark R.E.
        • Estes F.
        Cognitive task analysis.
        Int J Educ Res. 1996; 25: 403-417
        • Carter F.J.
        • Schijven M.P.
        • Aggarwal R.
        • Grantcharov T.
        • Francis N.K.
        • Hanna G.B.
        • Jakimowicz J.J.
        • Work Group for Evaluation and Implementation of Simulators and Skills Training Programmes
        Consensus guidelines for validation of virtual reality surgical simulators.
        Surg Endosc. 2005; 19: 1523-1532
        • Smink D.S.
        • Peyre S.E.
        • Soybel D.I.
        • Tavakkolizadeh A.
        • Vernon A.H.
        • Anastakis D.J.
        Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives.
        Am J Surg. 2012; 203: 540-545
        • Yates K.
        • Sullivan M.
        • Clark R.
        Integrated studies on the use of cognitive task analysis to capture surgical expertise for central venous catheter placement and open cricothyrotomy.
        Am J Surg. 2012; 203: 76-80
        • Campbell J.
        • Tirapelle L.
        • Yates K.
        • Clark R.
        • Inaba K.
        • Green D.
        • Plurad D.
        • Lam L.
        • Tang A.
        • Cestero R.
        • Sullivan M.
        The effectiveness of a cognitive task analysis informed curriculum to increase self-efficacy and improve performance for an open cricothyrotomy.
        J Surg Educ. 2011; 68: 403-407
        • Wohldmann EL1
        • Healy A.F.
        • Bourne L.E.
        A mental practice superiority effect: less retroactive interference and more transfer than physical practice.
        J Exp Psychol Learn Mem Cogn. 2008; 34: 823-833
        • Driskell J.E.
        • Copper C.
        • Moran A.
        Does mental practice enhance performance?.
        J Appl Psychol. 1994; 79: 481-492
        • Arora S.
        • Aggarwal R.
        • Sirimanna P.
        • Moran A.
        • Grantcharov T.
        • Kneebone R.
        • Sevdalis N.
        • Darzi A.
        Mental practice enhances surgical technical skills: a randomized controlled study.
        Ann Surg. 2011; 253: 265-270
        • Velmahos G.C.
        • Toutouzas K.G.
        • Sillin L.F.
        • Chan L.
        • Clark R.E.
        • Theodorou D.
        • Maupin F.
        Cognitive task analysis for teaching technical skills in an inanimate surgical skills laboratory.
        Am J Surg. 2004; 187: 114-119
      3. Accredited Education Institutes, American College of Surgeons. Available from: http://www.facs.org/education/accreditation/aei [cited 10.01.15].

      4. British Orthopaedic Association, Specialist Training in Trauma and Orthopaedics Curriculum August 2014. Available from: http://www.iscp.ac.uk/documents/syllabus_TO_2014.pdf [cited 11.02.15].

        • McCarthy A.D.
        • Moody L.
        • Waterworth A.R.
        • Bickerstaff D.R.
        Passive haptics in a knee arthroscopy simulator: is it valid for core skills training?.
        Clin Orthop Relat Res. 2006; 442: 13-20
        • Muller W.
        • Bockholt U.
        The virtual reality arthroscopy training simulator.
        Stud Health Technol Inform. 1998; 50: 13-19
        • Escoto A.
        • Trejos A.L.
        • Naish M.D.
        • Patel R.V.
        • Lebel M.E.
        Force sensing-based simulator for arthroscopic skills assessment in orthopaedic knee surgery.
        Stud Health Technol Inform. 2012; 173: 129-135
        • Cannon W.D.
        • Eckhoff D.G.
        • Garrett Jr., W.E.
        • Hunter R.E.
        • Sweeney H.J.
        Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint.
        Clin Orthop Relat Res. 2006; 442: 21-29
        • Seymour N.E.
        • Gallagher A.G.
        • Roman S.A.
        • O’Brien M.K.
        • Bansal V.K.
        • Andersen D.K.
        • Satava R.M.
        Virtual reality training improves operating room performance: results of a randomized, double-blinded study.
        Ann Surg. 2002; 236 ([discussion 463–4]): 458-463
        • Ogan K.
        • Jacomides L.
        • Shulman M.J.
        • Roehrborn C.G.
        • Cadeddu J.A.
        • Pearle M.S.
        Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver.
        J Urol. 2004; 172: 667-671
        • Grantcharov T.P.
        • Kristiansen V.B.
        • Bendix J.
        • Bardram L.
        • Rosenberg J.
        • Funch-Jensen P.
        Randomized clinical trial of virtual reality simulation for laparoscopic skills training.
        Br J Surg. 2004; 91: 146-150
        • Knoll T.
        • Trojan L.
        • Haecker A.
        • Alken P.
        • Michel M.S.
        Validation of computer-based training in ureterorenoscopy.
        BJU Int. 2005; 95: 1276-1279
      5. Matsumoto ED, Pace KT, D’A Honey RJ. Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol 2006;13(July (7)):896–901.

        • Okamura A.M.
        Haptic feedback in robot-assisted minimally invasive surgery.
        Curr Opin Urol. 2009; 19: 102-107