A pilot study to evaluate the face & construct validity of an orthopaedic virtual reality simulator


      • Virtual platform demonstrated ability to differentiate between levels of experience.
      • Higher novel metrics obtained in the module were associated with expertise.
      • The platform was felt to be more useful for surgical trainees early in their career.


      Aims: This study aimed to identify the face and construct validity of the Precision OS trauma module proximal femoral nail procedure. Secondary outcomes included perceived use of simulation in surgical training, with structured feedback from participants.
      Methods: A comparative interventional study was carried out in a regional orthopaedics trauma unit hospital. Volunteers were stratified into novice, intermediate and expert groups based on self-reported levels of experience. Each participant carried out a simulated proximal femoral nail on an immersive virtual platform following instruction on its use, with objective metrics such as time and x-rays, and novel metrics calculated by the simulation module recorded. Face validity was also assessed.
      Results: The proximal femoral nail module demonstrated construct validity. Kruskal Wallis test demonstrated a statistically significant difference across all group's novel performance (p=.018). Intermediate surgeons performed significantly better than novices (P=.022), with shorter procedural times (P=.018) Three of the intermediate group achieved the proficiency level set by the expert group, with no significant difference noted between these two groups (=.06). Time taken to completion for expert surgeons was less than intermediate group, although this did not reach significance (P=.19).
      Conclusion: The proximal femoral nail module on the Precision OS platform demonstrated good face, and construct validity. Further research evaluating use of virtual platform simulation in surgical trauma training is needed.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Injury
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Hurreiz H.
        The evolution of surgical training in the UK.
        Adv Med Educ Pract. 2019; 10: 163-168
        • Shaharan S
        • Neary P.
        Evaluation of surgical training in the era of simulation.
        World J Gastrointest Endosc. 2014; 6: 436-447
        • Alvand A
        • Khan T
        • Al-Ali S
        • Jackson WF
        • Price AJ
        • Rees JL
        Simple visual parameters for objective assessment of arthroscopic skill.
        J Bone Joint Surg Am. 2012; 94: e97
        • George BC
        • Bohnen JD
        • Williams RG
        • Meyerson SL
        • Schuller MC
        • Clark MJ
        • et al.
        Readiness of US general surgery residents for independent practice.
        Ann Surg. 2017; 266: 582-594
        • Group H.
        International guidelines for groin hernia management.
        Hernia. 2018; 22: 1-165
        • Foissey C
        • Fauvernier M
        • Fary C
        • Servien E
        • Lustig S
        • Batailler C.
        Total hip arthroplasty performed by direct anterior approach - does experience influence the learning curve?.
        SICOT J. 2020; 6: 15
        • Walsh CM
        • Sherlock ME
        • Ling SC
        • Carnahan H.
        Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy.
        Cochrane Database Syst Rev. 2012; CD008237
        • Khan R
        • Plahouras J
        • Johnston BC
        • Scaffidi MA
        • Grover SC
        • Walsh CM.
        Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy.
        Cochrane Database Syst Rev. 2018; 8CD008237
        • Mahmood T
        • Scaffidi MA
        • Khan R
        • Grover SC.
        Virtual reality simulation in endoscopy training: current evidence and future directions.
        World J Gastroenterol. 2018; 24: 5439-5445
        • Alaker M
        • Wynn GR
        • Arulampalam T.
        Virtual reality training in laparoscopic surgery: a systematic review & meta-analysis.
        Int J Surg. 2016; 29: 85-94
        • Dehabadi M
        • Fernando B
        • Berlingieri P.
        The use of simulation in the acquisition of laparoscopic suturing skills.
        Int J Surg. 2014; 12: 258-268
        • Duarte RJ
        • Cury J
        • Oliveira LC
        • Srougi M.
        Establishing the minimal number of virtual reality simulator training sessions necessary to develop basic laparoscopic skills competence: evaluation of the learning curve.
        Int Braz J Urol. 2013; 39: 712-719
        • Rebolledo BJ
        • Hammann-Scala J
        • Leali A
        • Ranawat AS.
        Arthroscopy skills development with a surgical simulator: a comparative study in orthopaedic surgery residents.
        Am J Sports Med. 2015; 43: 1526-1529
        • Waterman BR
        • Martin KD
        • Cameron KL
        • Owens BD
        • Belmont PJ.
        Simulation training improves surgical proficiency and safety during diagnostic shoulder arthroscopy performed by residents.
        Orthopedics. 2016; 39: e479-e485
        • Wang KC
        • Bernardoni ED
        • Cotter EJ
        • Cole BJ
        • Verma NN
        • Romeo AA
        • et al.
        Impact of simulation training on diagnostic arthroscopy performance: a randomized controlled trial.
        Arthrosc Sports Med Rehabil. 2019; 1: e47-e57
        • Akhtar K
        • Sugand K
        • Sperrin M
        • Cobb J
        • Standfield N
        • Gupte C.
        Training safer orthopedic surgeons. Construct validation of a virtual-reality simulator for hip fracture surgery.
        Acta Orthop. 2015; 86: 616-621
        • Bartlett JD
        • Lawrence JE
        • Stewart ME
        • Nakano N
        • Khanduja V.
        Does virtual reality simulation have a role in training trauma and orthopaedic surgeons?.
        Bone Joint J. 2018; 100-B: 559-565
      1. StatPearls. 2020.

        • Authen AL
        • Dybvik E
        • Furnes O
        • Gjertsen JE.
        Surgeon's experience level and risk of reoperation after hip fracture surgery: an observational study on 30,945 patients in the Norwegian hip fracture register 2011-2015.
        Acta Orthop. 2018; 89: 496-502
        • Schijven MP
        • Jakimowicz JJ.
        Validation of virtual reality simulators: key to the successful integration of a novel teaching technology into minimal access surgery.
        Minim Invasive Ther Allied Technol. 2005; 14: 244-246
        • Harris DJ
        • Bird JM
        • Smart PA
        • Wilson MR
        • Vine SJ.
        A framework for the testing and validation of simulated environments in experimentation and training.
        Front Psychol. 2020; 11: 605
        • Boet S
        • Bould MD
        • Fung L
        • Qosa H
        • Perrier L
        • Tavares W
        • et al.
        Transfer of learning and patient outcome in simulated crisis resource management: a systematic review.
        Can J Anaesth. 2014; 61: 571-582
        • Blyth P
        • Stott NS
        • Anderson IA.
        Virtual reality assessment of technical skill using the Bonedoc DHS simulator.
        Injury. 2008; 39: 1127-1133
        • Froelich JM
        • Milbrandt JC
        • Novicoff WM
        • Saleh KJ
        • Allan DG.
        Surgical simulators and hip fractures: a role in residency training?.
        J Surg Educ. 2011; 68: 298-302
        • Lohre R
        • Wang JC
        • Lewandrowski KU
        • Goel DP.
        Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons.
        J Spine Surg. 2020; 6: S208-SS23
        • Lohre R
        • Bois AJ
        • Athwal GS
        • Goel DP
        (CSES) CSaES. Improved complex skill acquisition by immersive virtual reality training: a randomized controlled trial.
        J Bone Joint Surg Am. 2020; 102: e26
        • Alvand A
        • Auplish S
        • Khan T
        • Gill HS
        • Rees JL.
        Identifying orthopaedic surgeons of the future: the inability of some medical students to achieve competence in basic arthroscopic tasks despite training: a randomised study.
        J Bone Joint Surg Br. 2011; 93: 1586-1591
        • Kaplan DJ
        • Patel JN
        • Liporace FA
        • Yoon RS.
        Intraoperative radiation safety in orthopaedics: a review of the ALARA (as low as reasonably achievable) principle.
        Patient Saf Surg. 2016; 10: 27
        • Parikh SN
        • d'Heurle A
        • Eismann EA
        • Cornwall R.
        The value of interpretation of intraoperative fluoroscopy by radiologists during pediatric fracture treatment.
        J Pediatr Orthop. 2014; 34: 359-361
        • Paul GR
        • Guyver P
        • Baldwin M
        • Akhtar K
        • Alvand A
        • Price AJ
        • et al.
        Validation of the updated ArthroS simulator: face and construct validity of a passive haptic virtual reality simulator with novel performance metrics.
        Knee Surg Sports Traumatol Arthrosc. 2017; (<i data-test="journal-title" style="box-sizing: inherit;">): 616-625
        • O'Connor EM
        • Nason GJ
        • Manecksha RP.
        An analysis of gender diversity in urology in the UK and Ireland.
        Ir Med J. 2017; 110: 648
        • Ip M.
        Technology not policy will help drive female consultant numbers higher.
        Bulletin. 2020; 104: 134-137
        • Pedersen P
        • Palm H
        • Ringsted C
        • Konge L.
        Virtual-reality simulation to assess performance in hip fracture surgery.
        Acta Orthop. 2014; 85: 403-407