Surgeon uses augmented reality for real-time data visualisation
A collaborative effort between US doctors and biomedical engineers has resulted in integrating the augmented reality tool, Apple Vision Pro, into surgical procedures.
A cardiologist used the technology to successfully perform an ablation procedure at Stanford Hospital to treat atrial fibrillation.
The innovation marks a significant milestone in advancing human-computer interaction within medical contexts.
Lloyd Minor, Dean of the School of Medicine and Vice President of Medical Affairs at Stanford University, hailed the integration as a testament to Stanford Medicine’s commitment to patient care in a digitally driven environment.
He emphasised the institution’s longstanding reputation for leveraging digital technologies in medicine responsibly and equitably.
David Entwistle, president and CEO of Stanford Health Care, underscored the institution’s preparedness for cutting-edge innovations in surgical interventions.
Michael Pfeffer, MD, chief information officer at Stanford Health Care, emphasised the institution’s commitment to exploring emerging technologies in healthcare.
During the ablation procedure, cardiac electrophysiologist Dr Alexander Perino utilised the augmented reality headset to navigate through real-time data streams.
By integrating secured data from a laptop, the headset enabled Dr Perino to manipulate virtual monitors seamlessly, enhancing his ability to perform the procedure while maintaining awareness of the patient and operating room.
The spatial computing headset tracks Dr Perino’s eye movements and allows intuitive interaction with multiple data streams, facilitating swift decision-making during surgeries.
He highlighted the potential for the technology to improve efficiency and enhance the overall surgical experience for clinicians and patients.
While the full extent of augmented reality’s integration into surgical practice is still being explored, initial successes have sparked optimism among medical professionals.
Dr Perino and his colleagues envision broader applications for spatial computing technology, including educational and training purposes, paving the way for a transformative shift in surgical procedures.
Lloyd Minor, dean of the School of Medicine and vice president of medical affairs at Stanford University, said: ‘The novel use of augmented reality in the operating room exemplifies Stanford Medicine’s mission of serving patients in a digitally driven, human-centred care environment. Our health system has long stood at the vanguard for using digital technologies in medicine.
‘I’m proud that through initiatives like RAISE Health – the joint initiative between Stanford Medicine and the Stanford Institute for Human-Centres Artificial Intelligence to guide the responsible use of AI across biomedical research, education, and patient care – we also define the safe, responsible and equitable use of these innovations.’
Apple unveiled the highly anticipated mixed-reality headset, the Apple Vision Pro, in June 2023.
Photo caption -Alexander Perino using the Apple Vision Pro in an operating room at Stanford Hospital. Credit: Fred Hizal


