A surgeon used augmented reality to assist with minimally invasive cardiac procedures for the first time in Italy.
The procedure was performed by a team led by Francesco Musumeci, senior consultant in cardiac surgery at UPMC-ISMETT in Palermo, Italy.
The team uses technology developed by their research lab to perform a left atrial appendage closure procedure.
The technology provides a 3D organ reconstruction so surgeons can interact with a real-time, computer-generated hologram stimulating the procedure being performed on the patient.
The patient’s chest and heart hologram were reconstructed from the CT scan, and a simulation was created to allow for accurate surgical planning.
Francesco Musumeci explained: ‘We decided to intervene surgically using a minimally invasive method. The ISMETT research lab’s focus on developing augmented and virtual reality in the medical field stimulated us to use these technologies.’
ISMETT’s research on augmented and virtual reality led to the development of precise and efficient technologies for various surgical procedures and patient care settings.
Augmented reality is an interactive experience that enhances real-world procedures through computer-generated perceptual information from images of diagnostic tests, like a CT scan, MRI or ultrasound. It creates a 3D simulation of reality with which surgeons can interact. These real-time, interactive 3D images allow for better anatomy analysis.
Salvatore Pasta is the cardiac research director at the UPMC-ISMETT research lab and a professor at the University of Palermo Department of Engineering.
He said: ‘In this particular case, with augmented reality, the object initially reconstructed from the CT scan was projected in the operating room (OR) onto the patient, improving the surgeon’s perception of the treatment.’
The visor’s semi-transparent screen allows digital content to be overlayed in real time in the natural environment.
Using gestures to manipulate the holographic images inside the visor and having a full view of the OR field, the surgeon can simulate the procedures they will perform, optimising efficiency and minimising risks.
Francesco Musumeci added: ‘Augmented and virtual reality will play an increasingly important role in surgery in the future. It provides planning support and better training opportunities for surgeons.’
Photo caption - Francesco Musumeci, senior consultant in cardiac surgery at UPMC ISMETT, uses augmented reality in cardiac surgery


