Image guidance for robotic minimally invasive coronary artery bypass

Michael Figl, Daniel Rueckert, David Hawkes, Roberto Casula, Mingxing Hu, Ose Pedro, Dong Ping Zhang, Graeme Penney, Fernando Bello, Philip Edwards

Research output: Contribution to journalArticlepeer-review

33 Scopus citations


A novel system for image guidance in totally endoscopic coronary artery bypass (TECAB) is presented. Key requirement is the availability of 2D-3D registration techniques that can deal with non-rigid motion and deformation. Image guidance for TECAB is mainly required before the mechanical stabilisation of the heart, when the most dominant source of misregistration is the deformation and non-rigid motion of the heart. To augment the images in the endoscope of the da Vinci robot, we have to find the transformation from the coordinate system of the preoperative imaging modality to the system of the endoscopic cameras. In a first step we build a 4D motion model of the beating heart. Intraoperatively we can use the ECG or video processing to determine the phase of the cardiac cycle, as well as the heart and respiratory frequencies. We then take the heart surface from the motion model and register it to the stereo endoscopic images of the da Vinci robot resp. of a validation system using photo-consistency. To take advantage of the fact that there is a whole image sequence available for registration, we use the different phases together to get the registration. We found the similarity function to be much smoother when using more phases. This also showed promising behaviour in convergence tests. Images of the vessels available in the preoperative coordinate system can then be transformed to the camera system and projected into the calibrated endoscope view using two video mixers with chroma keying. It is hoped that the augmented view can improve the efficiency of TECAB surgery and reduce the conversion rate to more conventional procedures.

Original languageEnglish
Pages (from-to)61-68
Number of pages8
JournalComputerized Medical Imaging and Graphics
Issue number1
StatePublished - Jan 2010
Externally publishedYes


  • Endoscopic procedures
  • Image-guided therapy
  • Medical robotics
  • Registration


Dive into the research topics of 'Image guidance for robotic minimally invasive coronary artery bypass'. Together they form a unique fingerprint.

Cite this